Chapter 8
Working with images and emoji in the 🦆 Dukki Facebook Corpus
In this chapter, I demonstrate how researchers can incorporate image content and emoji into corpus approaches to social media data. I present data from the Facebook Page of Dukki Gifts & Souvenirs, an independent business based in Nottingham, U.K. and, using a simple annotation scheme, I show how researchers can incorporate image content and emoji into frequency and collocation analysis in order to examine the patterns of use for images in this dataset. I discuss some of the adjustments required to extend approaches conventionally applied to written forms of data to image content, including how this might affect the way we think of core concepts, such as collocation.
Article outline
- 1.Introduction
- 2.Encoding multimodal features
- 3.Businesses and social media
- 4.Dukki and the Dukki Facebook Corpus
- 5.Frequency and distribution of images and emoji
- 6.Collocation
- 6.1Collocates of CANDID images
- 6.2Collocates of ‘Dukki’
- 7.Discussion and conclusion
-
Note
-
References
References
Adolphs, Svenja & Carter, Ronald
2013 Spoken Corpus Linguistics: From Monomodal to Multimodal [
Routledge Advances in Corpus Linguistics 15]. London: Routledge.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Agha, Asif
2003 The social life of cultural value.
Language and Communication 23: 231–273.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Baker, Paul, Gabrielatos, Costas, KhosraviNik, Majod, Krzyžanowski, Michał, McEnery, Tony & Wodak, Ruth
2008 A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press.
Discourse & Society 19(3): 273–306.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bateman, John, Wildfeuer, Janina & Hiippala, Tuomo
2017 Multimodality: Foundations, Research and Analysis – A Problem-Oriented Introduction. Berlin: Mouton de Gruyter.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bednarek, Monika
2015 Corpus-assisted multimodal discourse analysis of television and film narratives. In
Corpora and Discourse Studies: Integrating Discourse and Corpora,
Paul Baker &
Tony McEnery (eds), 63–87. Houndmills: Palgrave Macmillan.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bednarek, Monika & Caple, Helen
2017a The Discourse of News Values: How News Organizations Create Newsworthiness. Oxford: OUP.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bednarek, Monika & Caple, Helen
2017b Introducing a new topology for (multimodal) discourse analysis. In
Transforming Contexts: Papers from the 44th International Systemic Functional Congress,
Phil Chappell &
John S. Knox (eds), 19–25. Wollongong: 44th ISFC Organising Committee.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bou-Franch, Patricia & Blitvich, Pilar Garcés-Conejos
Bouvier, Gwen & Machin, David
2018 Critical Discourse Analysis and the challenges and opportunities of social media.
Review of Communication 18(3): 178–192.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Braber, Natalie & Robinson, Jonnie
2018 East Midlands English [
Dialects of English 15]. Berlin: De Gruyter Mouton.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brezina, Vaclav, McEnery, Tony & Wattam, Stephen
Brezina, Vaclav, Timperley, Matt & McEnery, Tony
2018 #LancsBox v. 4.x [software].
[URL] (29 March 2020).
Caple, Helen
2019 “Lucy says today she is a Labordoodle”: How the dogs-of-Instagram reveal voter preferences.
Social Semiotics 29(4): 427–447.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Caple, Helen, Bednarek, Monika & Anthony, Laurence
2018 Using Kaleidographic to visualize multimodal relations within and across texts.
Visual Communication 17(4): 461–474.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Carr, Caleb T. & Hayes, Rebecca A.
2015 Social media: Defining, developing, and divining.
Atlantic Journal of Communication 23(1): 46–65.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Chen, Jianfu, Kuznetsova, Polina, Warren, David S. & Choi, Yejin
2015 Déjà Image-Captions: A corpus of expressive descriptions in repetition.
Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 504–514. 31 May-5 June 2015, Denver, Colorado.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Collins, Luke C.
2019 Corpus Linguistics for Online Communication. London: Routledge.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Das, Gopal & Hagtvedt, Henrik
2016 Consumer responses to combined arousal-inducing stimuli.
International Journal of Research in Marketing 33(1): 213–215.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Das, Gopal, Wiener, Hillary J. D. & Kareklas, Ioannis
2019 To emoji or not to emoji? Examining the influence of emoji on consumer reactions to advertising.
Journal of Business Research 96: 147–156.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Davis, Mark & Edberg, Peter
2016 Unicode emoji – Unicode technical report #51.
[URL] (17 October 2019).
Dijkmans, Corné, Kerkhof, Peter & Beukeboom, Camiel J.
2015 A stage to engage: Social media use and corporate reputation.
Tourism Management 47: 58–67.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Domingo, Myrrh, Jewitt, Carey & Kress, Gunther
2014 Multimodal social semiotics: Writing in online contexts. In
The Routledge Handbook of Contemporary Literary Studies,
Jennifer Rowsell &
Kate Pahl (eds), 251–266. London: Routledge.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Facebook
2018 Newsroom – A new level of transparency for ads and pages.
[URL] (30 October 2019).
Fullwood, Chris, Orchard, Lisa J. & Floyd, Sarah A.
2013 Emoticon convergence in internet chat rooms.
Social Semiotics 23: 648–662.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ganster, Tina, Eimler, Sabrina C. & Krämer, Nicole C.
2012 Same same but different!? The differential influence of smilies and emoticons on person perception.
Cyberpsychology, Behavior, and Social Networking 15(4): 226–230.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gatt, Albert, Tanti, Marc, Muscat, Adrian, Paggio, Patrizia, Farrugia, Reuben A., Borg, Claudia, Camilleri, Kenneth P., Rosner, Michael & van der Plas, Lonneke
2018 Face2Text: Collecting an annotated image description corpus for the generation of rich face descriptions. In
Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC’18).
[URL] (17 October 2019).
Ge, Jing & Gretzel, Ulrike
2018 Impact of humour on firm-initiated social media conversations.
Information Technology & Tourism 18: 61–83.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ging, Debbie & Garvey, Sarah
2018 ‘Written in these scars are the stories I can’t explain’: A content analysis of pro-ana and thinspiration image sharing on Instagram.
New Media & Society 20(3): 1181–1200.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Glaser, Barney & Strauss, Anselm L.
1967 The Discovery of Grounded Theory. Chicago IL: Aldine.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gretry, Anaïs, Horváth, Csilla, Belei, Nina & van Riel, Allard C .R.
2017 “Don’t pretend to be my friend!” When an informal brand communication style backfires on social media.
Journal of Business Research 74: 77–89.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Hall, Edward T.
1966 The Hidden Dimension. Garden City NY: Doubleday.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
KhosraviNik, Majid
2017 Social Media Critical Discourse Studies (SM-CDS). In
Handbook of Critical Discourse Studies,
John Flowerdew &
John E. Richardson (eds), 582–596. London: Routledge.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Law, Locky
2019 Creativity and television drama: A corpus-based multimodal analysis of pattern-reforming creativity in House M.D.
Corpora 14(2): 135–171.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Li, Xueni S., Chan, Kimmy Wa & Kim, Sara
2018 Service with emoticons: How customers interpret employee use of emoticons in online service encounters.
Journal of Consumer Research 45(5): 973–987.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Luarn, Pin, Lin, Yu-Fan & Chiu, Yu-Ping
2015 Influence of Facebook brand-page posts on online engagement.
Online Information Review 39(4): 505–519.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
McEnery, Tony & Hardie, Andrew
2011 Corpus Linguistics: Method, Theory and Practice. Cambridge: CUP.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Miller, Hannah, Thebault-Spieker, Jacob, Chang, Shuo, Johnson, Isaac, Terveen, Loren & Hecht, Brent
2016 “Blissfully Happy” or “Ready to Fight”: Varying interpretations of emoji. In
Proceedings of the Tenth International AAAI Conference on Web and Social Media (ICWSM 2016).
[URL] (17 October 2019).
Myers, Greg
1996 Words in Ads. London: Edward Arnold.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Norris, Sigrid
2004 Analyzing Multimodal Interaction: A Methodological Framework. London: Routledge.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Obar, Jonathan A. & Wildman, Stephen S.
2015 Social media definition and the governance challenge: An introduction to the special issue.
Telecommunications Policy 39(9): 745–750.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ordenes, Francisco Villarroel, Gewal, Dhruv, Ludwig, Stephan, De Ruyter, Ko, Mahr, Dominik & Wetzels, Martin
2019 Cutting through content clutter: How speech and image acts drive consumer sharing of social media brand messages.
Journal of Consumer Research 45: 988–1012.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Pieters, Rik & Wedel, Michel
2007 Goal control of attention to advertising: The Yarbus implication.
Journal of Consumer Research 34: 224–233.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Poor, Morgan, Duhachek, Adam & Krishnan, H. Shanker
2013 How images of other consumers influence subsequent taste perceptions.
Journal of Marketing 77: 124–139.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rodrigues, David, Prada, Marília, Gaspar, Rui, Garrido, Margarida V. & Lopes, Diniz
2018 Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions.
Behavior Research Methods 50: 392–405.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Russell, Martha G.
2009 A call for creativity in new metrics for liquid media.
Journal of Interactive Advertising 9(2): 44–61.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Scollins, Richard & Titford, John
2000 Ey up mi Duck! Dialect of Derbyshire and the East Midlands. Newbury: Countryside Books.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Spina, Stefania
2019 Role of emoticons as structural markers in Twitter interactions.
Discourse Processes 56(4): 345–362.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Stubbs, Michael
2001 Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Thompson, Roy & Bowen, Christopher J.
2009 Grammar of the Shot. Amsterdam: Focal Press.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wijerante, Sanjaya, Balasuriya, Lakshika, Sheth, Amit & Doran, Derek
2016 EmojiNet: Building a machine readable sense inventory for emoji.
Proceedings of the International Workshop on Social Informatics 10046: 527–541.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Wolf, Maxim, Sims, Julian & Yang, Huadong
2018 Social media? What social media? Paper presented at the Annual Conference of the UK Academy for Information Systems, Oxford.
[URL] (17 October 2019).
Wondwesen, Tafesse
2015 Content strategies and audience response on Facebook brand pages.
Marketing Intelligence & Planning 33(6): 927–943.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Zappavigna, Michele
2016 Social media photography: Construing subjectivity in Instagram images.
Visual Communication 15(3): 271–292.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cited by
Cited by 1 other publications
Collins, Luke C & Paul Baker
2024.
A computer-assisted analysis of image representations of obesity: comparing UK news content with the World Obesity Federation Image Bank.
Visual Communication ![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 18 june 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.