Chapter 8
Working with images and emoji in the 🦆 Dukki Facebook Corpus
In this chapter, I demonstrate how researchers can incorporate image content and emoji into corpus approaches to social media data. I present data from the Facebook Page of Dukki Gifts & Souvenirs, an independent business based in Nottingham, U.K. and, using a simple annotation scheme, I show how researchers can incorporate image content and emoji into frequency and collocation analysis in order to examine the patterns of use for images in this dataset. I discuss some of the adjustments required to extend approaches conventionally applied to written forms of data to image content, including how this might affect the way we think of core concepts, such as collocation.
Article outline
- 1.Introduction
- 2.Encoding multimodal features
- 3.Businesses and social media
- 4.Dukki and the Dukki Facebook Corpus
- 5.Frequency and distribution of images and emoji
- 6.Collocation
- 6.1Collocates of CANDID images
- 6.2Collocates of ‘Dukki’
- 7.Discussion and conclusion
-
Note
-
References
References
Adolphs, Svenja & Carter, Ronald
2013 Spoken Corpus Linguistics: From Monomodal to Multimodal [
Routledge Advances in Corpus Linguistics 15]. London: Routledge.
Agha, Asif
2003 The social life of cultural value.
Language and Communication 23: 231–273.
Baker, Paul, Gabrielatos, Costas, KhosraviNik, Majod, Krzyžanowski, Michał, McEnery, Tony & Wodak, Ruth
2008 A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press.
Discourse & Society 19(3): 273–306.
Bateman, John, Wildfeuer, Janina & Hiippala, Tuomo
2017 Multimodality: Foundations, Research and Analysis – A Problem-Oriented Introduction. Berlin: Mouton de Gruyter.
Bednarek, Monika
2015 Corpus-assisted multimodal discourse analysis of television and film narratives. In
Corpora and Discourse Studies: Integrating Discourse and Corpora,
Paul Baker &
Tony McEnery (eds), 63–87. Houndmills: Palgrave Macmillan.
Bednarek, Monika & Caple, Helen
2017a The Discourse of News Values: How News Organizations Create Newsworthiness. Oxford: OUP.
Bednarek, Monika & Caple, Helen
2017b Introducing a new topology for (multimodal) discourse analysis. In
Transforming Contexts: Papers from the 44th International Systemic Functional Congress,
Phil Chappell &
John S. Knox (eds), 19–25. Wollongong: 44th ISFC Organising Committee.
Bou-Franch, Patricia & Blitvich, Pilar Garcés-Conejos
Bouvier, Gwen & Machin, David
2018 Critical Discourse Analysis and the challenges and opportunities of social media.
Review of Communication 18(3): 178–192.
Braber, Natalie & Robinson, Jonnie
2018 East Midlands English [
Dialects of English 15]. Berlin: De Gruyter Mouton.
Brezina, Vaclav, McEnery, Tony & Wattam, Stephen
Brezina, Vaclav, Timperley, Matt & McEnery, Tony
2018 #LancsBox v. 4.x [software].
[URL] (29 March 2020).
Caple, Helen
2019 “Lucy says today she is a Labordoodle”: How the dogs-of-Instagram reveal voter preferences.
Social Semiotics 29(4): 427–447.
Caple, Helen, Bednarek, Monika & Anthony, Laurence
2018 Using Kaleidographic to visualize multimodal relations within and across texts.
Visual Communication 17(4): 461–474.
Carr, Caleb T. & Hayes, Rebecca A.
2015 Social media: Defining, developing, and divining.
Atlantic Journal of Communication 23(1): 46–65.
Chen, Jianfu, Kuznetsova, Polina, Warren, David S. & Choi, Yejin
2015 Déjà Image-Captions: A corpus of expressive descriptions in repetition.
Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 504–514. 31 May-5 June 2015, Denver, Colorado.
Collins, Luke C.
2019 Corpus Linguistics for Online Communication. London: Routledge.
Das, Gopal & Hagtvedt, Henrik
2016 Consumer responses to combined arousal-inducing stimuli.
International Journal of Research in Marketing 33(1): 213–215.
Das, Gopal, Wiener, Hillary J. D. & Kareklas, Ioannis
2019 To emoji or not to emoji? Examining the influence of emoji on consumer reactions to advertising.
Journal of Business Research 96: 147–156.
Davis, Mark & Edberg, Peter
2016 Unicode emoji – Unicode technical report #51.
[URL] (17 October 2019).
Dijkmans, Corné, Kerkhof, Peter & Beukeboom, Camiel J.
2015 A stage to engage: Social media use and corporate reputation.
Tourism Management 47: 58–67.
Domingo, Myrrh, Jewitt, Carey & Kress, Gunther
2014 Multimodal social semiotics: Writing in online contexts. In
The Routledge Handbook of Contemporary Literary Studies,
Jennifer Rowsell &
Kate Pahl (eds), 251–266. London: Routledge.
Facebook
2018 Newsroom – A new level of transparency for ads and pages.
[URL] (30 October 2019).
Fullwood, Chris, Orchard, Lisa J. & Floyd, Sarah A.
2013 Emoticon convergence in internet chat rooms.
Social Semiotics 23: 648–662.
Ganster, Tina, Eimler, Sabrina C. & Krämer, Nicole C.
2012 Same same but different!? The differential influence of smilies and emoticons on person perception.
Cyberpsychology, Behavior, and Social Networking 15(4): 226–230.
Gatt, Albert, Tanti, Marc, Muscat, Adrian, Paggio, Patrizia, Farrugia, Reuben A., Borg, Claudia, Camilleri, Kenneth P., Rosner, Michael & van der Plas, Lonneke
2018 Face2Text: Collecting an annotated image description corpus for the generation of rich face descriptions. In
Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC’18).
[URL] (17 October 2019).
Ge, Jing & Gretzel, Ulrike
2018 Impact of humour on firm-initiated social media conversations.
Information Technology & Tourism 18: 61–83.
Ging, Debbie & Garvey, Sarah
2018 ‘Written in these scars are the stories I can’t explain’: A content analysis of pro-ana and thinspiration image sharing on Instagram.
New Media & Society 20(3): 1181–1200.
Glaser, Barney & Strauss, Anselm L.
1967 The Discovery of Grounded Theory. Chicago IL: Aldine.
Gretry, Anaïs, Horváth, Csilla, Belei, Nina & van Riel, Allard C .R.
2017 “Don’t pretend to be my friend!” When an informal brand communication style backfires on social media.
Journal of Business Research 74: 77–89.
Hall, Edward T.
1966 The Hidden Dimension. Garden City NY: Doubleday.
KhosraviNik, Majid
2017 Social Media Critical Discourse Studies (SM-CDS). In
Handbook of Critical Discourse Studies,
John Flowerdew &
John E. Richardson (eds), 582–596. London: Routledge.
Law, Locky
2019 Creativity and television drama: A corpus-based multimodal analysis of pattern-reforming creativity in House M.D.
Corpora 14(2): 135–171.
Li, Xueni S., Chan, Kimmy Wa & Kim, Sara
2018 Service with emoticons: How customers interpret employee use of emoticons in online service encounters.
Journal of Consumer Research 45(5): 973–987.
Luarn, Pin, Lin, Yu-Fan & Chiu, Yu-Ping
2015 Influence of Facebook brand-page posts on online engagement.
Online Information Review 39(4): 505–519.
McEnery, Tony & Hardie, Andrew
2011 Corpus Linguistics: Method, Theory and Practice. Cambridge: CUP.
Miller, Hannah, Thebault-Spieker, Jacob, Chang, Shuo, Johnson, Isaac, Terveen, Loren & Hecht, Brent
2016 “Blissfully Happy” or “Ready to Fight”: Varying interpretations of emoji. In
Proceedings of the Tenth International AAAI Conference on Web and Social Media (ICWSM 2016).
[URL] (17 October 2019).
Myers, Greg
1996 Words in Ads. London: Edward Arnold.
Norris, Sigrid
2004 Analyzing Multimodal Interaction: A Methodological Framework. London: Routledge.
Obar, Jonathan A. & Wildman, Stephen S.
2015 Social media definition and the governance challenge: An introduction to the special issue.
Telecommunications Policy 39(9): 745–750.
Ordenes, Francisco Villarroel, Gewal, Dhruv, Ludwig, Stephan, De Ruyter, Ko, Mahr, Dominik & Wetzels, Martin
2019 Cutting through content clutter: How speech and image acts drive consumer sharing of social media brand messages.
Journal of Consumer Research 45: 988–1012.
Pieters, Rik & Wedel, Michel
2007 Goal control of attention to advertising: The Yarbus implication.
Journal of Consumer Research 34: 224–233.
Poor, Morgan, Duhachek, Adam & Krishnan, H. Shanker
2013 How images of other consumers influence subsequent taste perceptions.
Journal of Marketing 77: 124–139.
Rodrigues, David, Prada, Marília, Gaspar, Rui, Garrido, Margarida V. & Lopes, Diniz
2018 Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions.
Behavior Research Methods 50: 392–405.
Russell, Martha G.
2009 A call for creativity in new metrics for liquid media.
Journal of Interactive Advertising 9(2): 44–61.
Scollins, Richard & Titford, John
2000 Ey up mi Duck! Dialect of Derbyshire and the East Midlands. Newbury: Countryside Books.
Spina, Stefania
2019 Role of emoticons as structural markers in Twitter interactions.
Discourse Processes 56(4): 345–362.
Stubbs, Michael
2001 Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell.
Thompson, Roy & Bowen, Christopher J.
2009 Grammar of the Shot. Amsterdam: Focal Press.
Wijerante, Sanjaya, Balasuriya, Lakshika, Sheth, Amit & Doran, Derek
2016 EmojiNet: Building a machine readable sense inventory for emoji.
Proceedings of the International Workshop on Social Informatics 10046: 527–541.
Wolf, Maxim, Sims, Julian & Yang, Huadong
2018 Social media? What social media? Paper presented at the Annual Conference of the UK Academy for Information Systems, Oxford.
[URL] (17 October 2019).
Wondwesen, Tafesse
2015 Content strategies and audience response on Facebook brand pages.
Marketing Intelligence & Planning 33(6): 927–943.
Zappavigna, Michele
2016 Social media photography: Construing subjectivity in Instagram images.
Visual Communication 15(3): 271–292.
Cited by
Cited by 1 other publications
Collins, Luke C & Paul Baker
2024.
A computer-assisted analysis of image representations of obesity: comparing UK news content with the World Obesity Federation Image Bank.
Visual Communication
This list is based on CrossRef data as of 15 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.