Cover not available
Part of
Corpus Approaches to Social Media
Edited by Sofia Rüdiger and Daria Dayter
[Studies in Corpus Linguistics 98] 2020
► pp. 175–196

Chapter 8
Working with images and emoji in the 🦆 Dukki Facebook Corpus

| Lancaster University

In this chapter, I demonstrate how researchers can incorporate image content and emoji into corpus approaches to social media data. I present data from the Facebook Page of Dukki Gifts & Souvenirs, an independent business based in Nottingham, U.K. and, using a simple annotation scheme, I show how researchers can incorporate image content and emoji into frequency and collocation analysis in order to examine the patterns of use for images in this dataset. I discuss some of the adjustments required to extend approaches conventionally applied to written forms of data to image content, including how this might affect the way we think of core concepts, such as collocation.

Keywords: multimodal, emoji, collocation, Facebook, business
Article outline
  • 1.Introduction
  • 2.Encoding multimodal features
    • 2.1Images
    • 2.2Emoji
  • 3.Businesses and social media
  • 4.Dukki and the Dukki Facebook Corpus
    • 4.1Image annotation
  • 5.Frequency and distribution of images and emoji
  • 6.Collocation
    • 6.1Collocates of CANDID images
    • 6.2Collocates of ‘Dukki’
  • 7.Discussion and conclusion
  • Note
  • References
Published online: 4 November 2020
DOI logo
https://doi.org/10.1075/scl.98.08col
References
Adolphs, Svenja & Carter, Ronald
2013 Spoken Corpus Linguistics: From Monomodal to Multimodal [Routledge Advances in Corpus Linguistics 15]. London: Routledge. DOI logoGoogle Scholar
Agha, Asif
2003 The social life of cultural value. Language and Communication 23: 231–273. DOI logoGoogle Scholar
Baker, Paul, Gabrielatos, Costas, KhosraviNik, Majod, Krzyžanowski, Michał, McEnery, Tony & Wodak, Ruth
2008 A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press. Discourse & Society 19(3): 273–306. DOI logoGoogle Scholar
Bateman, John, Wildfeuer, Janina & Hiippala, Tuomo
2017 Multimodality: Foundations, Research and Analysis – A Problem-Oriented Introduction. Berlin: Mouton de Gruyter. DOI logoGoogle Scholar
Bednarek, Monika
2015 Corpus-assisted multimodal discourse analysis of television and film narratives. In Corpora and Discourse Studies: Integrating Discourse and Corpora, Paul Baker & Tony McEnery (eds), 63–87. Houndmills: Palgrave Macmillan. DOI logoGoogle Scholar
Bednarek, Monika & Caple, Helen
2017a The Discourse of News Values: How News Organizations Create Newsworthiness. Oxford: OUP. DOI logoGoogle Scholar
2017b Introducing a new topology for (multimodal) discourse analysis. In Transforming Contexts: Papers from the 44th International Systemic Functional Congress, Phil Chappell & John S. Knox (eds), 19–25. Wollongong: 44th ISFC Organising Committee.Google Scholar
Bou-Franch, Patricia & Blitvich, Pilar Garcés-Conejos
2018 Relational work in multimodal networked interactions on Facebook. Internet Pragmatics 1(1): 134–160. DOI logoGoogle Scholar
Bouvier, Gwen & Machin, David
2018 Critical Discourse Analysis and the challenges and opportunities of social media. Review of Communication 18(3): 178–192. DOI logoGoogle Scholar
Braber, Natalie & Robinson, Jonnie
2018 East Midlands English [Dialects of English 15]. Berlin: De Gruyter Mouton. DOI logoGoogle Scholar
Brezina, Vaclav, McEnery, Tony & Wattam, Stephen
2015 Collocations in context: A new perspective on collocation networks. International Journal of Corpus Linguistics 20(2): 139–173. DOI logoGoogle Scholar
Brezina, Vaclav, Timperley, Matt & McEnery, Tony
2018 #LancsBox v. 4.x [software]. [URL] (29 March 2020).
Caple, Helen
2019 “Lucy says today she is a Labordoodle”: How the dogs-of-Instagram reveal voter preferences. Social Semiotics 29(4): 427–447. DOI logoGoogle Scholar
Caple, Helen, Bednarek, Monika & Anthony, Laurence
2018 Using Kaleidographic to visualize multimodal relations within and across texts. Visual Communication 17(4): 461–474. DOI logoGoogle Scholar
Carr, Caleb T. & Hayes, Rebecca A.
2015 Social media: Defining, developing, and divining. Atlantic Journal of Communication 23(1): 46–65. DOI logoGoogle Scholar
Chen, Jianfu, Kuznetsova, Polina, Warren, David S. & Choi, Yejin
2015 Déjà Image-Captions: A corpus of expressive descriptions in repetition. Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 504–514. 31 May-5 June 2015, Denver, Colorado.Google Scholar
Collins, Luke C.
2019 Corpus Linguistics for Online Communication. London: Routledge. DOI logoGoogle Scholar
Das, Gopal & Hagtvedt, Henrik
2016 Consumer responses to combined arousal-inducing stimuli. International Journal of Research in Marketing 33(1): 213–215. DOI logoGoogle Scholar
Das, Gopal, Wiener, Hillary J. D. & Kareklas, Ioannis
2019 To emoji or not to emoji? Examining the influence of emoji on consumer reactions to advertising. Journal of Business Research 96: 147–156. DOI logoGoogle Scholar
Davis, Mark & Edberg, Peter
2016 Unicode emoji – Unicode technical report #51. [URL] (17 October 2019).
Dijkmans, Corné, Kerkhof, Peter & Beukeboom, Camiel J.
2015 A stage to engage: Social media use and corporate reputation. Tourism Management 47: 58–67. DOI logoGoogle Scholar
Domingo, Myrrh, Jewitt, Carey & Kress, Gunther
2014 Multimodal social semiotics: Writing in online contexts. In The Routledge Handbook of Contemporary Literary Studies, Jennifer Rowsell & Kate Pahl (eds), 251–266. London: Routledge.Google Scholar
Facebook
2018 Newsroom – A new level of transparency for ads and pages. [URL] (30 October 2019).
Fullwood, Chris, Orchard, Lisa J. & Floyd, Sarah A.
2013 Emoticon convergence in internet chat rooms. Social Semiotics 23: 648–662. DOI logoGoogle Scholar
Ganster, Tina, Eimler, Sabrina C. & Krämer, Nicole C.
2012 Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking 15(4): 226–230. DOI logoGoogle Scholar
Gatt, Albert, Tanti, Marc, Muscat, Adrian, Paggio, Patrizia, Farrugia, Reuben A., Borg, Claudia, Camilleri, Kenneth P., Rosner, Michael & van der Plas, Lonneke
2018 Face2Text: Collecting an annotated image description corpus for the generation of rich face descriptions. In Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC’18). [URL] (17 October 2019).
Ge, Jing & Gretzel, Ulrike
2018 Impact of humour on firm-initiated social media conversations. Information Technology & Tourism 18: 61–83. DOI logoGoogle Scholar
Ging, Debbie & Garvey, Sarah
2018 ‘Written in these scars are the stories I can’t explain’: A content analysis of pro-ana and thinspiration image sharing on Instagram. New Media & Society 20(3): 1181–1200. DOI logoGoogle Scholar
Glaser, Barney & Strauss, Anselm L.
1967 The Discovery of Grounded Theory. Chicago IL: Aldine.Google Scholar
Gretry, Anaïs, Horváth, Csilla, Belei, Nina & van Riel, Allard C .R.
2017 “Don’t pretend to be my friend!” When an informal brand communication style backfires on social media. Journal of Business Research 74: 77–89. DOI logoGoogle Scholar
Hall, Edward T.
1966 The Hidden Dimension. Garden City NY: Doubleday.Google Scholar
Hardie, Andrew
2012 CQPweb – Combining power, flexibility and usability in a corpus analysis tool. International Journal of Corpus Linguistics 17(3): 380–409. DOI logoGoogle Scholar
KhosraviNik, Majid
2017 Social Media Critical Discourse Studies (SM-CDS). In Handbook of Critical Discourse Studies, John Flowerdew & John E. Richardson (eds), 582–596. London: Routledge. DOI logoGoogle Scholar
Law, Locky
2019 Creativity and television drama: A corpus-based multimodal analysis of pattern-reforming creativity in House M.D. Corpora 14(2): 135–171. DOI logoGoogle Scholar
Li, Xueni S., Chan, Kimmy Wa & Kim, Sara
2018 Service with emoticons: How customers interpret employee use of emoticons in online service encounters. Journal of Consumer Research 45(5): 973–987. DOI logoGoogle Scholar
Luarn, Pin, Lin, Yu-Fan & Chiu, Yu-Ping
2015 Influence of Facebook brand-page posts on online engagement. Online Information Review 39(4): 505–519. DOI logoGoogle Scholar
McEnery, Tony & Hardie, Andrew
2011 Corpus Linguistics: Method, Theory and Practice. Cambridge: CUP. DOI logoGoogle Scholar
Miller, Hannah, Thebault-Spieker, Jacob, Chang, Shuo, Johnson, Isaac, Terveen, Loren & Hecht, Brent
2016 “Blissfully Happy” or “Ready to Fight”: Varying interpretations of emoji. In Proceedings of the Tenth International AAAI Conference on Web and Social Media (ICWSM 2016). [URL] (17 October 2019).
Myers, Greg
1996 Words in Ads. London: Edward Arnold.Google Scholar
Norris, Sigrid
2004 Analyzing Multimodal Interaction: A Methodological Framework. London: Routledge. DOI logoGoogle Scholar
Obar, Jonathan A. & Wildman, Stephen S.
2015 Social media definition and the governance challenge: An introduction to the special issue. Telecommunications Policy 39(9): 745–750. DOI logoGoogle Scholar
Ordenes, Francisco Villarroel, Gewal, Dhruv, Ludwig, Stephan, De Ruyter, Ko, Mahr, Dominik & Wetzels, Martin
2019 Cutting through content clutter: How speech and image acts drive consumer sharing of social media brand messages. Journal of Consumer Research 45: 988–1012. DOI logoGoogle Scholar
Pieters, Rik & Wedel, Michel
2007 Goal control of attention to advertising: The Yarbus implication. Journal of Consumer Research 34: 224–233. DOI logoGoogle Scholar
Poor, Morgan, Duhachek, Adam & Krishnan, H. Shanker
2013 How images of other consumers influence subsequent taste perceptions. Journal of Marketing 77: 124–139. DOI logoGoogle Scholar
Rodrigues, David, Prada, Marília, Gaspar, Rui, Garrido, Margarida V. & Lopes, Diniz
2018 Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behavior Research Methods 50: 392–405. DOI logoGoogle Scholar
Russell, Martha G.
2009 A call for creativity in new metrics for liquid media. Journal of Interactive Advertising 9(2): 44–61. DOI logoGoogle Scholar
Scollins, Richard & Titford, John
2000 Ey up mi Duck! Dialect of Derbyshire and the East Midlands. Newbury: Countryside Books.Google Scholar
Spina, Stefania
2019 Role of emoticons as structural markers in Twitter interactions. Discourse Processes 56(4): 345–362. DOI logoGoogle Scholar
Stubbs, Michael
2001 Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell.Google Scholar
Thompson, Roy & Bowen, Christopher J.
2009 Grammar of the Shot. Amsterdam: Focal Press.Google Scholar
Wijerante, Sanjaya, Balasuriya, Lakshika, Sheth, Amit & Doran, Derek
2016 EmojiNet: Building a machine readable sense inventory for emoji. Proceedings of the International Workshop on Social Informatics 10046: 527–541. DOI logoGoogle Scholar
Wolf, Maxim, Sims, Julian & Yang, Huadong
2018 Social media? What social media? Paper presented at the Annual Conference of the UK Academy for Information Systems, Oxford. [URL] (17 October 2019).
Wondwesen, Tafesse
2015 Content strategies and audience response on Facebook brand pages. Marketing Intelligence & Planning 33(6): 927–943. DOI logoGoogle Scholar
Zappavigna, Michele
2016 Social media photography: Construing subjectivity in Instagram images. Visual Communication 15(3): 271–292. DOI logoGoogle Scholar