Chapter 8
Working with images and emoji in the 🦆 Dukki Facebook Corpus
In this chapter, I demonstrate how researchers can incorporate image content and emoji into corpus approaches to social media data. I present data from the Facebook Page of Dukki Gifts & Souvenirs, an independent business based in Nottingham, U.K. and, using a simple annotation scheme, I show how researchers can incorporate image content and emoji into frequency and collocation analysis in order to examine the patterns of use for images in this dataset. I discuss some of the adjustments required to extend approaches conventionally applied to written forms of data to image content, including how this might affect the way we think of core concepts, such as collocation.
Article outline
- 1.Introduction
- 2.Encoding multimodal features
- 3.Businesses and social media
- 4.Dukki and the Dukki Facebook Corpus
- 5.Frequency and distribution of images and emoji
- 6.Collocation
- 6.1Collocates of CANDID images
- 6.2Collocates of ‘Dukki’
- 7.Discussion and conclusion
-
Note
-
References
References (54)
References
Adolphs, Svenja & Carter, Ronald. 2013. Spoken Corpus Linguistics: From Monomodal to Multimodal [Routledge Advances in Corpus Linguistics 15]. London: Routledge.
Agha, Asif. 2003. The social life of cultural value. Language and Communication 23: 231–273.
Baker, Paul, Gabrielatos, Costas, KhosraviNik, Majod, Krzyžanowski, Michał, McEnery, Tony & Wodak, Ruth. 2008. A useful methodological synergy? Combining critical discourse analysis and corpus linguistics to examine discourses of refugees and asylum seekers in the UK press. Discourse & Society 19(3): 273–306.
Bateman, John, Wildfeuer, Janina & Hiippala, Tuomo. 2017. Multimodality: Foundations, Research and Analysis – A Problem-Oriented Introduction. Berlin: Mouton de Gruyter.
Bednarek, Monika. 2015. Corpus-assisted multimodal discourse analysis of television and film narratives. In Corpora and Discourse Studies: Integrating Discourse and Corpora, Paul Baker & Tony McEnery (eds), 63–87. Houndmills: Palgrave Macmillan.
Bednarek, Monika & Caple, Helen. 2017a. The Discourse of News Values: How News Organizations Create Newsworthiness. Oxford: OUP.
Bednarek, Monika & Caple, Helen. 2017b. Introducing a new topology for (multimodal) discourse analysis. In Transforming Contexts: Papers from the 44th International Systemic Functional Congress, Phil Chappell & John S. Knox (eds), 19–25. Wollongong: 44th ISFC Organising Committee.
Bouvier, Gwen & Machin, David. 2018. Critical Discourse Analysis and the challenges and opportunities of social media. Review of Communication 18(3): 178–192.
Braber, Natalie & Robinson, Jonnie. 2018. East Midlands English [Dialects of English 15]. Berlin: De Gruyter Mouton.
Brezina, Vaclav, Timperley, Matt & McEnery, Tony. 2018. #LancsBox v. 4.x [software]. <[URL]> (29 March 2020).
Caple, Helen. 2019. “Lucy says today she is a Labordoodle”: How the dogs-of-Instagram reveal voter preferences. Social Semiotics 29(4): 427–447.
Caple, Helen, Bednarek, Monika & Anthony, Laurence. 2018. Using Kaleidographic to visualize multimodal relations within and across texts. Visual Communication 17(4): 461–474.
Carr, Caleb T. & Hayes, Rebecca A. 2015. Social media: Defining, developing, and divining. Atlantic Journal of Communication 23(1): 46–65.
Chen, Jianfu, Kuznetsova, Polina, Warren, David S. & Choi, Yejin. 2015. Déjà Image-Captions: A corpus of expressive descriptions in repetition. Human Language Technologies: The 2015 Annual Conference of the North American Chapter of the ACL, 504–514. 31 May-5 June 2015, Denver, Colorado.
Collins, Luke C. 2019. Corpus Linguistics for Online Communication. London: Routledge.
Das, Gopal & Hagtvedt, Henrik. 2016. Consumer responses to combined arousal-inducing stimuli. International Journal of Research in Marketing 33(1): 213–215.
Das, Gopal, Wiener, Hillary J. D. & Kareklas, Ioannis. 2019. To emoji or not to emoji? Examining the influence of emoji on consumer reactions to advertising. Journal of Business Research 96: 147–156.
Davis, Mark & Edberg, Peter. 2016. Unicode emoji – Unicode technical report #51. <[URL]> (17 October 2019).
Dijkmans, Corné, Kerkhof, Peter & Beukeboom, Camiel J. 2015. A stage to engage: Social media use and corporate reputation. Tourism Management 47: 58–67.
Domingo, Myrrh, Jewitt, Carey & Kress, Gunther. 2014. Multimodal social semiotics: Writing in online contexts. In The Routledge Handbook of Contemporary Literary Studies, Jennifer Rowsell & Kate Pahl (eds), 251–266. London: Routledge.
Facebook. 2018. Newsroom – A new level of transparency for ads and pages. <[URL]> (30 October 2019).
Fullwood, Chris, Orchard, Lisa J. & Floyd, Sarah A. 2013. Emoticon convergence in internet chat rooms. Social Semiotics 23: 648–662.
Ganster, Tina, Eimler, Sabrina C. & Krämer, Nicole C. 2012. Same same but different!? The differential influence of smilies and emoticons on person perception. Cyberpsychology, Behavior, and Social Networking 15(4): 226–230.
Gatt, Albert, Tanti, Marc, Muscat, Adrian, Paggio, Patrizia, Farrugia, Reuben A., Borg, Claudia, Camilleri, Kenneth P., Rosner, Michael & van der Plas, Lonneke. 2018. Face2Text: Collecting an annotated image description corpus for the generation of rich face descriptions. In Proceedings of the 11th Edition of the Language Resources and Evaluation Conference (LREC’18). <[URL]> (17 October 2019).
Ge, Jing & Gretzel, Ulrike. 2018. Impact of humour on firm-initiated social media conversations. Information Technology & Tourism 18: 61–83.
Ging, Debbie & Garvey, Sarah. 2018. ‘Written in these scars are the stories I can’t explain’: A content analysis of pro-ana and thinspiration image sharing on Instagram. New Media & Society 20(3): 1181–1200.
Glaser, Barney & Strauss, Anselm L. 1967. The Discovery of Grounded Theory. Chicago IL: Aldine.
Gretry, Anaïs, Horváth, Csilla, Belei, Nina & van Riel, Allard C .R. 2017. “Don’t pretend to be my friend!” When an informal brand communication style backfires on social media. Journal of Business Research 74: 77–89.
Hall, Edward T. 1966. The Hidden Dimension. Garden City NY: Doubleday.
KhosraviNik, Majid. 2017. Social Media Critical Discourse Studies (SM-CDS). In Handbook of Critical Discourse Studies, John Flowerdew & John E. Richardson (eds), 582–596. London: Routledge.
Law, Locky. 2019. Creativity and television drama: A corpus-based multimodal analysis of pattern-reforming creativity in House M.D. Corpora 14(2): 135–171.
Li, Xueni S., Chan, Kimmy Wa & Kim, Sara. 2018. Service with emoticons: How customers interpret employee use of emoticons in online service encounters. Journal of Consumer Research 45(5): 973–987.
Luarn, Pin, Lin, Yu-Fan & Chiu, Yu-Ping. 2015. Influence of Facebook brand-page posts on online engagement. Online Information Review 39(4): 505–519.
McEnery, Tony & Hardie, Andrew. 2011. Corpus Linguistics: Method, Theory and Practice. Cambridge: CUP.
Miller, Hannah, Thebault-Spieker, Jacob, Chang, Shuo, Johnson, Isaac, Terveen, Loren & Hecht, Brent. 2016. “Blissfully Happy” or “Ready to Fight”: Varying interpretations of emoji. In Proceedings of the Tenth International AAAI Conference on Web and Social Media (ICWSM 2016). <[URL]> (17 October 2019).
Myers, Greg. 1996. Words in Ads. London: Edward Arnold.
Norris, Sigrid. 2004. Analyzing Multimodal Interaction: A Methodological Framework. London: Routledge.
Obar, Jonathan A. & Wildman, Stephen S. 2015. Social media definition and the governance challenge: An introduction to the special issue. Telecommunications Policy 39(9): 745–750.
Ordenes, Francisco Villarroel, Gewal, Dhruv, Ludwig, Stephan, De Ruyter, Ko, Mahr, Dominik & Wetzels, Martin. 2019. Cutting through content clutter: How speech and image acts drive consumer sharing of social media brand messages. Journal of Consumer Research 45: 988–1012.
Pieters, Rik & Wedel, Michel. 2007. Goal control of attention to advertising: The Yarbus implication. Journal of Consumer Research 34: 224–233.
Poor, Morgan, Duhachek, Adam & Krishnan, H. Shanker. 2013. How images of other consumers influence subsequent taste perceptions. Journal of Marketing 77: 124–139.
Rodrigues, David, Prada, Marília, Gaspar, Rui, Garrido, Margarida V. & Lopes, Diniz. 2018. Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behavior Research Methods 50: 392–405.
Russell, Martha G. 2009. A call for creativity in new metrics for liquid media. Journal of Interactive Advertising 9(2): 44–61.
Scollins, Richard & Titford, John. 2000. Ey up mi Duck! Dialect of Derbyshire and the East Midlands. Newbury: Countryside Books.
Spina, Stefania. 2019. Role of emoticons as structural markers in Twitter interactions. Discourse Processes 56(4): 345–362.
Stubbs, Michael. 2001. Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell.
Thompson, Roy & Bowen, Christopher J. 2009. Grammar of the Shot. Amsterdam: Focal Press.
Wijerante, Sanjaya, Balasuriya, Lakshika, Sheth, Amit & Doran, Derek. 2016. EmojiNet: Building a machine readable sense inventory for emoji. Proceedings of the International Workshop on Social Informatics 10046: 527–541.
Wolf, Maxim, Sims, Julian & Yang, Huadong. 2018. Social media? What social media? Paper presented at the Annual Conference of the UK Academy for Information Systems, Oxford. <[URL]> (17 October 2019).
Wondwesen, Tafesse. 2015. Content strategies and audience response on Facebook brand pages. Marketing Intelligence & Planning 33(6): 927–943.
Zappavigna, Michele. 2016. Social media photography: Construing subjectivity in Instagram images. Visual Communication 15(3): 271–292.
Cited by (1)
Cited by one other publication
Collins, Luke C & Paul Baker
2024.
A computer-assisted analysis of image representations of obesity: comparing UK news content with the World Obesity Federation Image Bank.
Visual Communication
This list is based on CrossRef data as of 19 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.