Article published in:
Language and Covid-19
Edited by Michaela Mahlberg and Gavin Brookes
[International Journal of Corpus Linguistics 26:4] 2021
► pp. 498–531

Communicating the unknown

An interdisciplinary annotation study of uncertainty in the coronavirus pandemic

| TU Darmstadt
| TU Darmstadt
| University of Melbourne
This paper presents an annotation approach to examine uncertainty in British and German newspaper articles on the coronavirus pandemic. We develop a tagset in an interdisciplinary team from corpus linguistics and sociology. After working out a gold standard on a pilot corpus, we apply the annotation to the entire corpus drawing on an “annotation-by-query” approach in CQPWeb, based on uncertainty constructions that have been extracted from the gold standard data. The annotated data are then evaluated and sociologically contextualised. On this basis, we study the development of uncertainty markers in the period under study and compare media discourses in Germany and the UK. Our findings reflect the different courses of the pandemic in Germany and the UK as well as the different political responses, media traditions and cultural concerns: While markers of fear are more important in British discourse, we see a steadily increasing level of disagreement in German discourse. Other forms of uncertainty such as ‘possibility’ or ‘probability’ are similarly frequent in both discourses.
Keywords: uncertainty, annotation, interdisciplinarity, Covid-19 discourse
Article outline
  • 1.Introduction
  • 2.Uncertainty in media discourses on COVID-19
    • 2.1Concepts of uncertainty
    • 2.2Linguistic uncertainty markers
  • 3.Methodology
    • 3.1Corpus and tools
    • 3.2Annotation scheme and gold standard development
    • 3.3Annotation by query: Extraction of constructions and operationalisation
      • 3.3.1Indications of personal uncertainty
        • Anxiety
        • Disagreement
        • Doubt
        • Ignorance
        • Presumption
      • 3.3.2Indications of situational uncertainty
        • Danger
        • Opportunity
        • Possibility
        • Probability
        • Vagueness
      • 3.3.3Operationalisation: CQL queries
  • 4.Results
    • 4.1Personal uncertainty markers
    • 4.2Situational uncertainty markers
  • 5.Conclusions
  • Acknowledgements
  • References
Published online: 23 August 2021
https://doi.org/10.1075/ijcl.21096.mul
References
Adams, J.
(2016) Risk and culture. In A. Burgess, A. Alemanno, & J. O. Zinn (Eds.), Routledge Handbook of Risk Studies (pp. 83–93). Routledge.Google Scholar
Bednarek, M.
(2006) Evaluation in Media Discourse: Analysis of a Newspaper Corpus. Continuum.Google Scholar
Biber, D., & Finegan, E.
(1989) Styles of stance in English: Lexical and grammatical marking of evidentiality and affect. Text & Talk, 9(1), 93–124. CrossrefGoogle Scholar
Boholm, M.
(2012) The semantic distinction between “risk” and “danger”: A linguistic analysis. Risk Analysis, 32(2), 281–293. CrossrefGoogle Scholar
Boogaart, R., & Fortuin, E.
(2016) Modality and mood in cognitive linguistics and construction grammars. In J. Nuyts & J. Van der Auwera (Eds.), Oxford Handbook of Modality and Mood (pp. 514–533). Oxford University Press.Google Scholar
Collins, L., & Nerlich, B.
(2016) Uncertainty discourses in the context of climate change: A corpus-assisted analysis of UK national newspaper articles. Communications – the European Journal of Communication Research, 41(3), 291–313. CrossrefGoogle Scholar
Covello, V. T.
(2009) Strategies for overcoming challenges to effective risk communication. In R. L. Heath & H. D. O’Hair (Eds.), Handbook of Risk and Crisis Communication (pp. 143–167). Routledge.Google Scholar
DF (Deutschlandfunk)
(2020, February 27). “Große Unsicherheit, die wir alle teilen.” Marlis Prinzing im Gespräch mit Sebastian Wellendorf. [“Great uncertainty that we all share.” Marlis Prinzing in conversation with Sebastian Wellendorf]. https://​www​.deutschlandfunk​.de​/medien​-und​-coronavirus​-grosse​-unsicherheit​-die​-wir​-alle​.2907​.de​.html​?dram:article​_id​=471231
Eckart de Castilho, R., Bartsch, S., & Gurevych, I.
(2012) CSNIPER – Annotation-by-query for non-canonical constructions in large corpora. In M. Zhang (Ed.), Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (pp. 85–90). Association for Computational Linguistics. https://​www​.aclweb​.org​/anthology​/P12​-3015
Evert, S., & The CWB Development Team
(2020) The IMS Corpus Workbench (CWB): CQP Query Language Tutorial. CWB Version. http://​cwb​.sourceforge​.net​/files​/CQP​_Tutorial​.pdf
Fischhoff, B.
(1998) Risk perception and communication unplugged: Twenty years of process. In R. Löfstedt & L. Frewer (Eds.), The Earthscan Reader in Risk and Modern Society (pp. 133–148). Earthscan.Google Scholar
Francis, G., Hunston, S., & Manning, E.
(1998) Collins Cobuild Grammar Patterns 2: Nouns and Adjectives. HarperCollins.Google Scholar
Gesser-Edelsburg, A., & Shir-Raz, Y.
(2018) Communicating risk for issues that involve ‘uncertainty bias’: What can the Israeli case of water fluoridation teach us? Journal of Risk Research, 21(4), 395–416. CrossrefGoogle Scholar
Greve, W., & Wentura, D.
(1997) Wissenschaftliche Beobachtung: Eine Einführung [Scientific Observation: An Introduction]. PVU/Beltz.Google Scholar
Gross, M.
(2007) The unknown in process: Dynamic connections of ignorance, non-knowledge and related concepts. Current Sociology, 55(5), 742–59. CrossrefGoogle Scholar
Hacquard, V., & Wellwood, A.
(2012) Embedding epistemic modals in English: A corpus-based study. Semantics and Pragmatics, 5(4), 1–29. CrossrefGoogle Scholar
Hamilton, C., Adolphs, S., & Nerlich, B.
(2007) The meanings of ‘risk’: A view from corpus linguistics. Discourse & Society, 18(2), 163–181. CrossrefGoogle Scholar
Hardie, A.
(2012) CQPweb – Combining power, flexibility and usability in a corpus analysis tool. International Journal of Corpus Linguistics, 17(3), 380–409. CrossrefGoogle Scholar
Hosinner, M.
(2020, March 11). Alles nur Panikmache der bösen Medien? [All just scaremongering by the evil media?] Heidenheimer Zeitung. https://​www​.hz​.de​/meinort​/heidenheim​/coronavirus​-alles​-nur​-panikmache​-der​-boesen​-medien​_-44473050​.html
Hunston, S.
(2011) Corpus Approaches to Evaluation: Phraseology and Evaluative Language. Routledge.Google Scholar
Hunston, S., & Francis, G.
(1999) Pattern Grammar: A Corpus-Driven Approach to the Lexical Grammar of English. John Benjamins. CrossrefGoogle Scholar
Hunter, D. J.
(2020) Covid-19 and the stiff upper lip – the pandemic response in the United Kingdom. New England Journal of Medicine, 382(16), e31. CrossrefGoogle Scholar
Jaspal, R., & Nerlich, B.
(2020) Social representations, identity threat, and coping amid COVID-19. Psychological Trauma: Theory, Research, Practice, and Policy, 12(S1), S249–S251. CrossrefGoogle Scholar
Johnson, C. R., Petruck, M. R. L., Baker, C. F., Ellsworth, M., Ruppenhofer, J., & Fillmore, C. F.
(2003) FrameNet: Theory and Practice. Version 1.1. https://​nats​-www​.informatik​.uni​-hamburg​.de​/pub​/CDG​/FrameNet​/book​.pdf
Juanchich, M., Gourdon-Kanhukamwe, A., & Sirota, M.
(2017) “I am uncertain” vs “It is uncertain”: How linguistic markers of the uncertainty source affect uncertainty communication. Judgment and Decision Making, 12(5), 445–465.Google Scholar
Kahneman, D., & Tversky, A.
(1982) Variants of uncertainty. Cognition, 11(2), 143–157. CrossrefGoogle Scholar
Klie, J.-C., Eckart de Castilho, R., & Gurevych, I.
(2020) From zero to hero: Human-in-the-loop entity linking in low resource domains. In D. Jurafsky, J. Chai, N. Schluter, & J. Tetreault (Eds.), Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (pp. 6982–6993). Association for Computational Linguistics. https://​www​.aclweb​.org​/anthology​/2020​.acl​-main​.624​.pdf. Crossref
Knight, F. H.
(1921) Risk, Uncertainty and Profit. University of Chicago Press.Google Scholar
Kratzer, A.
(1981) The notional category of modality. In H.-J. Eikmeyer & H. Rieser (Eds.), Words, Worlds, and Contexts (pp. 38–74). De Gruyter. CrossrefGoogle Scholar
(1991) Modality. In A. von Stechow & D. Wunderlich (Eds.), Semantics: An International Handbook of Contemporary Research (pp. 639–650). Mouton de Gruyter.Google Scholar
Lagnado, D. A., & Sloman, S. A.
(2004) Inside and outside probability judgment. In D. J. Koehler & N. Harvey (Eds.), Blackwell Handbook of Judgment and Decision Making (pp. 155–176). Blackwell. CrossrefGoogle Scholar
Luhmann, N.
(1993) Risk: A Sociological Theory. De Gruyter.Google Scholar
Lupton, D.
(2013) Risk and emotion: Towards an alternative theoretical perspective. Health, Risk & Society, 15(8), 634–47. CrossrefGoogle Scholar
McEnery, T., & Kifle, N. A.
(2002) Epistemic modality in argumentative essays of second-language writers. In J. Flowerdew (Ed.), Academic Discourse (pp. 182–215). Longman.Google Scholar
Müller, M., & Stegmeier, J.
(2019) Investigating risk, uncertainty and normativity within the framework of Digital Discourse Analysis: The example of future technologies in climate change discourse. In A. Olofsson & J. O. Zinn (Eds.), Researching Risk and Uncertainty – Methodologies, Methods and Research Strategies (pp. 309–335). Palgrave. CrossrefGoogle Scholar
Nuyts, J.
(2001) Epistemic Modality, Language, and Conceptualization: A Cognitive-Pragmatic Perspective. John Benjamins. CrossrefGoogle Scholar
Palmer, F. R.
(1986) Mood and Modality. Cambridge University Press.Google Scholar
Pidgeon, N., Hood, C., Jones, D., Turner, B., & Gibson, R.
(1992) Risk perception. In The Royal Society Study Group (Ed.), Risk: Analysis, Perception and Management (pp. 89–134). The Royal Society.Google Scholar
Quandt, T., Boberg, S., Schatto Eckrodt, T., & Frischlich, L.
(2020) Pandemic News: Facebook pages of mainstream news media and the coronavirus crisis – a computational content analysis. Münster Online Research (MOR), Working Paper 2 (2020) https://​arxiv​.org​/pdf​/2005​.13290​.pdf
Renn, O.
(2008) Risk Governance: Coping with Uncertainty in a Complex World. Earthscan. CrossrefGoogle Scholar
Sandman, P., & Lanard, J.
(2011) Explaining and proclaiming uncertainty: Risk communication lessons from Germany’s deadly E. coli outbreak. Risk=Hazard+Outrage: The Peter M. Sandman Risk Communication Website. http://​www​.psandman​.com​/col​/GermanEcoli​.htm
Scally, G., Jacobson, B., & Abbasi, K.
(2020) The UK’s public health response to covid-19. BMJ, 369, m1932. CrossrefGoogle Scholar
Tagesschau
(2020, March 20). Wirtschaft versus Gesundheit [Economy versus health]. Tagesschau.de. https://​www​.tagesschau​.de​/inland​/diskussion​-massnahmen​-corona​-101​.html
Tang, C., & Rundblad, G.
(2017) When safe means ‘dangerous’: A corpus investigation of risk communication in the media. Applied Linguistics, 38(5), 666–687. CrossrefGoogle Scholar
Teruel, M., Cardellino, C., Cardellino, F., Alonso Alemany, L., & Villata, S.
(2018) Increasing argument annotation reproducibility by using inter-annotator agreement to improve guidelines. In N. Calzolari, N. Calzolari, K. Choukri, C. Cieri, T. Declerck, S. Goggi, K. Hasida, H. Isahara, B. Maegaard, J. Mariani, H. Mazo, A. Moreno, J. Odijk, S. Piperidis, & T. Tokunaga (Eds.), Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC) (pp. 4061–4064). Association for Computational Linguistics. https://​aclanthology​.org​/L18​-1640​.pdf
Teigen, K. H.
(1988) The language of uncertainty. Acta Psychologica, 68(1–3), 27–38. CrossrefGoogle Scholar
Thompson, G., & Hunston, S.
(1999) Evaluation: An introduction. In S. Hunston & E. Thompson (Eds.), Evaluation in Text: Authorial Stance and the Construction of Discourse (pp. 1–26). Oxford University Press.Google Scholar
WHO (World Health Organization)
(2017) Communication risk in public health emergencies. A WHO guideline for emergency risk communication (ERC) policy and practice. World Health Organization. https://​apps​.who​.int​/iris​/handle​/10665​/259807
Zinn, J. O.
(2009) A comparison of sociological theorizing on risk and uncertainty. In J. O. Zinn (Ed.), Social Theories of Risk and Uncertainty (pp. 168–210). Blackwell.Google Scholar
(2016) ‘In-between’ and other reasonable ways to deal with risk and uncertainty. Health, Risk & Society, 18(7–8), 348–66. CrossrefGoogle Scholar
(2020a) ‘A monstrous threat’: How a state of exception turns into a ‘new normal’. Journal of Risk Research, 23(7–8), 1083–1091. CrossrefGoogle Scholar
(2020b) The UK ‘at Risk’: A Corpus Approach to Historical Social Change 1785–2009. Palgrave. CrossrefGoogle Scholar
Zinn, J. O., & McDonald, D.
(2018) Risk in The New York Times (1987–2014): A Corpus-Based Exploration of Sociological Theories. Palgrave. CrossrefGoogle Scholar