Cover not available
Article published In:
Pragmatics and Society
Vol. 12:2 (2021) ► pp.189–223

Towards a discourse-semantic approach to visual narrative analysis

The case of the BBC news story of Islamic State (IS)

| Prince Sattam Bin Abdulaziz University | Kafr El-Sheikh University
The present study propounds a novel discourse-semantic approach that problematizes the social semiotic analysis of visual narrative in two respects: (i) the lack of a model that can explain the plurifunctional structure of visual acts of communication in general and (ii) the failure to provide the deep structure underlying the characters and/or objects in visual narrative in particular. Redressing these two shortcomings, the approach is methodologically geared towards analysing the visual narrative grammar that encodes the 2017 BBC image-enabled news story of Islamic State (IS). The proposed approach rests on two theoretical models: (i) Roman Jakobson’s (1960) communication model of language functions; (ii) Algirdas Julien Greimas’s (1966, 1987) structural-semantic model of actant grammar. The study has reached two major findings. First, theoretically, the visual narrative analysis of images demands the presence of both (1) a theory that can adequately explain the plurifunctional structure associated with the semiotic complexity of visual communication and (2) a structural-semantic model that reveals the deep structure of the actants that enable the dramatis personae to relate to the events featuring in the mono-/multimodal discourse of narrative. Second, on a practical level of the BBC’s visual storyline, IS has been represented within three actant-based enunciation-spectacles: (a) victimhood with Subject versus Object, (b) beneficiariness with Sender versus Receiver, and (c) villainy (self-presented and other-presented) with Opponent/Victim versus Helper.
Keywords: actants, BBC, discourse-semantic approach, dramatis personae, images, Islamic State (IS), language functions, narrative grammar, news stories, plurifunctional structure, social semiotics, structural semiotics, visual narrative
Article outline
  • 1.Introduction
  • 2.Problematizing visual narrative analysis in social semiotics
  • 3.Visual narrative grammar: A discourse-semantic approach
    • 3.1Jakobson’s model of language functions
    • 3.2Greimas’s model of actant grammar
  • 4.Methodology
    • 4.1Data and procedure
    • 4.2Research question(s)
  • 5.Transcoding visual narrative grammar in the BBC news story of IS
    • 5.1Functions of the visual acts of communication in the BBC news story of IS
    • 5.2Visual deep structure: Actants and enunciation-spectacles of BBC visual narrative
  • 6.Conclusion: Summary and findings
  • Acknowledgments
  • Notes
  • References
Published online: 3 June 2021
DOI logo
https://doi.org/10.1075/ps.18045.sal
References (68)
References
Arnheim, Rudolf. 1974. Art and Visual Perception. Berkeley: California University Press. DOI logoGoogle Scholar
Auer, Peter. 2021. Turn-allocation and gaze: A multimodal revision of the “current-speaker-selects-next” rule of the turn-taking system of conversation analysis. Discourse Studies 23(2): 117–140. DOI logoGoogle Scholar
Bal, Mieke. 1985. Narratology: Introduction to the Theory of Narrative. Toronto: Toronto University Press.Google Scholar
Barthes, Roland. 1972. Myth today. In: Mythologies, Roland Barthes, 109–137. (Trans. Annette Lavers). New York: Hill & Wang.Google Scholar
. 1977. Image-Music-Text. (Ed. & Trans. Stephen Heath). London: Fontana.Google Scholar
Bateman, John A. & Janina Wildfeuer. 2014. A multimodal discourse theory of visual narrative. Journal of Pragmatics 741: 180–208. DOI logoGoogle Scholar
Bell, Allan. 1996. Text, time and technology in news English. In: Redesigning English: New Texts, New Identities, eds. Sharon Goodman & David Graddol, 3–26. London and New York: Routledge.Google Scholar
Bertin, Jacques. 1983 [1967]. Semiology of Graphics: Diagrams, Networks, Maps. (Trans. W. J. Berg). London: University of Wisconsin Press.Google Scholar
Bo, Xu. 2018. Multimodal discourse analysis of the movie Argo. English Language Teaching 11 (4): 132–137. DOI logoGoogle Scholar
Budniakiewicz, Therese. 1992. Fundamentals of Story Logic: Introduction to Greimassian Semiotics. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Caple, Helen. 2019. Doing critical discourse studies with multimodality: A reply. Critical Discourse Studies 16(5): 522–530. DOI logoGoogle Scholar
Chandler, Daniel. 2007. Semiotics: The Basics (2nd ed.). London & New York: Routledge. DOI logoGoogle Scholar
Chatman, Seymour. 1978. Story and Discourse: Narrative Structure in Fiction and Film. Ithaca, N.Y. & London: Cornell University Press.Google Scholar
Chen, Yaoyao, Svenja Adolphs & Dawn Knight. 2020. Multimodal discourse analysis. In: The Routledge Handbook of Corpus Approaches to Discourse Analysis, eds. Eric Friginal & Jack A. Hardy, 98–115. London and New York: Routledge. DOI logoGoogle Scholar
Colby, Benjamin N. 1966. The analysis of culture content and the patterning of narrative concern in texts. American Anthropologist 68(2): 374–388. DOI logoGoogle Scholar
1970. The description of narrative structures. In: Cognition: A Multiple View, ed. Paul L. Garvin, 177–192. New York: Spartan Books.Google Scholar
Culler, Jonathan. 1976. Saussure. London: Fontana.Google Scholar
Dondis, Donis A. 1973. A Primer of Visual Literacy. Cambridge, Mass.: MIT Press.Google Scholar
Fish, Stanley. 1980. Is There a Text in This Class? The Authority of Interpretive Communities. Cambridge, Mass.: Harvard University Press.Google Scholar
Friedland, Elliot. 2014. Special report: The Islamic State. The Clarion Project, November 2014: 1–15.Google Scholar
Genette, Gérard. 1980 [1972]. Narrative Discourse: An Essay in Method (Trans. J. E. Lewin). Oxford: Blackwell, Trans. of Discours du récit: Essais de méthode.Google Scholar
Goodman, Sharon. 1996. Visual English. In: Redesigning English: New Texts, New Identities, ed. Sharon Goodman & David Graddol, 38–72. London and New York: Routledge.Google Scholar
Goodman, Sharon & David Graddol (eds). 1996. Redesigning English: New Texts, New Identities. London & New York: Routledge.Google Scholar
Gombrich, Ernst. 1960. Art and Illusion. London: Phaidon.Google Scholar
Granström, Björn, David House & Inger Karlsson. 2002. Multimodality in Language and Speech Systems. Stockholm: Kluwer. DOI logoGoogle Scholar
Greimas, Algirdas J. 1966. Sémantique Structurale. Paris: Larousse.Google Scholar
1970. Du Sens. Paris: Seuil.Google Scholar
1971. Narrative grammar: Units and levels. Modern Language Notes 861: 793–806.Google Scholar
1983. Du Sens II: Essais Sémiotiques. Paris: Seuil.Google Scholar
1987. On Meaning: Selected Writings in Semiotic Theory (Trans. Paul J. Perron & Frank H. Collins). Minnesota, Minn.: Minnesota University Press.Google Scholar
1988 [1976]. Maupassant. The Semiotics of Text: Practical Exercises. Trans. Paul J. Perron. Amsterdam: John Benjamins. (Trans. of Maupassant, La sémiotique du texte.) DOI logoGoogle Scholar
Greimas, Algirdas J. & Joseph Courtés. 1982 [1979]. Semiotics and Language: An analytical Dictionary (Trans. Larry Crist & Daniel Patte). Bloomington: Indiana University Press. (Trans. of Sémiotique. Dictionnaire Raisonné de la Thèorie du Langage.)Google Scholar
Gruber, Christiane & Sune Haugbolle (eds). 2013. The Visual Culture in the Modern Middle East: Rhetoric of the Image. Bloomington and Indiana: Indiana University Press.Google Scholar
Hall, Stuart. 1972. The determinations of news photographs. Cultural Studies 31: 226–243.Google Scholar
Halliday, Michael A. K. 1978. Language as Social Semiotic. London: Edward Arnold.Google Scholar
1985. An Introduction to Functional Grammar. London: Edward Arnold.Google Scholar
1989. Language, Context, and Text: Aspects of Language in a Social-Semiotic Perspective (2nd ed.). Oxford: Oxford University Press.Google Scholar
Halliday, Michael A. K. & Christian M. I. M. Mathiessen. 2004. An Introduction to Functional Grammar (3rd ed.). London: Hodder Education.Google Scholar
Hawkes, Terence. 1977. Structuralism & Semiotics. London: Methuen. DOI logoGoogle Scholar
Herman, David. 2002. Story Logic: Problems and Possibilities of Narrative. Lincoln: Nebraska University Press.Google Scholar
Hiippala, Tuomo. 2016. The Structure of Multimodal Documents: An Empirical Approach. New York: Routledge.Google Scholar
Hodge, Robert & Gunther Kress. 1988. Social Semiotics. Cambridge: Polity Press.Google Scholar
Jakobson, Roman. 1960. Closing statement: Linguistics and poetics. In: Style in Language, ed. Thomas A. Sebeok, 350–377. Cambridge, Mass.: MIT Press.Google Scholar
Jaworski, Adam & Nikolas Coupland (eds.). 2006. The Discourse Reader (2nd ed.). New York: Routledge.Google Scholar
Jewitt, Carey & Rumiko Oyama. 2001. Visual meaning: A social semiotic approach. In: Handbook of Visual Analysis, eds. Theo van Leeuwen & Carey Jewitt, 134–156. London & New Delhi: Sage.Google Scholar
Kress, Gunther. 2010. Multimodality: A Social Semiotic Approach to Contemporary Communication. New York: Routledge.Google Scholar
Kress, Gunther & Theo van Leeuwen. 1996. Reading Images: The Grammar of Visual Design. New York: Routledge.Google Scholar
. 2006. Reading Images: The Grammar of Visual Design (2nd ed.). London & New York: Routledge. DOI logoGoogle Scholar
Lemke, Jay L. 1998. Multiplying meaning: Visual and verbal semiotics in scientific text. In: Reading Science: Critical and Functional Perspectives, eds. James R. Martin & Robert Veel, 87–113. London: Routledge.Google Scholar
Liu, Jing. 2013. Visual images interpretive strategies in multimodal texts. Journal of Language Teaching and Research 6, 4, 1259–1263. DOI logoGoogle Scholar
Liu, Yu & Kay L. O’Halloran. 2009. Intersemiotic texture: Analyzing cohesive devices between language and images. Social Semiotics 19(4): 367–388. DOI logoGoogle Scholar
Muir, Jim. 2017. “Islamic State”: Raqqa’a loss seals IS’s rapid rise and fall. BBC News Online 17 October 2017. Retrieved 30 November 2018, from [URL]
Norris, Sigrid. (ed.) 2012. Multimodality in Practice: Investigating Theory-in-Practice-through-Methodology. New York: Routledge. DOI logoGoogle Scholar
Nöth, Winfried. 1990. Handbook of Semiotics. Bloomington: Indiana University Press. DOI logoGoogle Scholar
Nuttall, Louise. 2018. Mind Style and Cognitive Grammar: Language and Worldview in Speculative Fiction. London: Bloomsbury Academic.Google Scholar
O’Halloran, Kay L. & Bradley A. Smith. (eds.). 2011. Multimodal Studies: Exploring Issues and Domains. New York: Routledge.Google Scholar
Ortner, Sherry B. 1973. On key symbols. American Anthropologist 75(5): 1338–1346. DOI logoGoogle Scholar
Propp, Vladimir J. 1968 [1928]. Morphology of the Folktale (2nd ed.). Austin, Tex.: University of Texas Press.Google Scholar
Rimmon-Kenan, Shlomith. 1983. Narrative Fiction: Contemporary Poetics. London: Methuen. DOI logoGoogle Scholar
Saussure, Ferdinand de. 1916. Cours de linguistique générale. Paris: Payot.Google Scholar
Schleifer, Ronald. 1987. A. J. Greimas and the Nature of Meaning: Linguistics, Semiotics and Discourse Theory. London and Sydney: Croom Helm.Google Scholar
Scott, Linda M. 1994. Images in advertising: The need for a theory of visual rhetoric. Journal of Consumer Research 21 (2): 252–273. DOI logoGoogle Scholar
Thibault, Paul J. 1991. Social Semiotics as Praxis. Minneapolis, Minn.: University of Minnesota Press.Google Scholar
2004. Agency and Consciousness in Discourse: Self-Other Dynamics as a Complex System. London & New York: Continuum.Google Scholar
Thompson, Philip & Peter Davenport. 1982. The Dictionary of Visual Language. Harmondsworth: Penguin.Google Scholar
Todorović, Tijana, Alenka Čuden, Karin Košak & Tomaž Toporišič. 2017. Language of dressing as a communication system and its functions – Roman Jakobson’s linguistic method. FIBRES & TEXTILE in Eastern Europe; 25(5): 1251, 127–135. DOI logoGoogle Scholar
Van Leeuwen, Theo. 2005. Introducing Social Semiotics. London & New York: Routledge.Google Scholar
. 2008. Discourse and Practice: New Tools for Critical Discourse Analysis. Oxford: Oxford University Press. DOI logoGoogle Scholar