Article published in:
Narrative Inquiry
Vol. 24:2 (2014) ► pp. 347–367

Emotion prosody and viewer engagement in film narrative

A social semiotic approach

This study adopts a social semiotic approach to model the dynamics of character emotion and the discursive mechanisms of viewer engagement in film narrative. Drawing upon the systemic functional semiotics (Halliday and Matthiessen, 2004), this paper proposes a metafunctional framework to elucidate how film characters’ emotions are ideationally construed, interpersonally enacted, and textually organized as a “prosody”. The explication of emotion prosody provides an explicit framework to explain the multi-dimensional, dynamic construction of narrative discourse. With the metafunctional model of emotion prosody, the fundamental mechanisms of viewer engagement, namely, allegiance, empathy and expectancy, are elucidated in a coherent discourse-based framework. Compared to schema-based cognitive film studies that focus on viewers’ emotional reactions, the social semiotic discourse analysis provides a more explicit and analytically reliable framework to explain the multi-dimensional construction of film narrative and the discursive mechanisms of viewer engagement.
Keywords: social semiotic, multimodal discourse analysis, film narrative, emotion prosody, viewer engagement
Published online: 24 November 2014
https://doi.org/10.1075/ni.24.2.09fen
References
Altman, R
(1984) A semantic/syntactic approach to film genre. Cinema Journal, 23(3), 6–18. CrossrefGoogle Scholar
(1999) Film/genre. London: British Film Institute. CrossrefGoogle Scholar
Bartlett, E.C
(1932) Remembering. Cambridge: Cambridge University Press.Google Scholar
Bateman, J.A
(2007) Towards a grande paradigmatique of film: Christian Metz reloaded. Semiotica, 1671, 13–64.Google Scholar
Bateman, J.A., & Schmidt, K.H
(2012) Multimodal film analysis: How films mean. London: Routledge.Google Scholar
Bordwell, D
(1985) Narration in the fiction film. Madison: University of Wisconsin Press.Google Scholar
Bordwell, D., & Carroll, N
(1996) Post-theory: Reconstructing film studies. Madison: University of Wisconsin Press.Google Scholar
Brewer, W.F., & Lichtenstein, E.H
(1982) Stories are to entertain: A structural affect theory of stories. Journal of Pragmatics, 61, 473–483. CrossrefGoogle Scholar
Carroll, N
(2003) Engaging the moving image. New Haven: Yale University Press. CrossrefGoogle Scholar
(2008) The philosophy of motion pictures. Malden, MA: Blackwell.Google Scholar
Coplan, A
(2006) Catching characters’ emotions: Emotional contagion responses to narrative fiction film. Film Studies, 81, 26–38. CrossrefGoogle Scholar
Feng, D
(2012) Modeling appraisal in film: A social semiotic approach. Unpublished PhD Thesis, National University of Singapore.
Frijda, N
(1986) The emotions. Cambridge, UK: Cambridge University Press.Google Scholar
Gregory, M
(1995) Generic expectancies and discoursal surprises: John Donne’s The good morrow. In P.H. Fries & M. Gregory (Eds.), Discourse in society: Systemic functional perspectives (pp. 67–84). Norwood, N. J.: Ablex.Google Scholar
Grodal, T
(1997) Moving pictures: A new theory of film genres, feeling and cognition. Oxford: Oxford University Press.Google Scholar
Halliday, M.A.K
(1978) Language as social semiotic: The social interpretation of language and meaning. London: Arnold.Google Scholar
Halliday, M.A.K., & Matthiessen, C.M.I.M
(2004) An introduction to functional grammar (3rd ed.). London: Arnold.Google Scholar
Hjelmslev, L
(1961) Prolegomena to a theory of language (Translated by F. J. Whitfield). Madison, Wisconsin: University of Wisconsin Press.Google Scholar
Hogan, P.C
(2003) The mind and its stories: Narrative universals and human emotion. Cambridge, UK: Cambridge University Press CrossrefGoogle Scholar
Hood, S.E
(2010) Appraising research: Evaluation in academic writing. London: Palgrave Macmillan. CrossrefGoogle Scholar
Hood, S.E., & Forey, G
(2008) The interpersonal dynamics of call-centre interactions: co-constructing the rise and fall of emotion. Discourse and Communication, 2(4): 389–409. CrossrefGoogle Scholar
Labov, W., & Waletzky, J
(1967) Narrative analysis: Oral versions of personal experience. In J. Helm (Ed.), Essays on the verbal and visual arts (pp. 12–44). Seattle: University of Washington Press.Google Scholar
Marshal, G
(1990) Pretty Woman. Burbank, C.A.: Buena Vista Pictures.Google Scholar
Martin, J.R
(1992) English text: System and structure. Amsterdam: John Benjamins. CrossrefGoogle Scholar
(1996) Evaluating disruption: Symbolising theme in junior secondary narrative. In R. Hasan & G. Williams (Eds.), Literacy in society (pp. 124–171). London: Longman.Google Scholar
(1997) Analyzing genre: Functional parameters. In F. Christie & J.R. Martin (Eds.), Genre and institutions: Social processes in the workplace and school (pp. 3–39). London: Cassell.Google Scholar
Martin, J.R., & Rose, D
(2008) Genre relations: Mapping culture. London: Equinox.Google Scholar
Metz, C
(1974) Film language: A semiotics of the cinema (Translated by M. Taylor). Oxford: Oxford University Press.Google Scholar
Neale, S
(2000) Genre and Hollywood. London: Routledge.Google Scholar
Ortony, A., Clore, G.L., & Collins, A
(1988) The cognitive structure of emotions. New York: Cambridge University Press. CrossrefGoogle Scholar
Osgood, C.E., Suci, G.J., & Tannenbaum, P.H
(1957) The measurement of meaning. Urbana: University of Illinois Press.Google Scholar
Pence, J
(2006) Narrative emotion: Feeling, form and function. Journal of Narrative Theory, 34(3), 273–276. CrossrefGoogle Scholar
Plantinga, C
(1999) The scene of empathy and the human face on film. In C. Plantinga & G.M. Smith (Eds.), Passionate views: Film, cognition, and emotion (pp. 239–255). Baltimore: Johns Hopkins University Press.Google Scholar
Poynton, C
1985 Language and gender: Making the difference. Geelong, Vic.: Deakin University Press.Google Scholar
Schank, R.C., & Abelson, R.P
(1977) Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
Scherer, K.R
(1984) On the nature and function of emotion: A component process approach. In K.R. Scherer & P. Ekman (Eds.), Approaches to emotion (pp. 293–318). Hillsdale, NJ: Erlbaum.Google Scholar
Scott, R
(2000) Gladiator. Universal City, C.A.: DreamWorks Pictures.Google Scholar
Smith, C.A
(1989) Dimensions of appraisal and physiological response in emotion. Journal of Personality and Social Psychology, 561, 339–353. CrossrefGoogle Scholar
Smith, G.R
(2003) Film structure and the emotion system. Cambridge: Cambridge University Press. CrossrefGoogle Scholar
Smith, M
(1995) Engaging characters: Fiction, emotion, and the cinema. Oxford: Oxford University Press.Google Scholar
Tan, E.S
(1996) Emotion and the structure of narrative film: Film as an emotion machine. Mahwah, N. J: Lawrence Erlbaum.Google Scholar
Thibault, P.J
(2000) The multimodal transcription of a television advertisement: Theory and practice. In A.P. Baldry (Ed.), Multimodality and multimediality in the distance learning age (pp. 311–385). Campobasso: Palladino Editore.Google Scholar
Tseng, C
(2009) Cohesion in film and the construction of filmic thematic configuration: A functional perspective. Unpublished PhD Thesis. Bremen: University of Bremen.Google Scholar
Uldall, E.T
(1960) Attitudinal meanings conveyed by intonation contours. Language and Speech, 31, 223–234. CrossrefGoogle Scholar
White, P.R.R
(1998) Telling media tales: The news story as rhetoric. Unpublished PhD thesis. Sydney: University of Sydney.Google Scholar
Zillmann, D
(1994) Mechanisms of emotional involvement with drama. Poetics, 231, 33–51. CrossrefGoogle Scholar
Cited by

Cited by 4 other publications

Choi, Grace Y.
2018. Learning through digital storytelling: exploring entertainment techniques in lecture video. Educational Media International 55:1 ► pp. 49 ff. Crossref logo
Hiippala, Tuomo
2017. The Multimodality of Digital Longform Journalism. Digital Journalism 5:4 ► pp. 420 ff. Crossref logo
Hood, Susan
2019.  In The Cambridge Handbook of Systemic Functional Linguistics, ► pp. 382 ff. Crossref logo
Pérez-Arredondo, Carolina & Camila Cárdenas-Neira
2019.  In Discourses from Latin America and the Caribbean, ► pp. 107 ff. Crossref logo

This list is based on CrossRef data as of 10 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.