Article published In:
Narrative InquiryVol. 24:2 (2014) ► pp.347–367
Emotion prosody and viewer engagement in film narrative
A social semiotic approach
This study adopts a social semiotic approach to model the dynamics of character emotion and the discursive mechanisms of viewer engagement in film narrative. Drawing upon the systemic functional semiotics (Halliday and Matthiessen, 2004), this paper proposes a metafunctional framework to elucidate how film characters’ emotions are ideationally construed, interpersonally enacted, and textually organized as a “prosody”. The explication of emotion prosody provides an explicit framework to explain the multi-dimensional, dynamic construction of narrative discourse. With the metafunctional model of emotion prosody, the fundamental mechanisms of viewer engagement, namely, allegiance, empathy and expectancy, are elucidated in a coherent discourse-based framework. Compared to schema-based cognitive film studies that focus on viewers’ emotional reactions, the social semiotic discourse analysis provides a more explicit and analytically reliable framework to explain the multi-dimensional construction of film narrative and the discursive mechanisms of viewer engagement.
References
Altman, R
(1984) A semantic/syntactic approach to film genre. Cinema Journal, 23(3), 6–18. 
(1999) Film/genre. London: British Film Institute.
Bartlett, E.C
(1932) Remembering. Cambridge: Cambridge University Press.
Bateman, J.A
(2007) Towards a grande paradigmatique of film: Christian Metz reloaded. Semiotica, 1671, 13–64.
Bateman, J.A., & Schmidt, K.H
(2012) Multimodal film analysis: How films mean. London: Routledge.
Bordwell, D
(1985) Narration in the fiction film. Madison: University of Wisconsin Press.
Bordwell, D., & Carroll, N
(1996) Post-theory: Reconstructing film studies. Madison: University of Wisconsin Press.
Brewer, W.F., & Lichtenstein, E.H
(1982) Stories are to entertain: A structural affect theory of stories. Journal of Pragmatics, 61, 473–483.
Carroll, N
(2003) Engaging the moving image. New Haven: Yale University Press.
(2008) The philosophy of motion pictures. Malden, MA: Blackwell.
Coplan, A
(2006) Catching characters’ emotions: Emotional contagion responses to narrative fiction film. Film Studies, 81, 26–38.
Feng, D
(2012) Modeling appraisal in film: A social semiotic approach. Unpublished PhD Thesis, National University of Singapore.
Frijda, N
(1986) The emotions. Cambridge, UK: Cambridge University Press.
Gregory, M
(1995) Generic expectancies and discoursal surprises: John Donne’s The good morrow. In P.H. Fries & M. Gregory (Eds.), Discourse in society: Systemic functional perspectives (pp. 67–84). Norwood, N. J.: Ablex.
Grodal, T
(1997) Moving pictures: A new theory of film genres, feeling and cognition. Oxford: Oxford University Press.
Halliday, M.A.K
(1978) Language as social semiotic: The social interpretation of language and meaning. London: Arnold.
Halliday, M.A.K., & Matthiessen, C.M.I.M
(2004) An introduction to functional grammar (3rd ed.). London: Arnold.
Hjelmslev, L
(1961) Prolegomena to a theory of language (Translated by F. J. Whitfield). Madison, Wisconsin: University of Wisconsin Press.
Hogan, P.C
(2003) The mind and its stories: Narrative universals and human emotion. Cambridge, UK: Cambridge University Press
Hood, S.E
(2010) Appraising research: Evaluation in academic writing. London: Palgrave Macmillan.
Hood, S.E., & Forey, G
(2008) The interpersonal dynamics of call-centre interactions: co-constructing the rise and fall of emotion. Discourse and Communication, 2(4): 389–409.
Labov, W., & Waletzky, J
(1967) Narrative analysis: Oral versions of personal experience. In J. Helm (Ed.), Essays on the verbal and visual arts (pp. 12–44). Seattle: University of Washington Press.
Marshal, G
(1990) Pretty Woman. Burbank, C.A.: Buena Vista Pictures.
Martin, J.R
(1996) Evaluating disruption: Symbolising theme in junior secondary narrative. In R. Hasan & G. Williams (Eds.), Literacy in society (pp. 124–171). London: Longman.
(1997) Analyzing genre: Functional parameters. In F. Christie & J.R. Martin (Eds.), Genre and institutions: Social processes in the workplace and school (pp. 3–39). London: Cassell.
Martin, J.R., & Rose, D
(2008) Genre relations: Mapping culture. London: Equinox.
Metz, C
(1974) Film language: A semiotics of the cinema (Translated by M. Taylor). Oxford: Oxford University Press.
Neale, S
(2000) Genre and Hollywood. London: Routledge.
Ortony, A., Clore, G.L., & Collins, A
(1988) The cognitive structure of emotions. New York: Cambridge University Press.
Osgood, C.E., Suci, G.J., & Tannenbaum, P.H
(1957) The measurement of meaning. Urbana: University of Illinois Press.
Pence, J
(2006) Narrative emotion: Feeling, form and function. Journal of Narrative Theory, 34(3), 273–276.
Plantinga, C
(1999) The scene of empathy and the human face on film. In C. Plantinga & G.M. Smith (Eds.), Passionate views: Film, cognition, and emotion (pp. 239–255). Baltimore: Johns Hopkins University Press.
Poynton, C
1985 Language and gender: Making the difference. Geelong, Vic.: Deakin University Press.
Schank, R.C., & Abelson, R.P
(1977) Scripts, plans, goals, and understanding: An inquiry into human knowledge structures. Hillsdale, NJ: Lawrence Erlbaum.
Scherer, K.R
(1984) On the nature and function of emotion: A component process approach. In K.R. Scherer & P. Ekman (Eds.), Approaches to emotion (pp. 293–318). Hillsdale, NJ: Erlbaum.
Scott, R
(2000) Gladiator. Universal City, C.A.: DreamWorks Pictures.
Smith, C.A
(1989) Dimensions of appraisal and physiological response in emotion. Journal of Personality and Social Psychology, 561, 339–353.
Smith, G.R
(2003) Film structure and the emotion system. Cambridge: Cambridge University Press.
Smith, M
(1995) Engaging characters: Fiction, emotion, and the cinema. Oxford: Oxford University Press.
Tan, E.S
(1996) Emotion and the structure of narrative film: Film as an emotion machine. Mahwah, N. J: Lawrence Erlbaum.
Thibault, P.J
(2000) The multimodal transcription of a television advertisement: Theory and practice. In A.P. Baldry (Ed.), Multimodality and multimediality in the distance learning age (pp. 311–385). Campobasso: Palladino Editore.
Tseng, C
(2009) Cohesion in film and the construction of filmic thematic configuration: A functional perspective. Unpublished PhD Thesis. Bremen: University of Bremen.
Uldall, E.T
(1960) Attitudinal meanings conveyed by intonation contours. Language and Speech, 31, 223–234.
White, P.R.R
(1998) Telling media tales: The news story as rhetoric. Unpublished PhD thesis. Sydney: University of Sydney.
Zillmann, D
(1994) Mechanisms of emotional involvement with drama. Poetics, 231, 33–51.
Cited by
Cited by 6 other publications
Choi, Grace Y.
2018. Learning through digital storytelling: exploring entertainment techniques in lecture video. Educational Media International 55:1 ► pp. 49 ff. 
Hiippala, Tuomo
2017. The Multimodality of Digital Longform Journalism. Digital Journalism 5:4 ► pp. 420 ff.
Hood, Susan
2019. Appraisal. In The Cambridge Handbook of Systemic Functional Linguistics, ► pp. 382 ff.
Pérez-Arredondo, Carolina & Camila Cárdenas-Neira
2019. The Hooded Student as a Metaphor: Multimodal Recontextualization of the Chilean Student Movement in a Broadcast News Report. In Discourses from Latin America and the Caribbean, ► pp. 107 ff.
Steele, Godfrey A.
2024. Media Representation of Gender-Based Violence in Two Cases and Related Examples: A Multimodal Discursive Study. In Caribbean Discourses, ► pp. 323 ff.
Wang, Jiayu & Jinyan Liu
2024. The visual stories in addressing climate change that a petroleum business tells and lives by: A multimodal critical ecolinguistic perspective. Energy Research & Social Science 111 ► pp. 103483 ff.
This list is based on CrossRef data as of 5 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.