Audiovisual translation as orchestration of multimodal synergies
Expendability of interjections in intralingual film subtitling
This study explores the coordination between subtitles and other semiotic resources in films, from within a systemic functional semiotic framework. The paper focuses on the subtitling of interjections (e.g., ‘oh’, ‘wow’, ‘yay’) to examine how subtitles are synthesized in films with respect to the presence of facial expressions and/or bodily gestures which might be perceived as conveying similar meanings. The analysis of multiple versions of intralingual subtitles of two English-language films shows that the seemingly random omission of soundtrack interjections from subtitles is patterned to a considerable degree – those interjections which are concurrent with semiotically correlated actions were frequently omitted. The findings suggest that subtitling is a complex process involving synergy between subtitles and other semiotic resources, which calls for interdisciplinary research integrating translation, multimodality, and linguistics.
Keywords: audiovisual translation, subtitling, multimodal synergy, interjection, facial expression, gesture, semiotic redundancy, systemic functional semiotics
- 2.Interjections and subtitling
- 3.Data and methodology
- 3.1Research data
- 3.2A systemic functional semiotic approach
- 3.3Tracking of interjections and annotation scheme
- 4.Subtitling of interjections in the presence or absence of semiotically correlated actions
- 4.1Subtitling of accompanied and unaccompanied interjections in each version
- 4.2Subtitling of accompanied interjections across versions
- 4.3Subtitling of unaccompanied interjections across versions
- 5.Concluding remarks
Published online: 15 January 2021
Ameka, Felix K.
de Linde, Zoé
Eastman, Carol M.
Ekman, Paul, and Wallace V. Friesen
Feng, Dezheng, and Kay L. O’Halloran
2006 “Multimodality and Audiovisual Translation.” In Proceedings of the Marie Curie Euroconferences: MuTra – Audiovisual Translation Scenarios, Copenhagen, 1–5 May 2006, edited by Mary Carroll, Heidrun Gerzymisch-Arbogast, and Sandra Nauert. Accessed 14 December 2017. http://www.euroconferences.info/proceedings/2006_Proceedings/2006_Gambier_Yves.pdf
Halliday, M. A. K., and Christian M. I. M. Matthiessen
Forthcoming. “Visual Affect in Films: A Semiotic Approach.” Semiotica.
Luyken, Georg-Michael, Thomas Herbst, Jo Langham-Brown, Helen Reid, and Hermann Spinhof
Martin, James R., and Peter R. R. White
Matthiessen, Christian M. I. M.
2005 “How Is Culture Rendered in Subtitles?” In Proceedings of the Marie Curie Euroconferences: MuTra – Challenges of Multidimensional Translation, Saarbrücken, 2–6 May 2005, edited by Heidrun Gerzymisch-Arbogast and Sandra Nauert. Accessed 14 December 2017. http://www.euroconferences.info/proceedings/2005_Proceedings/2005_Pedersen_Jan.pdf
Quirk, Randolph, Sidney Greenbaum, Geoffrey Leech, and Jan Svartvik
Rosa, Alexandra Assis