Article published in:
Audiovisual Translation: Theoretical and methodological challengesEdited by Yves Gambier and Sara Ramos Pinto
[Target 28:2] 2016
► pp. 222–236
The multimodal approach in audiovisual translation
Christopher Taylor | University of Trieste
This paper will explore the multimodal approach to audiovisual translation (AVT). It must first be stressed, however, that most research on multimodality has not as yet focused on questions of translation. The Routledge Handbook of Multimodal Analysis (Jewitt 2009), which contains articles by most of the leading figures in the field, while representing a major step forward in multimodal studies, does not tackle translation head on. The word ‘translation’ does not even appear in the index. Over a relatively short time span, most of the major contributions to the field have been more purely linguistically based and intent on providing keys to the understanding of the interplay of semiotic resources such as words, images, gesture, music, light, etc. (see O’Toole 1994; Kress and van Leeuwen 1996; Martinec 2000; Unsworth 2001; Baldry and Thibault 2006, etc.). The work of these scholars, however, has provided an impetus to developing ideas on how to exploit multimodal analyses in the area of AVT. Thibault’s work, for example, on the ‘multimodal transcription’ provided this author with the basis for investigating how the integration of semiotic modalities in a film text could assist the subtitler in making those all-important decisions on what to retain and what to discard when faced with time constraints. Other scholars have studied the co-articulation of words and image in their discussion of how different modalities realize social functions and make meaning (O’Halloran 2008; Bednarek 2010), emphasising the importance of supplementing purely linguistic analyses with studies of all the other semiotic resources that make up a multimodal text. Findings will inevitably be reported verbally but the analyses need to explore the concept of integration and how other resources can interact with language and, crucially, how translators can be made sensitive to the entire semiotic impact of a multimodal text.
Article outline
- 1.Introduction
- 2.Multimodal text analysis
- 2.1Narrative considerations
- Screenplays
- 2.2Linguistic considerations
- 2.3Semiotic considerations
- Audio description
- 2.4Cultural considerations
- 2.1Narrative considerations
- 3.The multimodal transcription
- 4.Limitations and future directions
- 5.Conclusion
- Note
-
References
Published online: 09 August 2016
https://doi.org/10.1075/target.28.2.04tay
https://doi.org/10.1075/target.28.2.04tay
References
Baldry, Anthony
Baldry, Anthony, and Paul Thibault
Bateman, John
Bordwell, David
Bruti, Silvia
Cattrysse, Patrick, and Yves Gambier
Fillmore, Charles
Fryer, Louise, and Jonathan Freeman
Gambier, Yves
2006 “Multimodality and Audiovisual Translation.” In Audiovisual Translation Scenarios: Proceedings of the Marie Curie Euroconferences MuTra: Audiovisual Translation Scenarios, Copenhagen 1–5 May 2006, ed. by Mary Carroll, Heidrun Gerzymisch-Arbogast, and Sandra Nauert. http://www.euroconferences.info/proceedings/2006_Proceedings/2006_proceedings.html. Accessed December 22, 2015.
Gottlieb, Henrik
Gregory, Michael
Kress, Gunther, and Theo van Leeuwen
Lomheim, Sylfest
Malcolm, Karen
Martinec, Radan
2000 “Rhythm in Multimodal Texts.” LEONARDO 33 (4): 289–297.
Mazur, Iwona
O’Halloran, Kay
Pedersen, Jan
Perego, Elisa
Pettit, Zoe
Ramière, Nathalie
Remael, Aline
Snyder, Joel
Taylor, Christopher
Taylor Christopher
Taylor, Christopher
Thibault, Paul
Unsworth, Len
Cited by
Cited by 8 other publications
Jing, Yi
Jordà Mathiasen, Eivor
Li, Long, Xi Li & Jun Miao
Liu, Lisheng
Messerli, Thomas C.
Sidiropoulou, Maria
Ulvydienė Huber, Loreta & Viktorija Lideikytė
Valdeón, Roberto A.
This list is based on CrossRef data as of 23 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.