Dubbing vs. subtitling: Complexity matters

Elisa Perego, Fabio Del Missier and Marta Stragà

Abstract

Despite the claims regarding the potential disruptiveness of subtitling for audiovisual processing, existing empirical evidence supports the idea that subtitle processing is semi-automatic and cognitively effective, and that, in moderately complex viewing scenarios, dubbing does not necessarily help viewers. In this paper we appraise whether the complexity of the translated audiovisual material matters for the cognitive and evaluative reception of subtitled vs. dubbed audiovisual material. To this aim, we present the results of two studies on the viewers’ reception of film translation (dubbing vs. subtitling), in which we investigate the cognitive and evaluative consequences of audiovisual complexity. In Study 1, the results show that a moderately complex film is processed effectively and is enjoyed irrespective of the translation method. In Study 2, the subtitling (vs. dubbing) of a more complex film leads to more effortful processing and lower cognitive performance, but not to a lessened appreciation. These results expose the boundaries of subtitle processing, which are reached only when the audiovisual material to be processed is complex, and they encourage scholars and practitioners to reconsider old standards as well as to invest more effort in crafting diverse types of audiovisual translations tailored both to the degree of complexity of the source product and to the individual differences of the target viewers.

Keywords:
Publication history
Table of contents

This paper presents two empirical studies analysing the cognitive (i.e., regarding comprehension and memory) and evaluative reception of films presented via two audiovisual translation (AVT) methods, namely, dubbing and subtitling. The central aim of these studies is to understand whether film complexity affects film reception when films are presented through different AVT methods. More specifically, we want to understand whether processing, comprehension and memory for film information, as well as film appreciation, differ across AVT methods in films that vary significantly in their level of complexity.

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.

References

Barsam, Richard
2007Looking at Movies. An Introduction to Film. New York: Norton & Company.Google Scholar
Carpenter, Patricia A., Marcel Adam Just, and Peter Shell
1990 “What One Intelligence Test Measures: A Theoretical Account of the Processing in the Raven Progressive Matrices Test.” Psychological Review 97: 404–431. DOI logoGoogle Scholar
Cary, Edmond
1960 “La traduction totale.” Babel 6 (3): 110–115. DOI logoGoogle Scholar
Chiaro, Delia
2009 “Issues in Audiovisual Translation.” In The Routledge Companion to Translation Studies, edited by Jeremy Munday, 141–165. London: Routledge.Google Scholar
Chaume, Frederic
2013 “The Turn of Audiovisual Translation. New Audiences and New Technologies.” Translation Spaces 2: 105–123. DOI logoGoogle Scholar
Danan, Martine
1991 “Dubbing as an Expression of Nationalism.” Meta 36 (4): 606–614. DOI logoGoogle Scholar
Díaz Cintas, Jorge
2001La traducción audiovisual: El subtitulado. Salamanca: Ediciones Almar.Google Scholar
Drew, Dan G., and Thomas Grimes
1987 “Audio-Visual Redundancy and TV News Recall.” Communication Research 14 (4): 452–461. DOI logoGoogle Scholar
d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet
1987 “Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In Eye Movements: From Psychology to Cognition, edited by J. Kevin O’Regan and Ariane Lévy-Schoen, 313–321. Amsterdam: Elsevier Science. DOI logoGoogle Scholar
d’Ydewalle, Géry, and Johan Van Rensbergen
1989 “Developmental Studies of Text-Picture Interactions in the Perception of Animated Cartoons with Text.” In Knowledge Acquisition from Text and Pictures, edited by Heinz Mandl and Joel R. Levin, 233–248. Amsterdam: Elsevier Science. DOI logoGoogle Scholar
d’Ydewalle, Géry, and Ingrid Gielen
1992 “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition: Scene Perception and Reading, edited by Keith Rayner, 415–427. New York: Springer-Verlag. DOI logoGoogle Scholar
d’Ydewalle, Géry, and Wim De Bruycker
2007 “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist 12: 196–205. DOI logoGoogle Scholar
fsoesch
2013 (May, 11) “Analyzing TV Series and Their Narrative Complexity.” Final Report. https://​allabouttvseries​.wordpress​.com/
Ghia, Elisa
2012Subtitling Matters. New Perspectives on Subtitling and Foreign Language Learning. Oxford: Peter Lang. DOI logoGoogle Scholar
Gottlieb, Henrik
1994 “Subtitling: People Translating People.” In Teaching Translation and Interpreting 2: Insights, Aims, Visions, edited by Cay Dollerup and Anne Lindegaard, 261–274. Amsterdam: John Benjamins. DOI logoGoogle Scholar
2004 “Language-Political Implications of Subtitling.” In Topics in Audiovisual Translation, edited by Pilar Orero, 83–100. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Grimes, Tom
1991 “Mild Auditory-Visual Dissonance in Television News May Exceed Viewer Attentional Capacity.” Human Communication Research 18 (2): 268–298. DOI logoGoogle Scholar
Hinkin, Michael P., Richard J. Harris, and Andrew T. Miranda
2014 “Verbal Redundancy Aids Memory for Filmed Entertainment Dialogue.” The Journal of Psychology 148 (2): 161–176. DOI logoGoogle Scholar
Kilborn, Richard
1993 “ ‘Speak My Language’. Current Attitudes to Television Subtitling and Dubbing.” Media, Culture and Society 15 (4): 641–660. DOI logoGoogle Scholar
Klein, Richard A., et al.
2014 “Investigating Variation in Replicability: A ‘Many Labs’ Replication Project.” Social Psychology 45 (3): 142–152. DOI logoGoogle Scholar
Koolstra, Cees M., Allerd L. Peeters, and Herman Spinhof
2002 “The Pros and Cons of Dubbing and Subtitling.” European Journal of Communication 17 (3): 325–354. DOI logoGoogle Scholar
Kothari, Brij, and Tathagata Bandyopadhyay
2014 “Same Language Subtitling of Bollywood Film Songs on TV: Effects on Literacy.” Information Technologies & International Development 10 (4): 31–47.Google Scholar
Kruger, Jan-Louis, Esté Hefer, and Gordon Matthew
2014 “Attention Distribution and Cognitive Load in a Subtitled Academic Lecture: L1 vs. L2.” Journal of Eye Movement Research 7 (5): 1–15.Google Scholar
Lang, Annie
1995 “Defining Audio/Video Redundancy from a Limited-Capacity Information Processing Perspective.” Communication Research 22 (1): 86–115. DOI logoGoogle Scholar
2000 “The Limited Capacity Model of Mediated Message Processing.” Journal of Communication 50 (1): 46–70. DOI logoGoogle Scholar
Lang, Annie, Seth Geiger, Melody Strickwerda, and Janine Sumner
1993 “The Effects of Related and Unrelated Cuts on Television Viewers’ Attention, Processing Capacity, and Memory.” Communication Research 20 (1): 4–29. DOI logoGoogle Scholar
Lang, Annie, Paul Bolls, Robert F. Potter, and Karlynn Kawahara
1999 “The Effects of Production Pacing and Arousing Content on the Information Processing of Television Messages.” Journal of Broadcasting & Electronic Media 43 (4): 451–475. DOI logoGoogle Scholar
Lang, Annie, Shuhua Zhou, Nancy Schwartz, Paul Bolls, and Robert F. Potter
2000 “The Effects of Edits on Arousal, Attention, and Memory for Television Messages: When an Edit is an Edit Can an Edit be Too Much?Journal of Broadcasting & Electronic Media 44 (1): 94–109. DOI logoGoogle Scholar
Lang, Annie, Satoko Kurita, Ya Gao, and Bridget Rubenking
2013 “Measuring Television Message Complexity as Available Processing Resources: Dimensions of Information and Cognitive Load.” Media Psychology 16 (2): 129–153. DOI logoGoogle Scholar
Li, Yili
2000 “Linguistic Characteristics of ESL Writing in Task-Based E-Mail Activities.” System 28 (2): 229–245. DOI logoGoogle Scholar
Lomheim, Sylfest
1999 “The Writing on the Screen. Subtitling: A Case Study from Norwegian Broadcasting (NRK), Oslo.” In Word, Text and Translation, edited by Gunilla Anderman and Margaret Rogers, 190–207. Clevedon: Multilingual Matters.Google Scholar
Marleau, Lucien
1982 “Les sous-titres … un mal nécessaire.” Meta 27 (3): 271–285. DOI logoGoogle Scholar
MCG (Media Consulting Group)
2007Study on Dubbing and Subtitling Needs and Practices in the European Audiovisual Industry. Final report. European Commission, Directorate-General Education and Culture.Google Scholar
2011Study on the Use of Subtitling. The Potential of Subtitling to Encourage Foreign Language Learning and Improve the Mastery of Foreign Languages. Final report. European Commission, Directorate-General Education and Culture.Google Scholar
Monaco, James
2009How to Read a Film. Movie, Media and Beyond. 4th ed. Oxford: Oxford University Press.Google Scholar
Murphy, John J.
2007Me and You and Memento and Fargo. New York: Continuum. DOI logoGoogle Scholar
Orrego-Carmona, D.
2015The Reception of (Non)Professional Subtitling. PhD diss. Universitat Rovira i Virgili, Tarragona.Google Scholar
Pashler, Harold, and Eric-Jan Wagenmakers
2012 “Editors’ Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?Perspectives on Psychological Science 7 (6): 528–530. DOI logoGoogle Scholar
Pavesi, Maria
2005La traduzione cinematografica. Roma: Carocci.Google Scholar
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi
2010 “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 13 (3): 243–272. DOI logoGoogle Scholar
Perego, Elisa, Fabio Del Missier, and Sara Bottiroli
2015 “Dubbing and Subtitling in Young and Older Adults: Cognitive and Evaluative Aspects.” Perspectives: Studies in Translatology 23 (1): 1–21. DOI logoGoogle Scholar
Perego, Elisa, David Orrego-Carmona, and Sara Bottiroli
2016 “An Empirical Take on the Dubbing vs. Subtitling Debate: An Eye Movement Study.” Lingue e Linguaggi 19: 255–274.Google Scholar
Raven, John C.
1995Manual for the Coloured Progressive Matrices (revised). Windsor: NFRE-Nelson.Google Scholar
Reid, Helene
1978 “Subtitling: The Intelligent Solution.” In Translating, a Profession, edited by Paul A. Horguelin, 420–428. Paris: FIT.Google Scholar
Scott, Mike
2009Wordsmith Tools. London: Oxford University Press.Google Scholar
Szmrecsányi, Benedikt M.
2004 “On Operationalizing Syntactic Complexity.” In Le poids des mots. Proceedings of the 7th International Conference on Textual Data Statistical Analysis, edited by Gérard Purnelle, Gérard Fairon, and Anne Dister, 1032–1038. Louvain-la-Neuve: Presses Universitaires de Louvain.Google Scholar
Thurstone, Thelma Gwinn, and Louis Leon Thurstone
1963Primary Mental Ability. Chicago, IL: Science Research Associates.Google Scholar
Van de Poel, Marijke, and Géry d’Ydewalle
2001 “Incidental Foreign-Language Acquisition by Children Watching Subtitled Television Programs.” In (Multi)Media Translation. Concepts, Practices, and Research, edited by Yves Gambier and Henrik Gottlieb, 259–273. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Vanderplank, Robert
2010 “Déjà vu? A Decade of Research on Language Laboratories, Television and Video in Language Learning.” Language Teaching 43 (1): 1–37. DOI logoGoogle Scholar
Van Lommel, Sven, Annouschka Laenen, and Géry d’Ydewalle
2006 “Foreign-Grammar Acquisition while Watching Subtitled Television Programmes.” British Journal of Educational Psychology 76 (2): 243–258. DOI logoGoogle Scholar
Winke, Paula, Susan Gass, and Tetyana Sydorenko
2013 “Factors Influencing the Use of Captions by Foreign Language Learners: An Eye-Tracking Study.” The Modern Language Journal 97 (1): 254–275. DOI logoGoogle Scholar
Wissmath, Bartholomäus, David Weibel, and Rudolf Groner
2009 “Dubbing or Subtitling? Effects on Spatial Presence, Transportation, Flow, and Enjoyment.” Journal of Media Psychology 21 (3): 114–125. DOI logoGoogle Scholar
Wissmath, Bartholomäus, and David Weibel
2012 “Translating Movies and the Sensation of ‘Being There’.” In Eye Tracking in Audiovisual Translation, edited by Elisa Perego, 277–293. Roma: Aracne.Google Scholar