Part of
Audiovisual Translation in Applied Linguistics: Educational perspectivesEdited by Laura Incalcaterra McLoughlin, Jennifer Lertola and Noa Talaván
[Benjamins Current Topics 111] 2020
► pp. 57–77
Edited by Laura Incalcaterra McLoughlin, Jennifer Lertola and Noa Talaván
[Benjamins Current Topics 111] 2020
► pp. 57–77
The implications of Cognitive Load Theory and exposure to subtitles in English as a Foreign Language (EFL)
The pedagogical use of subtitled and captioned material in the foreign language classroom is upheld by various theories which reveal the cognitive processing activated when students are exposed to multimedia and subtitled audiovisual materials. The three theories that will be considered here are Cognitive Load Theory (CLT), Cognitive Theory of Multimedia Learning (CTML) and Cognitive Affective Theory of Learning with Media (CATLM). The main purpose of the paper is to illustrate the internal mechanisms triggered in learners when various sensorial channels (visual, auditory and textual) coincide simultaneously on screen and how this may affect their cognitive engagement and motivation while learning a foreign language. Additionally, two empirical studies will be presented in the second part of the article in order to provide evidence of the benefits of using subtitled audiovisual materials in the English as a Foreign Language (EFL) classroom in Higher Education. The results show that both interlingual (L1) and intralingual (L2) subtitles prove to have a facilitating role in informal and colloquial language learning in this context.
Keywords: cognitive load theory, cognitive theory of multimedia learning, cognitive affective theory of learning with media, subtitled material, colloquial language learning
Article outline
- 1.Introduction
- 2.Principles of Cognitive Load Theory
- 3.Cognitive Load Theory and Cognitive Theory of Multimedia Learning
- 4.The role of motivation in the Cognitive Affective Theory of Learning with Media
- 5.Two empirical studies
- 5.1Methodology
- 5.1.1Participants
- 5.1.2Resources
- 5.2Study 1
- 5.3Study 2
- 5.1Methodology
- 6.Conclusions
-
Notes -
References
References
Araújo, Vera
2008 “The Educational Use of Subtitled Films in EFL Teaching.” In The Didactics of Audiovisual Translation, ed. by Jorge Díaz Cintas, 227–238. Amsterdam: John Benjamins Publishing Company. 
Baddeley, Alan D.
1992 “Working Memory.” Science 255 (5044): 556–59.
Bianchi, Francesca, and Tiziana Ciabattoni
2008 “Captions and Subtitles in EFL Learning: An Investigative Study in a Comprehensive Computer Environment.” In From Didactas to Ecolingua, ed. by Anthony Baldry, Maria Pavesi, Carol Taylor Torsello, and Christopher Taylor, 69–90. Trieste: EUT – Edizioni Università di Trieste.
Bird, Stephen A., and John N. Williams
2002 “The Effect of Bimodal Input on Implicit and Explicit Memory: An Investigation into the Benefits of within-Language Subtitling.” Applied Psycholinguistics 23 (4): 509–33.
Bisson, Marie-Josée, Walter J. B. Van Heuven, Kathy Conklin, and Richard J. Tunney
2014 “Processing of Native and Foreign Language Subtitles in Films: An Eye Tracking Study.” Applied Psycholinguistics 35 (2): 399–418.
Borrás, Isabel, and Robert C. Lafayette
1994 “Effects of Multimedia Courseware Subtitling on the Speaking Performance of College Students of French.” The Modern Language Journal 78 (1): 61–75. .
.Bravo, Conceiçao
2008 “Putting the Reader in the Picture. Screen Translation and Foreign-Language Learning.” PhD diss. Rovira i Virgili University. Accessed October 29, 2017. [URL].
2010 “Text on Screen and Text on Air: A Useful Tool for Foreign Language Teachers and Learners.” In New Insights into Audiovisual Translation and Media, ed. by Jorge Díaz Cintas, Anna Matamala, and Josélia Neves, 269–83. Amsterdam: Rodopi.
Caimi, Annamaria
2006 “Audiovisual Translation and Language Learning: The Promotion of Intralingual Subtitles.” The Journal of Specialised Translation 6: 85–98.
Chai, Judy, and Rosemary Erlam
2008 “The Effect and the Influence of the Use of Video and Captions on Second Language Learning.” New Zealand Studies in Applied Linguistics 14 (2): 25–44.
Chandler, Paul, and John Sweller
1991 “Cognitive Load Theory and the Format of Instruction.” Cognition and Instruction 8 (4): 293–332.
Chong, Toh Seong
2005 “Recent Advances in Cognitive Load Theory Research: Implications for Instructional Designers.” Malaysian Online Journal of Instructional Technology (MOJIT) 2 (3): 106–117.
Coe, Robert
2000 “What Is an ‘Effect Size’?” CEM Centre, University of Durham. Accessed October 29, 2017. [URL].
Cohen, Louis, Lawrence Manion, and Keith Morrison
2011 Research Methods in Education. 7th ed. New York: Taylor & Francis Group.
D’Ydewalle, Géry, and Marijke Van de Poel
1999 “Incidental Foreign-Language Acquisition by Children Watching Subtitled Television Programs.” Journal of Psycholinguistic Research 28 (3): 227–244.
Danan, Martine
1992 “Reversed Subtitling and Dual Coding Theory: New Directions for Foreign Language Instruction.” Language Learning 42 (4): 497–527. .
.
2004 “Captioning and Subtitling: Undervalued Language Learning Strategies.” Meta 49 (1): 67–77.
2015 “Subtitling as a Language Learning Tool: Past Findings, Current Applications, and Future Paths.” In Subtitles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 41–61. Bern, New York: Peter Lang.
Field, Andy P., Jeremy Miles, and Zoe Field
2012 Discovering Statistics Using R. London: Sage.
Frumuselu, Anca Daniela
2015 “Subtitled Television Series inside the EFL Classroom: Long-Term Effects upon Colloquial Language Learning and Oral Production.” PhD diss. Universitat Rovira i Virgili.
Frumuselu, Anca Daniela, Sven De Maeyer, Vincent Donche, and María del Mar Gutiérrez Colon Plana
2015 “Television Series inside the EFL Classroom: Bridging the Gap between Teaching and Learning Informal Language through Subtitles.” Linguistics and Education 32: 107–117.
Garza, Thomas J.
1991 “Evaluating the Use of Captioned Video Materials in Advanced Foreign Language Learning.” Foreign Language Annals 24 (3): 239–58.
Homer, Bruce D., Jan L. Plass, and Linda Blake
2008 “The Effects of Video on Cognitive Load and Social Presence in Multimedia-Learning.” Computers in Human Behavior 24 (3): 786–797.
Howarth, Jeff
2015 “Learning by Solving Problems: Cognitive Load Theory and the Re-Design of an Introductory GIS Course.” Cartographic Perspectives 80: 18–34.
Koolstra, Cees M., and Johannes W. J. Beentjes
1999 “Children’s Vocabulary Acquisition in a Foreign Language through Watching Subtitled Television Programs at Home.” Etr&D-Educational Technology Research and Development 47 (1): 51–60.
Krashen, Stephen D.
1985 The Input Hypothesis: Issues and Implications. London: Longman.
Mayer, Richard E.
2003 “Cognitive Theory of Multimedia Learning.” Learning and Instruction 13: 125–39.
2009 Multimedia Learning. Cambridge: Cambridge University Press.
2011 Applying the Science of Learning. Boston, MA: Pearson/Allyn&Bacon.
2014 “Incorporating Motivation into Multimedia Learning.” Learning and Instruction 29: 171–73.
Mayer, Richard E., Hyunjeong Lee, and Alanna Peebles
2014 “Multimedia Learning in a Second Language: A Cognitive Load Perspective.” Applied Cognitive Psychology 28 (5): 653–660.
Moreno, Roxana
2005 “Instructional Technology: Promise and Pitfalls.” In Technology-Based Education: Bringing Researchers and Practitioners Together, ed. by Lisa M. Pytlik Zillig, Mary Bodvarsson, and Roger Bruning, 1–19. Greenwich, CT: Information Age Publishing.
Moreno, Roxana, and Richard Mayer
2007 “Interactive Multimodal Learning Environments.” Educational Psychology Review 19 (3): 309–326.
Nguyen, Frank, and Ruth Colvin Clark
2005 “Efficiency in E-Learning: Proven Instructional Methods for Faster, Better, Online Learning.” Learning Solutions Magazine, November. Accessed October 29, 2017. [URL].
Sorden, Stephen D.
2012 “The Cognitive Theory of Multimedia Learning.” In Handbook of Educational Theories, 1–31. Charlotte, NC: Information Age Publishing.
Sweller, John
1994 “Cognitive Load Theory, Learning Difficulty, and Instructional Design.” Learning and Instruction 4: 295–312.
2005 “Implications of Cognitive Load Theory for Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, ed. by Richard E. Mayer, 19–30. Cambridge: Cambridge University Press.
Sweller, John, Jeroen J. G. van Merriënboer, and Fred G. W. C. Paas
1998 “Cognitive Architecture and Instructional Design.” Educational Psychology Review 10 (3): 251–296.
Talaván, Noa
2011 “A Quasi-Experimental Research Project on Subtitling and Foreign Language Acquisition.” In Audiovisual Translation Subtitles and Subtitling. Theory and Practice, ed. by Laura Incalcaterra, Marie Biscio, and Máire Àine Ní Mhainnín, 197–218. Oxford: Peter Lang.
2012 “Justificación teórico-práctica del uso de los subtítulos en la enseñanza-aprendizaje de idiomas.” Trans. Revista de Traductología 16: 23–37.
2013 La subtitulación en el aprendizaje de lenguas extranjeras. Barcelona: Octaedro.
Vanderplank, Robert
1988 “The Value of Teletext Sub-Titles in Language Learning.” ELT Journal 42 (2): 272–81. .
.
2015 “Thirty Years of Research into Captions/Same Language Subtitles and Second/Foreign Language Learning: Distinguishing between ‘Effects Of’ Subtitles and ‘Effects With’ Subtitles for Future Research.” In Subtiles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 19–40. Bern, New York: Peter Lang.
van Merriënboer, Jeroen J. G., and Paul Ayres
2005 “Research on Cognitive Load Theory and its Design Implications for E-Learning.” Etr&D 53 (3): 5–13.
Wuang, Yan-dong, and Cai-fen Shen
2007 “Tentative Model of Integrating Authentic Captioned Video to Facilitate ESL Learning.” Sino-Us English Teaching 4 (9): 1–13.