Cover not available
Article published In:
Audiovisual translation in applied linguistics: Educational perspectives
Edited by Laura Incalcaterra McLoughlin, Jennifer Lertola and Noa Talaván
[Translation and Translanguaging in Multilingual Contexts 4:1] 2018
► pp. 55–76

The implications of Cognitive Load Theory and exposure to subtitles in English Foreign Language (EFL)

| Universitat Rovira i Virgili
The pedagogical use of subtitled and captioned material in the foreign language classroom is upheld by various theories which reveal the cognitive processing activated when students are exposed to multimedia and subtitled audiovisual materials. The three theories that will be considered here are Cognitive Load Theory (CLT), Cognitive Theory of Multimedia Learning (CTML) and Cognitive Affective Theory of Learning with Media (CATLM). The main purpose of the paper is to illustrate the internal mechanisms triggered in learners when various sensorial channels (visual, auditory and textual) coincide simultaneously on screen and how this may affect their cognitive engagement and motivation while learning a foreign language. Additionally, two empirical studies will be presented in the second part of the article in order to provide evidence of the benefits of using subtitled audiovisual materials in the English Foreign Language (EFL) classroom in higher education. The results show that both interlingual (L1) and intralingual (L2) subtitles prove to have a facilitating role in informal and colloquial language learning in this context.
Keywords: cognitive load theory, cognitive theory of multimedia learning, cognitive affective theory of learning with media, subtitled material, colloquial language learning
Article outline
  • 1.Introduction
  • 2.Principles of Cognitive Load Theory
  • 3.Cognitive Load Theory and Cognitive Theory of Multimedia Learning
  • 4.The role of motivation in the Cognitive Affective Theory of Learning with Media
  • 5.Two empirical studies
    • 5.1Methodology
      • 5.1.1Participants
      • 5.1.2Resources
    • 5.2Study 1
    • 5.3Study 2
  • 6.Conclusions
  • Notes
  • References
Published online: 24 April 2018
DOI logo
https://doi.org/10.1075/ttmc.00004.fru
References
Araújo, Vera
2008 “The Educational Use of Subtitled Films in EFL Teaching.” In The Didactics of Audiovisual Translation, ed. by Jorge Díaz Cintas, 227–238. Amsterdam: John Benjamins Publishing Company. DOI logoGoogle Scholar
Baddeley, Alan D.
1992 “Working Memory.” Science 255 (5044): 556–59. DOI logoGoogle Scholar
Bianchi, Francesca, and Tiziana Ciabattoni
2008 “Captions and Subtitles in EFL Learning: An Investigative Study in a Comprehensive Computer Environment.” In From Didactas to Ecolingua, ed. by Anthony Baldry, Maria Pavesi, Carol Taylor Torsello, and Christopher Taylor, 69–90. Trieste: EUT – Edizioni Università di Trieste.Google Scholar
Bird, Stephen A., and John N. Williams
2002 “The Effect of Bimodal Input on Implicit and Explicit Memory: An Investigation into the Benefits of within-Language Subtitling.” Applied Psycholinguistics 23 (4): 509–33. DOI logoGoogle Scholar
Bisson, Marie-Josée, Walter J. B. Van Heuven, Kathy Conklin, and Richard J. Tunney
2014 “Processing of Native and Foreign Language Subtitles in Films: An Eye Tracking Study.” Applied Psycholinguistics 35 (2): 399–418. DOI logoGoogle Scholar
Borrás, Isabel, and Robert C. Lafayette
1994 “Effects of Multimedia Courseware Subtitling on the Speaking Performance of College Students of French.” The Modern Language Journal 78 (1): 61–75. DOI logo.Google Scholar
Bravo, Conceiçao
2008 “Putting the Reader in the Picture. Screen Translation and Foreign-Language Learning.” PhD diss. Rovira i Virgili University. Accessed October 29, 2017. [URL].
2010 “Text on Screen and Text on Air: A Useful Tool for Foreign Language Teachers and Learners.” In New Insights into Audiovisual Translation and Media, ed. by Jorge Díaz Cintas, Anna Matamala, and Josélia Neves, 269–83. Amsterdam: Rodopi. DOI logoGoogle Scholar
Caimi, Annamaria
2006 “Audiovisual Translation and Language Learning: The Promotion of Intralingual Subtitles.” The Journal of Specialised Translation 61: 85–98.Google Scholar
Chai, Judy, and Rosemary Erlam
2008 “The Effect and the Influence of the Use of Video and Captions on Second Language Learning.” New Zealand Studies in Applied Linguistics 14 (2): 25–44.Google Scholar
Chandler, Paul, and John Sweller
1991 “Cognitive Load Theory and the Format of Instruction.” Cognition and Instruction 8 (4): 293–332. DOI logoGoogle Scholar
Chong, Toh Seong
2005 “Recent Advances in Cognitive Load Theory Research: Implications for Instructional Designers.” Malaysian Online Journal of Instructional Technology (MOJIT) 2 (3): 106–117.Google Scholar
Coe, Robert
2000 “What Is an ‘Effect Size’?” CEM Centre, University of Durham. Accessed October 29, 2017. [URL].
Cohen, Louis, Lawrence Manion, and Keith Morrison
2011 Research Methods in Education. 7th ed. New York: Taylor & Francis Group.Google Scholar
D’Ydewalle, Géry, and Marijke Van de Poel
1999 “Incidental Foreign-Language Acquisition by Children Watching Subtitled Television Programs.” Journal of Psycholinguistic Research 28 (3): 227–244. DOI logoGoogle Scholar
Danan, Martine
1992 “Reversed Subtitling and Dual Coding Theory: New Directions for Foreign Language Instruction.” Language Learning 42 (4): 497–527. DOI logo.Google Scholar
2004 “Captioning and Subtitling: Undervalued Language Learning Strategies.” Meta 49 (1): 67–77. DOI logoGoogle Scholar
2015 “Subtitling as a Language Learning Tool: Past Findings, Current Applications, and Future Paths.” In Subtitles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 41–61. Bern, New York: Peter Lang.Google Scholar
Field, Andy P., Jeremy Miles, and Zoe Field
2012 Discovering Statistics Using R. London: Sage.Google Scholar
Frumuselu, Anca Daniela
2015 “Subtitled Television Series inside the EFL Classroom: Long-Term Effects upon Colloquial Language Learning and Oral Production.” PhD diss. Universitat Rovira i Virgili.Google Scholar
Frumuselu, Anca Daniela, Sven De Maeyer, Vincent Donche, and María del Mar Gutiérrez Colon Plana
2015 “Television Series inside the EFL Classroom: Bridging the Gap between Teaching and Learning Informal Language through Subtitles.” Linguistics and Education 321: 107–117. DOI logoGoogle Scholar
Garza, Thomas J.
1991 “Evaluating the Use of Captioned Video Materials in Advanced Foreign Language Learning.” Foreign Language Annals 24 (3): 239–58. DOI logoGoogle Scholar
Homer, Bruce D., Jan L. Plass, and Linda Blake
2008 “The Effects of Video on Cognitive Load and Social Presence in Multimedia-Learning.” Computers in Human Behavior 24 (3): 786–797. DOI logoGoogle Scholar
Howarth, Jeff
2015 “Learning by Solving Problems: Cognitive Load Theory and the Re-Design of an Introductory GIS Course.” Cartographic Perspectives 801: 18–34. DOI logoGoogle Scholar
Koolstra, Cees M., and Johannes W. J. Beentjes
1999 “Children’s Vocabulary Acquisition in a Foreign Language through Watching Subtitled Television Programs at Home.” Etr&D-Educational Technology Research and Development 47 (1): 51–60. DOI logoGoogle Scholar
Krashen, Stephen D.
1985 The Input Hypothesis: Issues and Implications. London: Longman.Google Scholar
Mayer, Richard E.
2003 “Cognitive Theory of Multimedia Learning.” Learning and Instruction 131: 125–39. DOI logoGoogle Scholar
2009 Multimedia Learning. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
2011 Applying the Science of Learning. Boston, MA: Pearson/Allyn&Bacon.Google Scholar
2014 “Incorporating Motivation into Multimedia Learning.” Learning and Instruction 291: 171–73. DOI logoGoogle Scholar
Mayer, Richard E., Hyunjeong Lee, and Alanna Peebles
2014 “Multimedia Learning in a Second Language: A Cognitive Load Perspective.” Applied Cognitive Psychology 28 (5): 653–660. DOI logoGoogle Scholar
Merriënboer, Jeroen J. G. Van, and Paul Ayres
2005 “Research on Cognitive Load Theory and its Design Implications for E-Learning.” Etr&D 53 (3): 5–13. DOI logoGoogle Scholar
Moreno, Roxana
2005 “Instructional Technology: Promise and Pitfalls.” In Technology-Based Education: Bringing Researchers and Practitioners Together, ed. by Lisa M. Pytlik Zillig, Mary Bodvarsson, and Roger Bruning, 1–19. Greenwich, CT: Information Age Publishing.Google Scholar
Moreno, Roxana, and Richard Mayer
2007 “Interactive Multimodal Learning Environments.” Educational Psychology Review 19 (3): 309–326. DOI logoGoogle Scholar
Nguyen, Frank, and Ruth Colvin Clark
2005 “Efficiency in E-Learning: Proven Instructional Methods for Faster, Better, Online Learning.” Learning Solutions Magazine, November. Accessed October 29, 2017. [URL].
Sorden, Stephen D.
2012 “The Cognitive Theory of Multimedia Learning.” In Handbook of Educational Theories, 1–31. Charlotte, NC: Information Age Publishing.Google Scholar
Sweller, John
1994 “Cognitive Load Theory, Learning Difficulty, and Instructional Design.” Learning and Instruction 41: 295–312. DOI logoGoogle Scholar
2005 “Implications of Cognitive Load Theory for Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, ed. by Richard E. Mayer, 19–30. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Sweller, John, Jeroen J. G. Van Merriënboer, and Fred G. W. C. Paas
1998 “Cognitive Architecture and Instructional Design.” Educational Psychology Review 10 (3): 251–296. DOI logoGoogle Scholar
Talaván, Noa
2011 “A Quasi-Experimental Research Project on Subtitling and Foreign Language Acquisition.” In Audiovisual Translation Subtitles and Subtitling. Theory and Practice, ed. by Laura Incalcaterra, Marie Biscio, and Máire Àine Ní Mhainnín, 197–218. Oxford: Peter Lang.Google Scholar
2012 “Justificación teórico-práctica del uso de los subtítulos en la enseñanza-aprendizaje de idiomas.” Trans. Revista de Traductología 161: 23–37.Google Scholar
2013 La subtitulación en el aprendizaje de lenguas extranjeras. Barcelona: Octaedro.Google Scholar
Vanderplank, Robert
1988 “The Value of Teletext Sub-Titles in Language Learning.” ELT Journal 42 (2): 272–81. DOI logo.Google Scholar
2015 “Thirty Years of Research into Captions/Same Language Subtitles and Second/Foreign Language Learning: Distinguishing between ‘Effects Of’ Subtitles and ‘Effects With’ Subtitles for Future Research.” In Subtiles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 19–40. Bern, New York: Peter Lang.Google Scholar
Wuang, Yan-dong, and Cai-fen Shen
2007 “Tentative Model of Integrating Authentic Captioned Video to Facilitate ESL Learning.” Sino-Us English Teaching 4 (9): 1–13.Google Scholar
Cited by

Cited by 2 other publications

Vanderplank, Robert
2019. ‘Gist watching can only take you so far’: attitudes, strategies and changes in behaviour in watching films with captions. The Language Learning Journal 47:4 ► pp. 407 ff. DOI logo
Vanderplank, Robert
2019. Video and Informal Language Learning. In The Handbook of Informal Language Learning, ► pp. 181 ff. DOI logo

This list is based on CrossRef data as of 11 november 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.