Cover not available
Part of
Audiovisual Translation in Applied Linguistics: Educational perspectives
Edited by Laura Incalcaterra McLoughlin, Jennifer Lertola and Noa Talaván
[Benjamins Current Topics 111] 2020
► pp. 57–77

The implications of Cognitive Load Theory and exposure to subtitles in English as a Foreign Language (EFL)

| Universitat Rovira i Virgili
The pedagogical use of subtitled and captioned material in the foreign language classroom is upheld by various theories which reveal the cognitive processing activated when students are exposed to multimedia and subtitled audiovisual materials. The three theories that will be considered here are Cognitive Load Theory (CLT), Cognitive Theory of Multimedia Learning (CTML) and Cognitive Affective Theory of Learning with Media (CATLM). The main purpose of the paper is to illustrate the internal mechanisms triggered in learners when various sensorial channels (visual, auditory and textual) coincide simultaneously on screen and how this may affect their cognitive engagement and motivation while learning a foreign language. Additionally, two empirical studies will be presented in the second part of the article in order to provide evidence of the benefits of using subtitled audiovisual materials in the English as a Foreign Language (EFL) classroom in Higher Education. The results show that both interlingual (L1) and intralingual (L2) subtitles prove to have a facilitating role in informal and colloquial language learning in this context.
Keywords: cognitive load theory, cognitive theory of multimedia learning, cognitive affective theory of learning with media, subtitled material, colloquial language learning
Article outline
  • 1.Introduction
  • 2.Principles of Cognitive Load Theory
  • 3.Cognitive Load Theory and Cognitive Theory of Multimedia Learning
  • 4.The role of motivation in the Cognitive Affective Theory of Learning with Media
  • 5.Two empirical studies
    • 5.1Methodology
      • 5.1.1Participants
      • 5.1.2Resources
    • 5.2Study 1
    • 5.3Study 2
  • 6.Conclusions
  • Notes
  • References
Published online: 12 November 2020
DOI logo
https://doi.org/10.1075/bct.111.ttmc.00004.fru
References (45)
References
Araújo, Vera. 2008. “The Educational Use of Subtitled Films in EFL Teaching.” In The Didactics of Audiovisual Translation, ed. by Jorge Díaz Cintas, 227–238. Amsterdam: John Benjamins Publishing Company. DOI logoGoogle Scholar
Baddeley, Alan D. 1992. “Working Memory.” Science 255 (5044): 556–59. DOI logoGoogle Scholar
Bianchi, Francesca, and Tiziana Ciabattoni. 2008. “Captions and Subtitles in EFL Learning: An Investigative Study in a Comprehensive Computer Environment.” In From Didactas to Ecolingua, ed. by Anthony Baldry, Maria Pavesi, Carol Taylor Torsello, and Christopher Taylor, 69–90. Trieste: EUT – Edizioni Università di Trieste.Google Scholar
Bird, Stephen A., and John N. Williams. 2002. “The Effect of Bimodal Input on Implicit and Explicit Memory: An Investigation into the Benefits of within-Language Subtitling.” Applied Psycholinguistics 23 (4): 509–33. DOI logoGoogle Scholar
Bisson, Marie-Josée, Walter J. B. Van Heuven, Kathy Conklin, and Richard J. Tunney. 2014. “Processing of Native and Foreign Language Subtitles in Films: An Eye Tracking Study.” Applied Psycholinguistics 35 (2): 399–418. DOI logoGoogle Scholar
Borrás, Isabel, and Robert C. Lafayette. 1994. “Effects of Multimedia Courseware Subtitling on the Speaking Performance of College Students of French.” The Modern Language Journal 78 (1): 61–75. DOI logo.Google Scholar
Bravo, Conceiçao. 2008. “Putting the Reader in the Picture. Screen Translation and Foreign-Language Learning.” PhD diss. Rovira i Virgili University. Accessed October 29, 2017. [URL].
. 2010. “Text on Screen and Text on Air: A Useful Tool for Foreign Language Teachers and Learners.” In New Insights into Audiovisual Translation and Media, ed. by Jorge Díaz Cintas, Anna Matamala, and Josélia Neves, 269–83. Amsterdam: Rodopi. DOI logoGoogle Scholar
Caimi, Annamaria. 2006. “Audiovisual Translation and Language Learning: The Promotion of Intralingual Subtitles.” The Journal of Specialised Translation 6: 85–98.Google Scholar
Chai, Judy, and Rosemary Erlam. 2008. “The Effect and the Influence of the Use of Video and Captions on Second Language Learning.” New Zealand Studies in Applied Linguistics 14 (2): 25–44.Google Scholar
Chandler, Paul, and John Sweller. 1991. “Cognitive Load Theory and the Format of Instruction.” Cognition and Instruction 8 (4): 293–332. DOI logoGoogle Scholar
Chong, Toh Seong. 2005. “Recent Advances in Cognitive Load Theory Research: Implications for Instructional Designers.” Malaysian Online Journal of Instructional Technology (MOJIT) 2 (3): 106–117.Google Scholar
Coe, Robert. 2000. “What Is an ‘Effect Size’?” CEM Centre, University of Durham. Accessed October 29, 2017. [URL].
Cohen, Louis, Lawrence Manion, and Keith Morrison. 2011. Research Methods in Education. 7th ed. New York: Taylor & Francis Group.Google Scholar
D’Ydewalle, Géry, and Marijke Van de Poel. 1999. “Incidental Foreign-Language Acquisition by Children Watching Subtitled Television Programs.” Journal of Psycholinguistic Research 28 (3): 227–244. DOI logoGoogle Scholar
Danan, Martine. 1992. “Reversed Subtitling and Dual Coding Theory: New Directions for Foreign Language Instruction.” Language Learning 42 (4): 497–527. DOI logo.Google Scholar
. 2004. “Captioning and Subtitling: Undervalued Language Learning Strategies.” Meta 49 (1): 67–77. DOI logoGoogle Scholar
. 2015. “Subtitling as a Language Learning Tool: Past Findings, Current Applications, and Future Paths.” In Subtitles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 41–61. Bern, New York: Peter Lang.Google Scholar
Field, Andy P., Jeremy Miles, and Zoe Field. 2012. Discovering Statistics Using R. London: Sage.Google Scholar
Frumuselu, Anca Daniela. 2015. “Subtitled Television Series inside the EFL Classroom: Long-Term Effects upon Colloquial Language Learning and Oral Production.” PhD diss. Universitat Rovira i Virgili.Google Scholar
Frumuselu, Anca Daniela, Sven De Maeyer, Vincent Donche, and María del Mar Gutiérrez Colon Plana. 2015. “Television Series inside the EFL Classroom: Bridging the Gap between Teaching and Learning Informal Language through Subtitles.” Linguistics and Education 32: 107–117. DOI logoGoogle Scholar
Garza, Thomas J. 1991. “Evaluating the Use of Captioned Video Materials in Advanced Foreign Language Learning.” Foreign Language Annals 24 (3): 239–58. DOI logoGoogle Scholar
Homer, Bruce D., Jan L. Plass, and Linda Blake. 2008. “The Effects of Video on Cognitive Load and Social Presence in Multimedia-Learning.” Computers in Human Behavior 24 (3): 786–797. DOI logoGoogle Scholar
Howarth, Jeff. 2015. “Learning by Solving Problems: Cognitive Load Theory and the Re-Design of an Introductory GIS Course.” Cartographic Perspectives 80: 18–34. DOI logoGoogle Scholar
Koolstra, Cees M., and Johannes W. J. Beentjes. 1999. “Children’s Vocabulary Acquisition in a Foreign Language through Watching Subtitled Television Programs at Home.” Etr&D-Educational Technology Research and Development 47 (1): 51–60. DOI logoGoogle Scholar
Krashen, Stephen D. 1985. The Input Hypothesis: Issues and Implications. London: Longman.Google Scholar
Mayer, Richard E. 2003. “Cognitive Theory of Multimedia Learning.” Learning and Instruction 13: 125–39. DOI logoGoogle Scholar
2009. Multimedia Learning. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
2011. Applying the Science of Learning. Boston, MA: Pearson/Allyn&Bacon.Google Scholar
2014. “Incorporating Motivation into Multimedia Learning.” Learning and Instruction 29: 171–73. DOI logoGoogle Scholar
Mayer, Richard E., Hyunjeong Lee, and Alanna Peebles. 2014. “Multimedia Learning in a Second Language: A Cognitive Load Perspective.” Applied Cognitive Psychology 28 (5): 653–660. DOI logoGoogle Scholar
Moreno, Roxana. 2005. “Instructional Technology: Promise and Pitfalls.” In Technology-Based Education: Bringing Researchers and Practitioners Together, ed. by Lisa M. Pytlik Zillig, Mary Bodvarsson, and Roger Bruning, 1–19. Greenwich, CT: Information Age Publishing.Google Scholar
Moreno, Roxana, and Richard Mayer. 2007. “Interactive Multimodal Learning Environments.” Educational Psychology Review 19 (3): 309–326. DOI logoGoogle Scholar
Nguyen, Frank, and Ruth Colvin Clark. 2005. “Efficiency in E-Learning: Proven Instructional Methods for Faster, Better, Online Learning.” Learning Solutions Magazine, November. Accessed October 29, 2017. [URL].
Sorden, Stephen D. 2012. “The Cognitive Theory of Multimedia Learning.” In Handbook of Educational Theories, 1–31. Charlotte, NC: Information Age Publishing.Google Scholar
Sweller, John. 1994. “Cognitive Load Theory, Learning Difficulty, and Instructional Design.” Learning and Instruction 4: 295–312. DOI logoGoogle Scholar
. 2005. “Implications of Cognitive Load Theory for Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, ed. by Richard E. Mayer, 19–30. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Sweller, John, Jeroen J. G. van Merriënboer, and Fred G. W. C. Paas. 1998. “Cognitive Architecture and Instructional Design.” Educational Psychology Review 10 (3): 251–296. DOI logoGoogle Scholar
Talaván, Noa. 2011. “A Quasi-Experimental Research Project on Subtitling and Foreign Language Acquisition.” In Audiovisual Translation Subtitles and Subtitling. Theory and Practice, ed. by Laura Incalcaterra, Marie Biscio, and Máire Àine Ní Mhainnín, 197–218. Oxford: Peter Lang.Google Scholar
. 2012. “Justificación teórico-práctica del uso de los subtítulos en la enseñanza-aprendizaje de idiomas.” Trans. Revista de Traductología 16: 23–37.Google Scholar
. 2013. La subtitulación en el aprendizaje de lenguas extranjeras. Barcelona: Octaedro.Google Scholar
Vanderplank, Robert. 1988. “The Value of Teletext Sub-Titles in Language Learning.” ELT Journal 42 (2): 272–81. DOI logo.Google Scholar
. 2015. “Thirty Years of Research into Captions/Same Language Subtitles and Second/Foreign Language Learning: Distinguishing between ‘Effects Of’ Subtitles and ‘Effects With’ Subtitles for Future Research.” In Subtiles and Language Learning. Principles, Strategies and Practical Experiences, ed. by Yves Gambier, Annamaria Caimi, and Cristina Mariotti, 19–40. Bern, New York: Peter Lang.Google Scholar
van Merriënboer, Jeroen J. G., and Paul Ayres. 2005. “Research on Cognitive Load Theory and its Design Implications for E-Learning.” Etr&D 53 (3): 5–13. DOI logoGoogle Scholar
Wuang, Yan-dong, and Cai-fen Shen. 2007. “Tentative Model of Integrating Authentic Captioned Video to Facilitate ESL Learning.” Sino-Us English Teaching 4 (9): 1–13.Google Scholar