Cover not available
Part of
Audiovisual Input and Second Language Learning
Edited by Carmen Muñoz and Imma Miralpeix
[Language Learning & Language Teaching 61] 2024
► pp. 74–99

Attention allocation in (L1) subtitled
and (L2) captioned video viewing

Effects of prior vocabulary instruction on input processing and comprehension

| Universitat de Barcelona,
| Fonds Wetenschappelijk Onderzoek – Vlaanderen (FWO),
Pre-directing learners’ attention to novel words facilitates learning through meaning-focused input, but little is known about the effect that vocabulary-focused activities may have on video processing and comprehension. This study investigates attention allocation in (L1) subtitled and (L2) captioned video viewing and explores potential trade-offs between pre-viewing instruction and comprehension. Eighty-seven Catalan/Spanish L2-English beginner learners watched an eight-minute video with either captions or subtitles while their eye-movements were recorded. Half of the participants in each language condition were pre-taught vocabulary. Results showed that pre-viewing instruction affected attention allocation only in the captions group, with participants tending to spend less time on target captions and comprehension-relevant captions. Allocating attention to vocabulary, however, did not seem to hinder comprehension in a significant manner.
Article outline
  • 1.Introduction
  • 2.Literature review
    • 2.1Vocabulary learning through L2 television
    • 2.2The importance of attention allocation
    • 2.3Pre-viewing instruction as an attention enhancing technique
    • 2.4Trade-off effects
    • 2.5Rationale and research aims
  • 3.Methodology
    • 3.1Participants
    • 3.2Audiovisual materials
    • 3.3Target words
    • 3.4Pre- and post-viewing tasks
    • 3.5Procedure
    • 3.6Scoring and data analysis
  • 4.Results
    • 4.1Effect of instruction on dwell times and number of fixations on target-vocabulary AOIs
    • 4.2Effect of instruction on comprehension rates
    • 4.3Effect of instruction on dwell times and number of fixations on question-relevant AOIs
  • 5.Discussion
  • 6.Conclusion and further research
  • Ethical considerations
  • Acknowledgements
  • Notes
  • References
  • Appendix
This content is being prepared for publication; it may be subject to changes.
References (44)
References
Avello, D., & Muñoz, C. (2023). The development of receptive language skills from captioned video viewing in primary school EFL learners. Education Sciences, 13(5), 479. DOI logoGoogle Scholar
Ayres, P., & Sweller, J. (2005). The split-attention principle in multimedia learning. In R. E. Mayer (Ed.), The Cambridge handbook of multimedia learning (pp. 135–146). Cambridge University Press. DOI logoGoogle Scholar
Bisson, M. J., Van Heuven, W. J., Conklin, K., & Tunney, R. J. (2014). Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics, 35(2), 399–418. DOI logoGoogle Scholar
Chang, A. C. S., & Read, J. (2006). The effects of listening support on the listening performance of EFL learners. TESOL Quarterly, 40(2), 375–397. DOI logoGoogle Scholar
Choi, S. (2017). Processing and learning of enhanced English collocations: An eye movement study. Language Teaching Research, 21(3), 403–426. DOI logoGoogle Scholar
Chung, J. M. (2002). The effects of using two advance organizers with video texts for the teaching of listening in English. Foreign Language Annals, 35(2), 231–241. DOI logoGoogle Scholar
Cochran, W. G. (1954). Some methods for strengthening the common χ2 tests. Biometrics, 10(4), 417–451. DOI logoGoogle Scholar
Elgort, I., Wetering, R. V. D., Arrow, T., & Beyersmann, E. (2023). Previewing novel words before reading affects their processing during reading: An eye-movement study with first and second language readers. Language Learning. DOI logoGoogle Scholar
Gass, S., Winke, P., Isbell, D. R., & Ahn, J. (2019). How captions help people learn languages: A working-memory, eye-tracking study. Language Learning & Technology, 23(2), 84–104Google Scholar
Gesa, F., & Miralpeix, I. (2023). Extensive viewing as additional input for foreign language vocabulary learning: A longitudinal study in secondary school. Language Teaching Research. DOI logoGoogle Scholar
Godfroid, A. (2019). Eye tracking in second language acquisition and bilingualism: A research synthesis and methodological guide. Taylor and Francis. DOI logoGoogle Scholar
Godfroid, A., Housen, A., & Boers, F. (2010). A procedure for testing the Noticing Hypothesis in the context of vocabulary acquisition. In M. Pütz & L. Sicola (Eds.), Cognitive processing in second language acquisition: Inside the learner’s mind (pp. 169–197). John Benjamins. DOI logoGoogle Scholar
Khan, N., Kasdar, J., Melvin, M., Blomquist, R., Huang, E., & McEwen, J. (2015). Fresh off the Boat [TV series]. ABC.Google Scholar
Laufer, B., & Hulstijn, J. (2001). Incidental vocabulary acquisition in a second language: The construct of task-induced involvement. Applied linguistics, 22(1), 1–26. DOI logoGoogle Scholar
Lee, S. K. (2007). Effects of textual enhancement and topic familiarity on Korean EFL students’ reading comprehension and learning of passive form. Language Learning, 57(1), 87–118. DOI logoGoogle Scholar
Lindgren, E., & Muñoz, C. (2013). The influence of exposure, parents, and linguistic distance on young European learners’ foreign language comprehension. International Journal of Multilingualism, 10(1), 105–129. DOI logoGoogle Scholar
Majuddin, E., Siyanova-Chanturia, A., & Boers, F. (2021). Incidental acquisition of multiword expressions through audiovisual materials: The role of repetition and typographic enhancement. Studies in Second Language Acquisition, 43(5), 985–1008. DOI logoGoogle Scholar
Montero Perez, M. (2019). Pre-learning vocabulary before viewing captioned video: An eye-tracking study. The Language Learning Journal, 47(4), 460–478. DOI logoGoogle Scholar
Montero Perez, M., Peters, E., & Desmet, P. (2015). Enhancing vocabulary learning through captioned video: An eye-tracking study. Modern Language Journal, 99(2), 308–328. DOI logoGoogle Scholar
(2018). Vocabulary learning through viewing video: The effect of two enhancement techniques. Computer Assisted Language Learning, 31(1–2), 1–26. DOI logoGoogle Scholar
Montero Perez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739. DOI logoGoogle Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eye-tracking study. System, 67, 77–86. DOI logoGoogle Scholar
Nation, P., & Heatley, A. (2002). Range: A program for the analysis of vocabulary in texts [software].Google Scholar
Pellicer-Sánchez, A., Conklin, K., & Vilkaitė-Lozdienė, L. (2021a). The effect of pre-reading instruction on vocabulary learning: An investigation of L1 and L2 readers’ eye movements. Language Learning, 71(1), 162–203. DOI logoGoogle Scholar
(2021b). (Re) Examining the benefits of pre-reading instruction for vocabulary learning. TESOL Quarterly, 56(1), 363–375. DOI logoGoogle Scholar
Peters, E. (2019). The effect of imagery and on-screen text on foreign language vocabulary learning from audiovisual input. TESOL Quarterly, 53(4), 1008–1032. DOI logoGoogle Scholar
Peters, E., & Webb, S. (2018). Incidental vocabulary acquisition through watching a single episode of L2 television. Studies in Second Language Acquisition, 40(3), 551–577. DOI logoGoogle Scholar
Puimège, E., Montero Perez, M., & Peters, E. (2023). The effects of typographic enhancement on L2 collocation processing and learning from reading: An eye-tracking study. Applied Linguistics, 45(1), 88–110. DOI logoGoogle Scholar
Pujadas, G., & Muñoz, C. (2019). Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by adolescents. The Language Learning Journal, 47(4), 479–496. DOI logoGoogle Scholar
(2020). Examining adolescent EFL learners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, 42(3), 551–575. DOI logoGoogle Scholar
(2023). Measuring the visual in audio-visual input: The effects of imagery in vocabulary learning through TV viewing. ITL-International Journal of Applied Linguistics 174(2), 263–290. DOI logoGoogle Scholar
Robinson, P. (2003). Attention and memory during SLA. In C. Doughty & M. Long (Eds.), Handbook of research in second language acquisition (pp. 631–678). Blackwell. DOI logoGoogle Scholar
Rodgers, M. P. (2018). The images in television programs and the potential for learning unknown words: The relationship between on-screen imagery and vocabulary. ITL-International Journal of Applied Linguistics, 169(1), 191–211. DOI logoGoogle Scholar
Rodgers, M. P. H., & Webb, S. (2011). Narrow viewing: The vocabulary in related television programs. TESOL Quarterly, 45(4), 689–717. DOI logoGoogle Scholar
(2020). Incidental vocabulary learning through watching television. ITL – International Journal of Applied Linguistics, 171(2), 191–220. DOI logoGoogle Scholar
Schmidt, R. W. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129–158. DOI logoGoogle Scholar
Schmitt, N. (2008). Instructed second language vocabulary learning. Language Teaching Research, 12(3), 329–363. DOI logoGoogle Scholar
(2010). Researching vocabulary: A vocabulary research manual. Palgrave MacMillan. DOI logoGoogle Scholar
Teng, F. (2022). Vocabulary learning through videos: Captions, advance-organizer strategy, and their combination. Computer Assisted Language Learning, 35(3), 518–550. DOI logoGoogle Scholar
VanPatten, B. (2004). Processing instruction: Theory, research, and commentary. Routledge. DOI logoGoogle Scholar
Webb, S. (2015). Extensive viewing: Language learning through watching television. In D. Nunan & J. C. Richards (Eds.), Language learning beyond the classroom (pp. 159–168). Routledge.Google Scholar
Webb, S. A. (2009). The effects of pre-learning vocabulary on reading comprehension and writing. Canadian Modern Language Review, 65(3), 441–470. DOI logoGoogle Scholar
Webb, S., & Nation, P. (2017). How vocabulary is learned. Oxford University Press.Google Scholar
Webb, S., Uchihara, T., & Yanagisawa, A. (2023). How effective is second language incidental vocabulary learning? A meta-analysis. Language Teaching, 56(2), 161–180. DOI logoGoogle Scholar