Cover not available
Part of
Audiovisual Input and Second Language Learning
Edited by Carmen Muñoz and Imma Miralpeix
[Language Learning & Language Teaching 61] 2024
► pp. 129–153

Multimodal input and L2 pragmatics

An eye-tracking study

| Universitat de Barcelona
| Universitat de Barcelona
| Universitat Jaume I
Analyzing the effects of multimodal input in the acquisition of second/foreign language (L2) pragmatics is a recent area in research. In this line, the use of eye-tracking to investigate L2 pragmatics remains limited (Godfroid, 2019). This study aimed to explore the effects of multimodal input on L2 requests among English as a Foreign Language (EFL) learners, while monitoring them with a webcam eye-tracker. The study used a multiple-choice discourse completion test at pre and posttest to evaluate the effects of viewing audio-visual material with or without captions. Additionally, a subset of participants was interviewed regarding pragmatic perception. Findings indicate that participants exposed to captioned videos performed better in the posttest and relied on captions when viewing, a result corroborated by retrospective interviews.
Article outline
  • 1.Introduction
  • 2.Review of the literature
  • 3.Methodology
    • 3.1Participants
    • 3.2Instruments
      • 3.2.1Selected scenes from the series Emily in Paris
      • 3.2.2Multiple-choice discourse completion test (MCDCT)
      • 3.2.3RealEye
      • 3.2.4Retrospective interviews
    • 3.3Data collection procedure
    • 3.4Data analysis
  • 4.Results
    • 4.1RQ1: What are the effects of captioned-video viewing on the learning of requests, as compared to non-captioned video viewing?
    • 4.2RQ2: Is there a difference in visual behavior when watching
      captioned and uncaptioned videos?
    • 4.3RQ3: What are learners’ perceptions of their pragmatic learning in relation to the presence of captions (or not) in the videos?
      • 4.3.1Captions group
      • 4.3.2No captions group
  • 5.Discussion
  • 6.Conclusion
  • Author queries
  • Acknowledgements
  • References
  • Appendix
This content is being prepared for publication; it may be subject to changes.
References (24)
References
Abrams, Z. I. (2014). Using film to provide a context for teaching L2 pragmatics. System, 46, 55–64. DOI logoGoogle Scholar
Alcón, E., & Pitarch, J. G. (2010). The effect of instruction on learners’ pragmatic awareness: A focus on refusals. International Journal of English Studies, 10(1), 65–80. DOI logoGoogle Scholar
Bardovi-Harlig, K. (2013). Developing L2 pragmatics. Language Learning, 63(1), 68–86. DOI logoGoogle Scholar
Barón, J., & Celaya, M. L. (2022). “May I do something for you?” The effects of audio-visual material (captioned and non-captioned) on EFL pragmatic learning. Special Issue: Teaching second language pragmatics in the current era of globalization. Language Teaching Research, 26(2), 238–255. DOI logoGoogle Scholar
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language use. Cambridge University Press. DOI logoGoogle Scholar
Bruti, S. (2016). Audiovisual texts and subtitling in the teaching of pragmatics. Trans-kom, 9(2), 186–207.Google Scholar
Celaya, M. L., Amengual, M., Martínez-Flor, A., & Barón, J. (2023). Using audio-visual material in Second Language Acquisition courses: An analysis for English Philology/English Studies. In L. J. Conejero Magro, C. Blanco García, L. Méndez Márquez, & J. Ruiz Morgan (Eds.), Bridging cultures. English and American studies in Spain (121–127). Universidad de Extremadura.Google Scholar
Derakhshan, A., & Eslami, Z. R. (2020). The effect of metapragmatic awareness, interactive translation, and discussion through video-enhanced input on EFL learners’ comprehension of implicature. Applied Research on English Language, 9(1), 637–664.Google Scholar
Finger-Bou, R., & Muñoz, C. (2023). The effects of regular and enhanced captions on incidental vocabulary acquisition. ELIA. Estudios de Lingüística Inglesa Aplicada,23, 15–50. DOI logoGoogle Scholar
Frumuselu, A. D., De Maeyer, S., Donche, V., & Gutiérrez-Colón, M. M. (2015). Television series inside the EFL classroom: Bridging the gap between teaching and learning informal language through subtitles. Linguistics and Education, 32, 107–117. DOI logoGoogle Scholar
Gesa, F., & Miralpeix, I. (2023). Extensive viewing as additional input for foreign language vocabulary learning: A longitudinal study in secondary school. Language Teaching Research. DOI logoGoogle Scholar
Godfroid, A. (2020). Eye-tracking in second language acquisition and bilingualism. A research synthesis and methodological guide. Routledge.Google Scholar
Khazdouzian, Y., Celaya, M. L., & Barón, J. (2021). When watching is not enough: The effects of captions on L2 pragmatics acquisition and awareness. RAEL, Revista Electrónica de Lingüística Aplicada, 19(2), 90–107.Google Scholar
Montero Pérez, M., Van Den Noortgate, W., & Desmet, P. (2013). Captioned video for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739. DOI logoGoogle Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eye-tracking study. System, 67, 77–86. DOI logoGoogle Scholar
Pattemore, A., & Muñoz, C. (2022). Captions and learnability factors in learning grammar from audio-visual input. JALT CALL, 18(1), 83–109. DOI logoGoogle Scholar
Peters, E., & Muñoz, C. (2020). Introduction to special issue of Language learning from multimodal input. Studies in Second Language Acquisition, 42(3), 489–497. DOI logoGoogle Scholar
Pujadas, G., & Muñoz, C. (2020). Examining adolescent EFL learners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, 42(3), 551–575. DOI logoGoogle Scholar
Qi, X., & Lai, C. (2017). The effects of deductive instruction and inductive instruction on learners’ development of pragmatic competence in the teaching of Chinese as a second language. System, 70, 26–37. DOI logoGoogle Scholar
Quick Placement Test. (2001). Paper and pen test. Oxford University Press.Google Scholar
Scotto, S. C. (2022). A pragmatics-first approach to faces. Topoi, 41(4), 641–657. DOI logoGoogle Scholar
Taguchi, N. (2015). Instructed pragmatics at a glance: Where instructional studies were, are, and should be going. Language Teaching, 48(1), 1–50. DOI logoGoogle Scholar
Usó-Juan, E., & Martínez-Flor, A. (2021). Fostering learners’ (meta)pragmatic awareness through film analysis. Language Value, 14(1), 85–111. DOI logoGoogle Scholar
(2022). Using audiovisual material to teach refusals from a discursive perspective: A research-based proposal. Complutense Journal of English Studies, 30, 53–66. DOI logoGoogle Scholar