Cover not available
Part of
Audiovisual Input and Second Language Learning
Edited by Carmen Muñoz and Imma Miralpeix
[Language Learning & Language Teaching 61] 2024
► pp. 126–149

Multimodal input and L2 pragmatics

An eye-tracking study

 | Universitat de Barcelona
 | Universitat de Barcelona
 | Universitat Jaume I
Analyzing the effects of multimodal input in the acquisition of second/foreign language (L2) pragmatics is a recent area in research. In this line, the use of eye-tracking to investigate L2 pragmatics remains limited (Godfroid, 2019). This study aimed to explore the effects of multimodal input on L2 requests among English as a Foreign Language (EFL) learners, while monitoring them with a webcam eye-tracker. The study used a multiple-choice discourse completion test at pre and posttest to evaluate the effects of viewing audio-visual material with or without captions. Additionally, a subset of participants was interviewed regarding pragmatic perception. Findings indicate that participants exposed to captioned videos performed better in the posttest and relied on captions when viewing, a result corroborated by retrospective interviews.
Article outline
  • 1.Introduction
  • 2.Review of the literature
  • 3.Methodology
    • 3.1Participants
    • 3.2Instruments
      • 3.2.1Selected scenes from the series Emily in Paris
      • 3.2.2Multiple-choice discourse completion test (MCDCT)
      • 3.2.3RealEye
      • 3.2.4Retrospective interviews
    • 3.3Data collection procedure
    • 3.4Data analysis
  • 4.Results
    • 4.1RQ1: What are the effects of captioned-video viewing on the learning of requests, as compared to non-captioned video viewing?
    • 4.2RQ2: Is there a difference in visual behavior when watching
      captioned and uncaptioned videos?
    • 4.3RQ3: What are learners’ perceptions of their pragmatic learning in relation to the presence of captions (or not) in the videos?
      • 4.3.1Captions group
      • 4.3.2No captions group
  • 5.Discussion
  • 6.Conclusion
  • Ethical considerations
  • Acknowledgements
  • References
  • Appendix
Published online: 26 September 2024
DOI logo
https://doi.org/10.1075/lllt.61.06bar
References (21)
References
Abrams, Z. I. (2014). Using film to provide a context for teaching L2 pragmatics. System, 46, 55–64. DOI logoGoogle Scholar
Alcón, E., & Pitarch, J. G. (2010). The effect of instruction on learners’ pragmatic awareness: A focus on refusals. International Journal of English Studies, 10(1), 65–80. DOI logoGoogle Scholar
Bardovi-Harlig, K. (2013). Developing L2 pragmatics. Language Learning, 63(1), 68–86. DOI logoGoogle Scholar
Barón, J., & Celaya, M. L. (2022). “May I do something for you?” The effects of audio-visual material (captioned and non-captioned) on EFL pragmatic learning. Special Issue: Teaching second language pragmatics in the current era of globalization. Language Teaching Research, 26(2), 238–255. DOI logoGoogle Scholar
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language use. Cambridge University Press. DOI logoGoogle Scholar
Bruti, S. (2016). Audiovisual texts and subtitling in the teaching of pragmatics. Trans-kom, 9(2), 186–207.Google Scholar
Celaya, M. L., Amengual, M., Martínez-Flor, A., & Barón, J. (2023). Using audio-visual material in Second Language Acquisition courses: An analysis for English Philology/English Studies. In L. J. Conejero Magro, C. Blanco García, L. Méndez Márquez, & J. Ruiz Morgan (Eds.), Bridging cultures. English and American studies in Spain (121–127). Universidad de Extremadura.Google Scholar
Derakhshan, A., & Eslami, Z. R. (2020). The effect of metapragmatic awareness, interactive translation, and discussion through video-enhanced input on EFL learners’ comprehension of implicature. Applied Research on English Language, 9(1), 637–664.Google Scholar
Finger-Bou, R., & Muñoz, C. (2023). The effects of regular and enhanced captions on incidental vocabulary acquisition. ELIA. Estudios de Lingüística Inglesa Aplicada,23, 15–50. DOI logoGoogle Scholar
Gesa, F., & Miralpeix, I. (2023). Extensive viewing as additional input for foreign language vocabulary learning: A longitudinal study in secondary school. Language Teaching Research. DOI logoGoogle Scholar
Godfroid, A. (2020). Eye-tracking in second language acquisition and bilingualism. A research synthesis and methodological guide. Routledge.Google Scholar
Khazdouzian, Y., Celaya, M. L., & Barón, J. (2021). When watching is not enough: The effects of captions on L2 pragmatics acquisition and awareness. RAEL, Revista Electrónica de Lingüística Aplicada, 19(2), 90–107.Google Scholar
Muñoz, C. (2017). The role of age and proficiency in subtitle reading. An eye-tracking study. System, 67, 77–86. DOI logoGoogle Scholar
Pattemore, A., & Muñoz, C. (2022). Captions and learnability factors in learning grammar from audio-visual input. JALT CALL, 18(1), 83–109. DOI logoGoogle Scholar
Peters, E., & Muñoz, C. (2020). Introduction to special issue of Language learning from multimodal input. Studies in Second Language Acquisition, 42(3), 489–497. DOI logoGoogle Scholar
Pujadas, G., & Muñoz, C. (2020). Examining adolescent EFL learners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, 42(3), 551–575. DOI logoGoogle Scholar
Qi, X., & Lai, C. (2017). The effects of deductive instruction and inductive instruction on learners’ development of pragmatic competence in the teaching of Chinese as a second language. System, 70, 26–37. DOI logoGoogle Scholar
Quick Placement Test. (2001). Paper and pen test. Oxford University Press.Google Scholar
Scotto, S. C. (2022). A pragmatics-first approach to faces. Topoi, 41(4), 641–657. DOI logoGoogle Scholar
Usó-Juan, E., & Martínez-Flor, A. (2021). Fostering learners’ (meta)pragmatic awareness through film analysis. Language Value, 14(1), 85–111. DOI logoGoogle Scholar
(2022). Using audiovisual material to teach refusals from a discursive perspective: A research-based proposal. Complutense Journal of English Studies, 30, 53–66. DOI logoGoogle Scholar