Cover not available
Article published In:
Translation, Cognition & Behavior
Vol. 4:2 (2021) ► pp.305–330
thematic section

Effects of subtitle speed on proportional reading time

Re-analysing subtitle reading data with mixed effects models

ORCID logo | University of Warsaw
ORCID logo | University of Warsaw
ORCID logo | Aston University | University of the Free State

How much time do viewers spend reading subtitles and does it depend on the subtitle speed? By posing these questions, in this paper we re-analyse previous data to address this issue while promoting two methodological advancements in eye-tracking audiovisual research: (1) the use of proportional reading time (PRT) as a metric of time spent on subtitle reading and (2) the analysis of data via linear mixed models (LMMs). We tested 19 Polish L1 viewers with advanced English proficiency watching two clips with English soundtrack with Polish subtitles. First, we compared PRT at two different subtitle speeds: 12 characters per second (cps) and 20 cps. Then, we used actual subtitle speed rates to better understand the speed-PRT relationship. The results showed a significantly higher PRT for 20 cps compared to 12 cps, with the models predicting a PRT of 45.24% at 20 cps. We have also found strong evidence of the advantage of LMMs over more commonly used statistical techniques.

Keywords: subtitling, subtitle speed, eye tracking, proportional reading time, linear mixed effects models
Article outline
  • 1.Introduction
    • 1.1Subtitle speed
    • 1.2Measuring the reading time of subtitles
    • 1.3Overview of the current study
  • 2.Methods
    • 2.1Participants
    • 2.2Apparatus
    • 2.3Materials
    • 2.4Data processing and analysis
      • 2.4.1Subtitle selection
      • 2.4.2Variables and data analysis
  • 3.Results
    • 3.1Comparing PRT at 12 cps and 20 cps
    • 3.2Finding the relationship between Actual Speed and PRT
  • 4.Discussion
  • 5.Conclusions, limitations and future research avenues
  • Notes
  • References
Published online: 3 December 2021
DOI logo
https://doi.org/10.1075/tcb.00057.sza
References
Bates, Douglas, Reinhold Kliegl, Shravan Vasishth, and R. Harald Baayen
2018 Parsimonius Mixed Models.Google Scholar
Broda, Bartosz, Maciej Ogrodniczuk, Włodzimierz Gruszczyński, Bartłomiej Nitoń, Edyta Charzyńska, Łukasz Dębowski, and Milena Hadryan
2015 Jasnopis czyli Mierzenie zrozumiałości polskich tekstów użytkowych. SWPS Uniwersytet Humanistycznospołeczny.Google Scholar
Caffrey, Colm
2012 “Using an Eye–tracking Tool to Measure the Effects of Experimental Subtitling Procedures on Viewer Perception of Subtitled AV Content.” In Eye Tracking and Audiovisual Translation. Edited by Elisa Perego, 223–258. Rome: Aracne.Google Scholar
Christensen, Garret, Jeremy Freese, and Edward Miguel
2019 Transparent and Reproducible Social Science Research: How to do Open Science. Oakland, CA: University of California Press.Google Scholar
Conklin, Kathryn, Ana Pellicer Sánchez, and Gareth Carrol
2018 Eye-tracking: A Guide for Applied Linguistics Research. Cambridge, UK: Cambridge University Press. DOI logoGoogle Scholar
Cunnings, Ian, and Ian Finlayson
2015 “Mixed Effects Modeling and Longitudinal Data Analysis.” In Advancing Quantitative Methods in Second Language Research. Edited by Luke Plonsky, 159–181. New York, NY: Routledge. DOI logoGoogle Scholar
d’Ydewalle, Géry
1984 “Processing TV Information and Eye Movements Research.” Readings on Cognitive Ergonomics—Mind and Computers. Proceedings of the 2nd European Conference in Gmunden, Austria, September 10–14, 1984. Edited by Gerrit C. van der Veer, Michael J. Tauber, Thomas R. G. Green & Peter Gorny, 200–204. Berlin: Springer. DOI logoGoogle Scholar
d’Ydewalle, Gery, and Wim De Bruycker
2007 “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist 12 (3):196–205. DOI logoGoogle Scholar
d’Ydewalle, Gery, Patrick Muylle, and Johan van Rensbergen
1985 “Attention Shifts in Partially Redundant Information Situations.” In Eye Movements and Human Information Processing. Edited by R. Groner, G. W. McConkie and C. Menz, 375–384. Amsterdam: Elsevier.Google Scholar
d’Ydewalle, Gery, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
1991 “Watching Subtitled Television: Automatic reading behavior.” Communication Research 18 (5): 650–666. DOI logoGoogle Scholar
d’Ydewalle, Gery, Johan van Rensbergen, and Joris Pollet
1987 “Reading a Message When the Same Message is Available Auditorily in Another Language: The case of subtitling.” In Eye Movements: From Physiology to Cognition. Edited by J. K. O’Regan and A. Levy-Schoen, 313–321. Amsterdam/New York: Elsevier. DOI logoGoogle Scholar
Díaz Cintas, Jorge, and Aline Remael
2007 Audiovisual Translation: Subtitling. Manchester: St. Jerome.Google Scholar
Díaz Cintas, Jorge, and Aline Remael
2021 Subtitling: Concepts and Practices. London, UK: Routledge.Google Scholar
Field, Andy P.
2018 Discovering Statistics using IBM SPSS Statistics. 5th ed. Los Angeles: SAGE.Google Scholar
Fresno, Nazaret, and Katarzyna Sepielak
2020 “Subtitling Speed in Media Accessibility Research: Some methodological considerations.” Perspectives: 1–17. DOI logoGoogle Scholar
Garson, G. David
2020 Multilevel modelling: Applications in Stata, IBM SPSS, SAS, R & HLM. Los Angeles: Sage.Google Scholar
Heck, Ronald H., Scott Loring Thomas, and Lynn Naomi Tabata
2014 Multilevel and Longitudinal Modeling with IBM SPSS. New York: Routledge.Google Scholar
Ivarsson, Jan, and Mary Carroll
1998 Subtitling. Simrishamn: TransEdit HB.Google Scholar
Karamitroglou, Fotios
1998 “A Proposed Set of Subtitling Standards in Europe.” Translation Journal 2 (2).Google Scholar
Kim, Myungsup, Yangseon Kim, and Peter Schmidt
2007 “On the Accuracy of Bootstrap Confidence Intervals for Efficiency Levels in Stochastic Frontier Models with Panel Data.” Journal of Productivity Analysis 28 (3):165–181. DOI logoGoogle Scholar
Koolstra, Cees M., Tom H. A. Van Der Voort, and Gery d’Ydewalle
1999 “Lengthening the Presentation Time of Subtitles on Television: Effects on children’s reading time and recognition.” Communications 24 (4):407–422. DOI logoGoogle Scholar
Liao, Sixin, Lili Yu, Erik D. Reichle, and Jan-Louis Kruger
2020 “Using Eye Movements to Study the Reading of Subtitles in Video.” Scientific Studies of Reading: 1–19. DOI logoGoogle Scholar
Martí Ferriol, José Luis
2013 “Subtitle Reading Speeds in Different Languages: The case of Lethal Weapon.” Quaderns: Revista de traducció (20): 201–210.Google Scholar
Meteyard, Lotte, and Robert A. I. Davies
2020 “Best Practice Guidance for Linear Mixed-Effects Models in Psychological Science.” Journal of Memory and Language 1121. DOI logoGoogle Scholar
Moran, Siobhan
2009 “The Effect of Linguistic Variation on Subtitle Reception.” PhD dissertation, York University.
Muylaert, Willem, Johan Nootens, Daniel Poesmans, and A. K. Pugh
1983 “Design and Utilisation of Subtitles on Foreign Language Television Programmes.” In Theorie, Methoden and Modelle der Kontaktlinguistik. Edited by P. H. Nelde, 201–214. Bonn: Dummler.Google Scholar
Netflix
2016 Timed Text Style Guide: General Requirements.Google Scholar
Orero Clavero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero Fresco, Sara Rovira Esteva, Olga Soler Vilageliu, and Agnieszka Szarkowska
2018 “Conducting Experimental Research in Audiovisual Translation (AVT): A position paper.” JosTrans: The Journal of Specialised Translation 30 (2018): 105–126.Google Scholar
Orrego-Carmona, David
2015 “The Reception of (Non)professional Subtitling.” PhD dissertation, Department of English and German Studies, Universitat Rovira i Virgili.
2018 “From Old Tricks to Netflix: How Local are Interlingual Subtitling Norms for Streamed television?” Journal of Audiovisual Translation 1 (1): 81–100. DOI logoGoogle Scholar
Perego, Elisa, Fabio Del Missier, and Marta Stragà
2018 “Dubbing vs. Subtitling. Complexity matters.” Target 30 (1):137–157. DOI logoGoogle Scholar
Rayner, Keith
1998 “Eye Movements in Reading and Information Processing: 20 years of research.” Psychological Bulletin 124 (3): 372–422. DOI logoGoogle Scholar
Romero Fresco, Pablo
2009 “More Haste Less Speed: Edited versus verbatim respoken subtitles.” Vigo International Journal of Applied Linguistics 61: 109–133.Google Scholar
2015a “Final Thoughts: Viewing speed in subtitling.” In The Reception of Subtitles for the Deaf and Hard of Hearing in Europe. Edited by Pablo Romero Fresco, 335–341. Bern: Peter Lang.Google Scholar
2015b The Reception of Subtitles for the Deaf and Hard of Hearing in Europe: UK, Spain, Italy, Poland, Denmark, France and Germany. Bern: Peter Lang.Google Scholar
Silva, Breno B., Agnieszka Szarkowska, and David Orrego-Carmona
2021 “Dataset PRT Paper”. Figshare. Dataset. DOI logoGoogle Scholar
Szarkowska, Agnieszka
2016 Report on the Results of an Online Survey on Subtitle Presentation Times and Line Breaks in Interlingual Subtitling. Part 1: Subtitlers. University College London.Google Scholar
Szarkowska, Agnieszka, and Lidia Bogucka
2019 “Six-second Rule Revisited: An eye-tracking study on the impact of speech rate and language proficiency on subtitle reading.” Translation, Cognition & Behavior 2 (1):101–124. DOI logoGoogle Scholar
Szarkowska, Agnieszka, Jorge Díaz Cintas, and Olivia Gerber Morón
2020 “Quality is in the Eye of the Stakeholders: What do professional subtitlers and viewers think about subtitling?” Universal Access in the Information Society. DOI logoGoogle Scholar
Szarkowska, Agnieszka, and Olivia Gerber Morón
2018a SURE Project Dataset. RepOD.Google Scholar
2018b “Viewers Can Keep up with Fast Subtitles: Evidence from eye movements.” Plos One 13 (6). DOI logoGoogle Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
2011 “Verbatim, Standard, or Edited? Reading patterns of different captioning styles among deaf, hard of hearing, and hearing viewers.” American Annals of the Deaf 156 (4): 363–378. DOI logoGoogle Scholar
TED
2017 “English Style Guide” [URL]
Trezek, Beverly, and Connie Mayer
2019 “Reading and Deafness: State of the evidence and implications for research and practice.” Education Sciences 9 (3). DOI logoGoogle Scholar
Tveit, Jan Emil
2005 Translating for Television: A handbook in screen translation. Bergen: JK Publishing.Google Scholar
Zárate, Soledad
2021 Captioning and Subtitling for d/Deaf and Hard of Hearing Audiences. London: UCL Press.Google Scholar