Cover not available
Article published In:
Translation, Cognition & Behavior
Vol. 4:2 (2021) ► pp.305–330
thematic section

Effects of subtitle speed on proportional reading time

Re-analysing subtitle reading data with mixed effects models

ORCID logo | University of Warsaw
ORCID logo | University of Warsaw
ORCID logo | Aston University | University of the Free State
How much time do viewers spend reading subtitles and does it depend on the subtitle speed? By posing these questions, in this paper we re-analyse previous data to address this issue while promoting two methodological advancements in eye-tracking audiovisual research: (1) the use of proportional reading time (PRT) as a metric of time spent on subtitle reading and (2) the analysis of data via linear mixed models (LMMs). We tested 19 Polish L1 viewers with advanced English proficiency watching two clips with English soundtrack with Polish subtitles. First, we compared PRT at two different subtitle speeds: 12 characters per second (cps) and 20 cps. Then, we used actual subtitle speed rates to better understand the speed-PRT relationship. The results showed a significantly higher PRT for 20 cps compared to 12 cps, with the models predicting a PRT of 45.24% at 20 cps. We have also found strong evidence of the advantage of LMMs over more commonly used statistical techniques.
Keywords: subtitling, subtitle speed, eye tracking, proportional reading time, linear mixed effects models
Article outline
  • 1.Introduction
    • 1.1Subtitle speed
    • 1.2Measuring the reading time of subtitles
    • 1.3Overview of the current study
  • 2.Methods
    • 2.1Participants
    • 2.2Apparatus
    • 2.3Materials
    • 2.4Data processing and analysis
      • 2.4.1Subtitle selection
      • 2.4.2Variables and data analysis
  • 3.Results
    • 3.1Comparing PRT at 12 cps and 20 cps
    • 3.2Finding the relationship between Actual Speed and PRT
  • 4.Discussion
  • 5.Conclusions, limitations and future research avenues
  • Notes
  • References
Published online: 3 December 2021
DOI logo
https://doi.org/10.1075/tcb.00057.sza
References (47)
References
Bates, Douglas, Reinhold Kliegl, Shravan Vasishth, and R. Harald Baayen. 2018. Parsimonius Mixed Models.Google Scholar
Broda, Bartosz, Maciej Ogrodniczuk, Włodzimierz Gruszczyński, Bartłomiej Nitoń, Edyta Charzyńska, Łukasz Dębowski, and Milena Hadryan. 2015. Jasnopis czyli Mierzenie zrozumiałości polskich tekstów użytkowych. SWPS Uniwersytet Humanistycznospołeczny.Google Scholar
Caffrey, Colm. 2012. “Using an Eye–tracking Tool to Measure the Effects of Experimental Subtitling Procedures on Viewer Perception of Subtitled AV Content.” In Eye Tracking and Audiovisual Translation. Edited by Elisa Perego, 223–258. Rome: Aracne.Google Scholar
Christensen, Garret, Jeremy Freese, and Edward Miguel. 2019. Transparent and Reproducible Social Science Research: How to do Open Science. Oakland, CA: University of California Press.Google Scholar
Conklin, Kathryn, Ana Pellicer Sánchez, and Gareth Carrol. 2018. Eye-tracking: A Guide for Applied Linguistics Research. Cambridge, UK: Cambridge University Press. DOI logoGoogle Scholar
Cunnings, Ian, and Ian Finlayson. 2015. “Mixed Effects Modeling and Longitudinal Data Analysis.” In Advancing Quantitative Methods in Second Language Research. Edited by Luke Plonsky, 159–181. New York, NY: Routledge. DOI logoGoogle Scholar
d’Ydewalle, Géry. 1984. “Processing TV Information and Eye Movements Research.” Readings on Cognitive Ergonomics—Mind and Computers. Proceedings of the 2nd European Conference in Gmunden, Austria, September 10–14, 1984. Edited by Gerrit C. van der Veer, Michael J. Tauber, Thomas R. G. Green & Peter Gorny, 200–204. Berlin: Springer. DOI logoGoogle Scholar
d’Ydewalle, Gery, and Wim De Bruycker. 2007. “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist 12 (3):196–205. DOI logoGoogle Scholar
d’Ydewalle, Gery, Patrick Muylle, and Johan van Rensbergen. 1985. “Attention Shifts in Partially Redundant Information Situations.” In Eye Movements and Human Information Processing. Edited by R. Groner, G. W. McConkie and C. Menz, 375–384. Amsterdam: Elsevier.Google Scholar
d’Ydewalle, Gery, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen. 1991. “Watching Subtitled Television: Automatic reading behavior.” Communication Research 18 (5): 650–666. DOI logoGoogle Scholar
d’Ydewalle, Gery, Johan van Rensbergen, and Joris Pollet. 1987. “Reading a Message When the Same Message is Available Auditorily in Another Language: The case of subtitling.” In Eye Movements: From Physiology to Cognition. Edited by J. K. O’Regan and A. Levy-Schoen, 313–321. Amsterdam/New York: Elsevier. DOI logoGoogle Scholar
Díaz Cintas, Jorge, and Aline Remael. 2007. Audiovisual Translation: Subtitling. Manchester: St. Jerome.Google Scholar
Díaz Cintas, Jorge, and Aline Remael. 2021. Subtitling: Concepts and Practices. London, UK: Routledge.Google Scholar
Field, Andy P. 2018. Discovering Statistics using IBM SPSS Statistics. 5th ed. Los Angeles: SAGE.Google Scholar
Fresno, Nazaret, and Katarzyna Sepielak. 2020. “Subtitling Speed in Media Accessibility Research: Some methodological considerations.” Perspectives: 1–17. DOI logoGoogle Scholar
Garson, G. David. 2020. Multilevel modelling: Applications in Stata, IBM SPSS, SAS, R & HLM. Los Angeles: Sage.Google Scholar
Heck, Ronald H., Scott Loring Thomas, and Lynn Naomi Tabata. 2014. Multilevel and Longitudinal Modeling with IBM SPSS. New York: Routledge.Google Scholar
Ivarsson, Jan, and Mary Carroll. 1998. Subtitling. Simrishamn: TransEdit HB.Google Scholar
Karamitroglou, Fotios. 1998. “A Proposed Set of Subtitling Standards in Europe.” Translation Journal 2 (2).Google Scholar
Kim, Myungsup, Yangseon Kim, and Peter Schmidt. 2007. “On the Accuracy of Bootstrap Confidence Intervals for Efficiency Levels in Stochastic Frontier Models with Panel Data.” Journal of Productivity Analysis 28 (3):165–181. DOI logoGoogle Scholar
Koolstra, Cees M., Tom H. A. Van Der Voort, and Gery d’Ydewalle. 1999. “Lengthening the Presentation Time of Subtitles on Television: Effects on children’s reading time and recognition.” Communications 24 (4):407–422. DOI logoGoogle Scholar
Liao, Sixin, Lili Yu, Erik D. Reichle, and Jan-Louis Kruger. 2020. “Using Eye Movements to Study the Reading of Subtitles in Video.” Scientific Studies of Reading: 1–19. DOI logoGoogle Scholar
Martí Ferriol, José Luis. 2013. “Subtitle Reading Speeds in Different Languages: The case of Lethal Weapon.” Quaderns: Revista de traducció (20): 201–210.Google Scholar
Meteyard, Lotte, and Robert A. I. Davies. 2020. “Best Practice Guidance for Linear Mixed-Effects Models in Psychological Science.” Journal of Memory and Language 1121. DOI logoGoogle Scholar
Moran, Siobhan. 2009. “The Effect of Linguistic Variation on Subtitle Reception.” PhD dissertation, York University.
Muylaert, Willem, Johan Nootens, Daniel Poesmans, and A. K. Pugh. 1983. “Design and Utilisation of Subtitles on Foreign Language Television Programmes.” In Theorie, Methoden and Modelle der Kontaktlinguistik. Edited by P. H. Nelde, 201–214. Bonn: Dummler.Google Scholar
Netflix. 2016. Timed Text Style Guide: General Requirements.Google Scholar
Orero Clavero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero Fresco, Sara Rovira Esteva, Olga Soler Vilageliu, and Agnieszka Szarkowska. 2018. “Conducting Experimental Research in Audiovisual Translation (AVT): A position paper.” JosTrans: The Journal of Specialised Translation 30 (2018): 105–126.Google Scholar
Orrego-Carmona, David. 2015. “The Reception of (Non)professional Subtitling.” PhD dissertation, Department of English and German Studies, Universitat Rovira i Virgili.
. 2018. “From Old Tricks to Netflix: How Local are Interlingual Subtitling Norms for Streamed television?” Journal of Audiovisual Translation 1 (1): 81–100. DOI logoGoogle Scholar
Perego, Elisa, Fabio Del Missier, and Marta Stragà. 2018. “Dubbing vs. Subtitling. Complexity matters.” Target 30 (1):137–157. DOI logoGoogle Scholar
Rayner, Keith. 1998. “Eye Movements in Reading and Information Processing: 20 years of research.” Psychological Bulletin 124 (3): 372–422. DOI logoGoogle Scholar
Romero Fresco, Pablo. 2009. “More Haste Less Speed: Edited versus verbatim respoken subtitles.” Vigo International Journal of Applied Linguistics 61: 109–133.Google Scholar
. 2015a. “Final Thoughts: Viewing speed in subtitling.” In The Reception of Subtitles for the Deaf and Hard of Hearing in Europe. Edited by Pablo Romero Fresco, 335–341. Bern: Peter Lang.Google Scholar
. 2015b. The Reception of Subtitles for the Deaf and Hard of Hearing in Europe: UK, Spain, Italy, Poland, Denmark, France and Germany. Bern: Peter Lang.Google Scholar
Silva, Breno B., Agnieszka Szarkowska, and David Orrego-Carmona. 2021. “Dataset PRT Paper”. Figshare. Dataset. DOI logoGoogle Scholar
Szarkowska, Agnieszka. 2016. Report on the Results of an Online Survey on Subtitle Presentation Times and Line Breaks in Interlingual Subtitling. Part 1: Subtitlers. University College London.Google Scholar
Szarkowska, Agnieszka, and Lidia Bogucka. 2019. “Six-second Rule Revisited: An eye-tracking study on the impact of speech rate and language proficiency on subtitle reading.” Translation, Cognition & Behavior 2 (1):101–124. DOI logoGoogle Scholar
Szarkowska, Agnieszka, Jorge Díaz Cintas, and Olivia Gerber Morón. 2020. “Quality is in the Eye of the Stakeholders: What do professional subtitlers and viewers think about subtitling?” Universal Access in the Information Society. DOI logoGoogle Scholar
Szarkowska, Agnieszka, and Olivia Gerber Morón. 2018a. SURE Project Dataset. RepOD.Google Scholar
. 2018b. “Viewers Can Keep up with Fast Subtitles: Evidence from eye movements.” Plos One 13 (6). DOI logoGoogle Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek. 2011. “Verbatim, Standard, or Edited? Reading patterns of different captioning styles among deaf, hard of hearing, and hearing viewers.” American Annals of the Deaf 156 (4): 363–378. DOI logoGoogle Scholar
TED. 2017. “English Style Guide” [URL]
Trezek, Beverly, and Connie Mayer. 2019. “Reading and Deafness: State of the evidence and implications for research and practice.” Education Sciences 9 (3). DOI logoGoogle Scholar
Tveit, Jan Emil. 2005. Translating for Television: A handbook in screen translation. Bergen: JK Publishing.Google Scholar
Zárate, Soledad. 2021. Captioning and Subtitling for d/Deaf and Hard of Hearing Audiences. London: UCL Press.Google Scholar
Cited by (3)

Cited by three other publications

Arroyo Chavez, Mariana, Molly Feanny, Matthew Seita, Bernard Thompson, Keith Delk, Skyler Officer, Abraham Glasser, Raja Kushalnagar & Christian Vogler
2024. Proceedings of the CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff. DOI logo
Kruger, Jan-Louis & Sixin Liao
2022. Establishing a theoretical framework for AVT research. Translation Spaces 11:1 ► pp. 12 ff. DOI logo
Silva, Breno B., David Orrego-Carmona & Agnieszka Szarkowska
2022. Using linear mixed models to analyze data from eye-tracking research on subtitling. Translation Spaces 11:1 ► pp. 60 ff. DOI logo

This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.