thematic section
Effects of subtitle speed on proportional reading time
Re-analysing subtitle reading data with mixed effects models
How much time do viewers spend reading subtitles and does it depend on the subtitle speed? By posing these
questions, in this paper we re-analyse previous data to address this issue while promoting two methodological advancements in
eye-tracking audiovisual research: (1) the use of proportional reading time (PRT) as a metric of time spent on subtitle reading
and (2) the analysis of data via linear mixed models (LMMs). We tested 19 Polish L1 viewers with advanced English
proficiency watching two clips with English soundtrack with Polish subtitles. First, we compared PRT at two different subtitle
speeds: 12 characters per second (cps) and 20 cps. Then, we used actual subtitle speed rates to better understand the speed-PRT
relationship. The results showed a significantly higher PRT for 20 cps compared to 12 cps, with the models predicting a PRT of
45.24% at 20 cps. We have also found strong evidence of the advantage of LMMs over more commonly used statistical techniques.
Article outline
- 1.Introduction
- 1.1Subtitle speed
- 1.2Measuring the reading time of subtitles
- 1.3Overview of the current study
- 2.Methods
- 2.1Participants
- 2.2Apparatus
- 2.3Materials
- 2.4Data processing and analysis
- 2.4.1Subtitle selection
- 2.4.2Variables and data analysis
- 3.Results
- 3.1Comparing PRT at 12 cps and 20 cps
- 3.2Finding the relationship between Actual Speed and PRT
- 4.Discussion
- 5.Conclusions, limitations and future research avenues
- Notes
-
References
References (47)
Bates, Douglas, Reinhold Kliegl, Shravan Vasishth, and R. Harald Baayen
2018 Parsimonius
Mixed Models.
Broda, Bartosz, Maciej Ogrodniczuk, Włodzimierz Gruszczyński, Bartłomiej Nitoń, Edyta Charzyńska, Łukasz Dębowski, and Milena Hadryan
2015 Jasnopis
czyli Mierzenie zrozumiałości polskich tekstów użytkowych. SWPS Uniwersytet Humanistycznospołeczny.
Caffrey, Colm
2012 “
Using
an Eye–tracking Tool to Measure the Effects of Experimental Subtitling Procedures on Viewer Perception of Subtitled AV
Content.” In
Eye Tracking and Audiovisual
Translation. Edited by
Elisa Perego, 223–258. Rome: Aracne.
Christensen, Garret, Jeremy Freese, and Edward Miguel
2019 Transparent
and Reproducible Social Science Research: How to do Open Science. Oakland, CA: University of California Press.
Conklin, Kathryn, Ana Pellicer Sánchez, and Gareth Carrol
2018 Eye-tracking:
A Guide for Applied Linguistics Research. Cambridge, UK: Cambridge University Press.
Cunnings, Ian, and Ian Finlayson
2015 “
Mixed
Effects Modeling and Longitudinal Data Analysis.” In
Advancing
Quantitative Methods in Second Language Research. Edited by
Luke Plonsky, 159–181. New York, NY: Routledge.
d’Ydewalle, Géry
1984 “
Processing
TV Information and Eye Movements Research.”
Readings on Cognitive Ergonomics—Mind and
Computers. Proceedings of the 2nd European Conference in Gmunden, Austria, September 10–14, 1984. Edited by
Gerrit C. van der Veer,
Michael J. Tauber,
Thomas R. G. Green &
Peter Gorny, 200–204. Berlin: Springer.
d’Ydewalle, Gery, and Wim De Bruycker
2007 “
Eye
Movements of Children and Adults while Reading Television Subtitles.”
European
Psychologist 12 (3):196–205.
d’Ydewalle, Gery, Patrick Muylle, and Johan van Rensbergen
1985 “
Attention
Shifts in Partially Redundant Information Situations.” In
Eye
Movements and Human Information Processing. Edited by
R. Groner,
G. W. McConkie and
C. Menz, 375–384. Amsterdam: Elsevier.
d’Ydewalle, Gery, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
1991 “
Watching
Subtitled Television: Automatic reading behavior.”
Communication
Research 18 (5): 650–666.
d’Ydewalle, Gery, Johan van Rensbergen, and Joris Pollet
1987 “
Reading
a Message When the Same Message is Available Auditorily in Another Language: The case of
subtitling.” In
Eye Movements: From Physiology to
Cognition. Edited by
J. K. O’Regan and
A. Levy-Schoen, 313–321. Amsterdam/New York: Elsevier.
Díaz Cintas, Jorge, and Aline Remael
2007 Audiovisual
Translation: Subtitling. Manchester: St. Jerome.
Díaz Cintas, Jorge, and Aline Remael
2021 Subtitling:
Concepts and Practices. London, UK: Routledge.
Field, Andy P.
2018 Discovering Statistics using IBM SPSS
Statistics. 5th ed. Los Angeles: SAGE.
Fresno, Nazaret, and Katarzyna Sepielak
2020 “
Subtitling
Speed in Media Accessibility Research: Some methodological
considerations.”
Perspectives: 1–17.
Garson, G. David
2020 Multilevel modelling: Applications
in Stata, IBM SPSS, SAS, R & HLM. Los Angeles: Sage.
Heck, Ronald H., Scott Loring Thomas, and Lynn Naomi Tabata
2014 Multilevel
and Longitudinal Modeling with IBM SPSS. New York: Routledge.
Ivarsson, Jan, and Mary Carroll
1998 Subtitling. Simrishamn: TransEdit HB.
Karamitroglou, Fotios
1998 “
A
Proposed Set of Subtitling Standards in Europe.”
Translation
Journal 2 (2).
Kim, Myungsup, Yangseon Kim, and Peter Schmidt
2007 “
On
the Accuracy of Bootstrap Confidence Intervals for Efficiency Levels in Stochastic Frontier Models with Panel
Data.”
Journal of Productivity
Analysis 28 (3):165–181.
Koolstra, Cees M., Tom H. A. Van Der Voort, and Gery d’Ydewalle
1999 “
Lengthening
the Presentation Time of Subtitles on Television: Effects on children’s reading time and
recognition.”
Communications 24 (4):407–422.
Liao, Sixin, Lili Yu, Erik D. Reichle, and Jan-Louis Kruger
2020 “
Using
Eye Movements to Study the Reading of Subtitles in Video.”
Scientific Studies of
Reading: 1–19.
Martí Ferriol, José Luis
2013 “
Subtitle
Reading Speeds in Different Languages: The case of Lethal Weapon.”
Quaderns: Revista de
traducció (20): 201–210.
Meteyard, Lotte, and Robert A. I. Davies
2020 “
Best
Practice Guidance for Linear Mixed-Effects Models in Psychological Science.”
Journal of Memory
and Language 1121.
Moran, Siobhan
2009 “
The
Effect of Linguistic Variation on Subtitle
Reception.” PhD dissertation, York University.
Muylaert, Willem, Johan Nootens, Daniel Poesmans, and A. K. Pugh
1983 “
Design
and Utilisation of Subtitles on Foreign Language Television
Programmes.” In
Theorie, Methoden and Modelle der
Kontaktlinguistik. Edited by
P. H. Nelde, 201–214. Bonn: Dummler.
Netflix
2016 Timed Text Style
Guide: General Requirements.
Orero Clavero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero Fresco, Sara Rovira Esteva, Olga Soler Vilageliu, and Agnieszka Szarkowska
2018 “
Conducting
Experimental Research in Audiovisual Translation (AVT): A position paper.”
JosTrans: The
Journal of Specialised
Translation 30 (2018): 105–126.
Orrego-Carmona, David
2015 “
The
Reception of (Non)professional Subtitling.” PhD dissertation, Department of English and German Studies, Universitat Rovira i Virgili.
Pedersen, Jan
2018 “
From
Old Tricks to Netflix: How Local are Interlingual Subtitling Norms for Streamed
television?”
Journal of Audiovisual
Translation 1 (1): 81–100.
Perego, Elisa, Fabio Del Missier, and Marta Stragà
Rayner, Keith
1998 “
Eye
Movements in Reading and Information Processing: 20 years of research.”
Psychological
Bulletin 124 (3): 372–422.
Romero Fresco, Pablo
2009 “
More
Haste Less Speed: Edited versus verbatim respoken subtitles.”
Vigo International Journal of
Applied
Linguistics 61: 109–133.
Romero Fresco, Pablo
2015a “
Final
Thoughts: Viewing speed in subtitling.” In
The Reception of Subtitles
for the Deaf and Hard of Hearing in Europe. Edited by
Pablo Romero Fresco, 335–341. Bern: Peter Lang.
Romero Fresco, Pablo
2015b The
Reception of Subtitles for the Deaf and Hard of Hearing in Europe: UK, Spain, Italy, Poland, Denmark, France and
Germany. Bern: Peter Lang.
Silva, Breno B., Agnieszka Szarkowska, and David Orrego-Carmona
2021 “
Dataset
PRT Paper”. Figshare. Dataset.
Szarkowska, Agnieszka
2016 Report
on the Results of an Online Survey on Subtitle Presentation Times and Line Breaks in Interlingual
Subtitling. Part 1: Subtitlers. University College London.
Szarkowska, Agnieszka, and Lidia Bogucka
Szarkowska, Agnieszka, Jorge Díaz Cintas, and Olivia Gerber Morón
2020 “
Quality
is in the Eye of the Stakeholders: What do professional subtitlers and viewers think about
subtitling?”
Universal Access in the Information Society.
Szarkowska, Agnieszka, and Olivia Gerber Morón
2018a SURE
Project Dataset. RepOD.
Szarkowska, Agnieszka, and Olivia Gerber Morón
2018b “
Viewers
Can Keep up with Fast Subtitles: Evidence from eye movements.”
Plos
One 13 (6).
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
2011 “
Verbatim,
Standard, or Edited? Reading patterns of different captioning styles among deaf, hard of hearing, and hearing
viewers.”
American Annals of the
Deaf 156 (4): 363–378.
TED
2017 “
English Style
Guide”
[URL]
Trezek, Beverly, and Connie Mayer
2019 “
Reading
and Deafness: State of the evidence and implications for research and practice.”
Education
Sciences 9 (3).
Tveit, Jan Emil
2005 Translating for Television: A
handbook in screen translation. Bergen: JK Publishing.
Zárate, Soledad
2021 Captioning
and Subtitling for d/Deaf and Hard of Hearing
Audiences. London: UCL Press.
Cited by (3)
Cited by 3 other publications
Arroyo Chavez, Mariana, Molly Feanny, Matthew Seita, Bernard Thompson, Keith Delk, Skyler Officer, Abraham Glasser, Raja Kushalnagar & Christian Vogler
2024.
Proceedings of the CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.
Kruger, Jan-Louis & Sixin Liao
Silva, Breno B., David Orrego-Carmona & Agnieszka Szarkowska
This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.