Usability tests for personalised subtitles
Over the past decade, subtitles have developed along with broadcast and broadband technology. Viewers nowadays enjoy new
opportunities to customize subtitles to best meet their personal preferences or needs. This study aims to identify end-user
subtitle setting preferences, to investigate whether these settings have an effect on content comprehension, and to explore
subtitle usability for two groups of participants, those under the age of 65 and those over 65. In an experiment, three subtitle
features were open to customization: the position, the box and the size of the subtitle, before and after participants watched an
on-demand TV documentary produced by the Catalan public broadcaster TVC. Results confirm a preference for bottom and medium
subtitles. Furthermore, while the under 65 segment made satisfactory use of the system, the over 65 segment experienced different
levels of usability and reported different capabilities and problems.
Article outline
- Introduction
- Media accessibility and usability
- Subtitle position and text size
- Objectives and methodology
- Participants, materials and procedure
- Results
- Discussion
- Conclusions
- Notes
-
References
References
References
AENOR (Asociación Española de Normalización y Certificación)
2012 Subtitulado para personas sordas y personas con discapacidad auditiva [Subtitling for the Deaf and Hard-of-Hearing People]. UNE 153010:2012. Madrid: AENOR.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Armstrong, Mike, Andy Brown, Michael Crabb, Chris J. Hughes, Rhianne Jones, and James Sandford
2015 Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape.
Research & Development White Paper WHP 307. British Broadcasting Corporation. Accessed September 18, 2017.
[URL].
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
Arnáiz-Uzquiza, Verónica
2008 “
La Objetividad en el Subtitulado. Justificación de los Parámetros Formales Mediante Eye Tracking.” In
ULISES y la comunidad sorda: Hacia el desarrollo de tecnologías comunicativas para la igualdad de oportunidades, edited by
Álvaro Pérez-Ugena, and
Ricardo Vizcaíno Laorga, 73–85. Madrid: Observatorio de las Realidades Sociales y de la Comunicación.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Baker, Robert G.
1981 Guidelines for the Subtitling of Television Programmes. A report from Southampton University for Independent Television (UK). Southampton (UK): Southampton University.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bartoll, Eduard, and Anjana Martínez-Tejerina
2010 “
The Positioning of Subtitles for the Deaf and Hard of Hearing.” In
Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by
Anna Matamala, and
Pilar Orero, 69–86. Bern: Peter Lang.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Bernard, Michael, Chia Hui Liao, and Melissa Mills
2001 “
The Effect of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” In
CHI EA ’01 Extended Abstracts on Human Factors in Computer Systems, 175–176. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Brooke, John
1996 “
SUS-A quick and dirty usability scale.” In
Usability Evaluation in Industry, edited by
Patrick W. Jordan,
Bruce Thomas,
Ian Lyall McClelland, and
Bernard A. Weerdmeester, 4–7. London: CRC Press,
[URL]
Brown, Andy, Rhianne Jones, and Michael Crabb
2015 “
Dynamic Subtitles: The User Experience.” In
TVX 15’ Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 103–112. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Carmichael, Alex
1999 Style Guide for the Design of Interactive Television Services for Elderly Viewers, Winchester: Independent Television Commission.
[URL]
Carroll, Mary, and Jan Ivarsson
1998 Subtitling. Simrishamn: TransEdit.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Costa-Montenegro, Enrique, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez
2016 “
SubTitleMe, Subtitles in Cinemas in Mobile Devices.”
Universal Access in the Information Society 15 (3): 461–472.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Crabb, Michael, Rhianne Jones, Michael Armstrong, and Chris J. Hughes
2015 “
Online News Videos: The UX of Subtitle Position.” In
ASSETS ’15 Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Czaja, Sara J., Neil Charness, Arthur D. Fisk, Christopher Hertzog, Sankaran N. Nair, Wendy A. Rogers, and Joseph Sharit
2006 “
Factors Predicting the Use of Technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE).”
Psychology and Aging 21 (2): 333–352.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
d’Ydewalle, Géry, and Ingrid Gielen
1992 “
Attention Allocation with Overlapping Sound, Image, and Text.” In
Eye Movements and Visual Cognition, edited by
Keith Rayner, Springer Series in Neuropsychology, 415–527. New York: Springer.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
1991 “
Watching Subtitled Television. Automatic Reading Behaviour.”
Communication Research 18 (5): 650–666.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet
1987 “
Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In
Eye Movements From Physiology to Cognition: Selected/Edited Proceedings of the Third European Conference on Eye Movements, Dourdan, France, September 1985, edited by
J. K. O’Regan, and
A. Levy-Schoen, 313–321. Amsterdam: Elsevier Science Publishers.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
De Bruycker, Wim, and Géry d’Ydewalle
2003 “
Chapter 31. Reading Native and Foreign Language Television Subtitles in Children and Adults.” In
The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, edited by
Jukka Hyöna,
Ralph Radach, and
H. Deubel, 671–684. Amsterdam: Elsevier Science BV.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
de Linde, Zoé, and Neil Kay
1999 The Semiotics of Subtitling. Manchester: St. Jerome Publishing.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
DTV4All (Digital Television for All)
2010 European Research Project.
[URL]
Dykstra, Dean Julian
1993 A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. Texas: A&M University.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gottlieb, Henrik
1998 “
Subtitles, Translation and Idioms.” PhD Thesis, University of Copenhagen.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gottlieb, Henrik
2005 “
Multidimensional Translation: Semantics turned Semiotics.” In
MuTra 2005: Challenges of Multidimensional Translation: Conference Proceedings, edited by
Sandra Nauert, and
Heidrun Gerzymisch-Arbogast, EU-High-Level Scientific Conference Series, 33–61,
[URL]
Greco, Gian Maria
2016 “
On Accessibility as a Human Right, with an application to Media Accessibility.” In
Researching Audio Description, edited by
Anna Matamala, and
Pilar Orero,
Palgrave Studies in Translating and Interpreting Series, 11–13. London: Palgrave Macmillan.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gulliver, Stephen, and Ghinea, George
2003 “
How Level and Type of Deafness Affect User Perception of Multimedia Video Clips.”
Universal Access in the Information Society 2 (4): 374–386.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
HBB4ALL (Hybrid Broadcast Broadband For ALL)
2017 European Research Project.
[URL]
Holken, Hamut, and Pilar Orero
2014 “
TV Content Delivery to PC, Tablet, Smartphone: From the Accessibility Vision into Market Reality.”
ThinkMind Mobility 2014: The Fourth International Conference on Mobile Services, Resources, and Users, 99–104,
[URL]
Hughes, Chris J., Mike Armstrong, Rhianne Jones, and Michael Crabb
2015 “
Responsive Design for Personalised Subtitles.” In
W4A ’15 Proceedings of the 12th Web for All Conference, 81. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
ISO (International Organization for Standardization)
2017 Information Technology – User Interface Component Accessibility – Part 23: Guidance on the Visual Presentation of Audio Information (including Captions and Subtitles).
ISO/IEC 20071-23. Paris: ISO.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Karamitroglou, Fotios
1997 “
A Proposed Set of Subtitling Standards in Europe.”
Translation Journal 2 (2),
[URL]
Kirkland, C. Eric
1999 “
Evaluation of Captioning Features to Inform Development of Digital Television Captioning Capabilities.”
American Annals of the Deaf 144 (3): 250–260.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Koolstra, Cees M., and Jonannes W. J. Beentjes
1999 “
Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home.”
Education Technology Research and Development 47 (1): 51–60.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Koolstra, Cees M., Tom H. A. van der Voort, and Leo J. Th. van der Kamp
1997 “
Television’s Impact on Children’s Reading Comprehension and Decoding Skills: A 3-Year Panel Study.”
Reading Research Quarterly 32 (2): 128–152.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz
2015 “
Subtitles on the Moving Image: An Overview of Eye Tracking Studies.”
Refractory: A Journal of Entertainment Media 251: 1–14.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Montagud, Mario, Fernando Boronat, Juan González, and Javier Pastor
2017 “
Web-Based Platform for Subtitles Customization and Synchronization in Multi-Screen Scenarios.” In
TVX ’17 Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 81–82. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nathan, John G., Daniel R. Anderson, and Diane E. Field
1984 “
Television Viewing at Home: Distances and Visual Angles Adopted by Children and Adults.” In
Proceedings of the Human Factors and Ergonomics Society Annual Meeting 28 (11): 978–982.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nettelbeck, Ted, and Nicholas R. Burns
2010 “
Processing Speed, Working Memory and Reasoning Ability from Childhood to Old Age.”
Personality and Individual Differences 48 (4): 379–384.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Neves, Josélia
2007 “
‘There is Research and Research’: Subtitling for the Deaf and Hard of Hearing (SDH).” In
Traducción y Accesibilidad. Subtitulación para Sordos y Audiodescripción para Ciegos. Nuevas Modalidades de Traducción Audiovisual, edited by
Catalina Jiménez Hurtado,
Studien zur romanischen Sprachwissenschaft und interkulturellen Kommunikation Series, 27–40. Frankfurt am Main: Peter Lang.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nielsen, Jakob, and Rolf Molich
1990 “
Heuristic Evaluation of User Interfaces.” In
CHI ’90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 249–256. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Noland, Katy C., and Louise H. Truong
2015 A Survey of UK Television Viewing Conditions.
BBC R&D White Paper WHP 287. British Broadcasting Corporation.
[URL]
Orero, Pilar, John Birch, and Andrew Lambourne
2014 “
Media accessibility in HBBTV: Interaction for All.”
IET Conference Proceedings 11–15 Sept. 2014
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
2018 “
Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.”
JosTrans: The Journal of Specialised Translation 301: 105–126,
[URL]
Orero, Pilar, Javier Serrano, Olga Soler, Anna Matamala, Judit Castella, Maria Teresa Soto Sanfiel, Anna Vilaró, and Carme Mangiron
2014 “
Accessibility to Digital Society: Interaction for All.”
ICDS 2014. The Eighth International Conference on Digital Society, 188–191.
[URL]
Orero, Pilar, and Irene Tor-Carroggio
2018 “
User Requirements when Designing Learning e-Content: Interaction for All.” In
Designing for the User Experience in Learning Systems, edited by
Evangelos Kapros, and
Maria Koutsombogera. Berlin: Springer.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi
2010 “
The Cognitive Effectiveness of Subtitle Processing.”
Media Psychology 13 (3): 243–272.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rayner, Keith
1998 “
Eye Movements in Reading and Information Processing: Twenty Years of Research.”
Psychological Bulletin 1241: 372–422.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Reder, Stephen, and John Bynner
(eds) 2009 Tracking Adult Literacy and Numeracy Skills: Findings from Longitudinal Research. New York and London: Routledge.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Reuter-Lorenz, Patricia A., and Denise C. Park
2014 “
How Does it STAC Up? Revisiting the Scaffolding Theory of Aging and Cognition.”
Neuropsychology Review 24 (3): 355–370.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Robson, Gary D.
2004 The Closed Captioning Handbook. Amsterdam and London: Focal Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Romero-Fresco, Pablo
2009 “
More Haste Less Speed: Edited versus Verbatim Respoken Subtitles.”
VIAL: Vigo International Journal of Applied Linguistics 61: 109–133,
[URL]
Romero-Fresco, Pablo
2011 Subtitling through Speech Recognition: Respeaking. Manchester: Routledge.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rudd, Rima E.
2007 “
Health Literacy Skills of U.S. Adults.”
American Journal of Health Behavior 311 (
Suppl 1): S8–S18.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sauro, Jeff
2011 “
Measuring Usability with the System Usability Scale (SUS).” In
Measuring U.
[URL]
Sauro, Jeff, and James R. Lewis
2016 “
Chapter 8. Standardized Usability Questionnaires.” In
Quantifying the User Experience, edited by
Jeff Sauro and
James R. Lewis, 185–240. Amsterdam: Elsevier.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sears, Andrew, and Vicki Hanson
2011 “
Representing Users in Accessibility Research.” In
CHI ’11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2235–2238. New York: ACM Press.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sinclair II Robert, E., Gilma Annuska Perkins, Michael Edward Dulac Winser, Ramkumar Subramanian, and Paul Reid
2009 Personalization of User Accessibility Options. U.S. Patent No. US7554522B2,
[URL]
Springett, Mark, Mark Rice, and Richard Griffiths
2011 “
Towards Inclusive Digital Television.”
Universal Access in the Information Society 121: 1–3.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
2011 “
Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.”
American Annals of the Deaf 156 (4): 363–378.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Szarkowska, Agnieszka, Izabela Krejtz, Olga Pilipczuk, Łukasz Dutka, and Jan-Louis Kruger
2016 “
The Effects of Text Editing and Subtitle Presentation Rate on the Comprehension and Reading Patterns of Interlingual and Intralingual Subtitles among Deaf, Hard of Hearing and Hearing Viewers.”
Across Languages and Cultures 17 (2): 183–204.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Utray, Francisco, Ana Maria Pereira, and Pilar Orero
2009 “
The Present and Future of Audio Description and Subtitling for the Deaf and Hard of Hearing in Spain.”
Meta 54 (2): 248–263.
![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Utray, Francisco, Belén Ruiz, and José Antonio Moreiro
2010 “
Maximum Font Size for Subtitles in Standard Definition Digital Television: Tests for a Font Magnifying Application.” In
Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by
Anna Matamala, and
Pilar Orero, 59–68. Bern: Peter Lang.
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cited by
Cited by 3 other publications
Abdel Latif, Muhammad M. M.
2020.
Translation and Interpreting Assessment Research. In
Translator and Interpreter Education Research [
New Frontiers in Translation Studies, ],
► pp. 61 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Gorman, Benjamin M., Michael Crabb & Michael Armstrong
2021.
Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
Qiu, Lijian, Wenzheng Zhao & Xuezhi Liu
2022.
Does subtitle size in teaching video influence learning outcomes?.
Multimedia Tools and Applications 81:30
► pp. 43253 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 18 june 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.