Article published In:
Translation SpacesVol. 7:2 (2018) ► pp.263–284
Usability tests for personalised subtitles
Over the past decade, subtitles have developed along with broadcast and broadband technology. Viewers nowadays enjoy new opportunities to customize subtitles to best meet their personal preferences or needs. This study aims to identify end-user subtitle setting preferences, to investigate whether these settings have an effect on content comprehension, and to explore subtitle usability for two groups of participants, those under the age of 65 and those over 65. In an experiment, three subtitle features were open to customization: the position, the box and the size of the subtitle, before and after participants watched an on-demand TV documentary produced by the Catalan public broadcaster TVC. Results confirm a preference for bottom and medium subtitles. Furthermore, while the under 65 segment made satisfactory use of the system, the over 65 segment experienced different levels of usability and reported different capabilities and problems.
Keywords: subtitles, customization, user-centric design, accessibility, convergence, usability
Article outline
- Introduction
- Media accessibility and usability
- Subtitle position and text size
- Objectives and methodology
- Participants, materials and procedure
- Results
- Discussion
- Conclusions
- Notes
-
References
References
References
AENOR (Asociación Española de Normalización y Certificación)
2012 Subtitulado para personas sordas y personas con discapacidad auditiva [Subtitling for the Deaf and Hard-of-Hearing People]. UNE 153010:2012. Madrid: AENOR.
Armstrong, Mike, Andy Brown, Michael Crabb, Chris J. Hughes, Rhianne Jones, and James Sandford
2015 Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape. Research & Development White Paper WHP 307. British Broadcasting Corporation. Accessed September 18, 2017. [URL]. 
Arnáiz-Uzquiza, Verónica
2008 “La Objetividad en el Subtitulado. Justificación de los Parámetros Formales Mediante Eye Tracking.” In ULISES y la comunidad sorda: Hacia el desarrollo de tecnologías comunicativas para la igualdad de oportunidades, edited by Álvaro Pérez-Ugena, and Ricardo Vizcaíno Laorga, 73–85. Madrid: Observatorio de las Realidades Sociales y de la Comunicación.
Baker, Robert G.
1981 Guidelines for the Subtitling of Television Programmes. A report from Southampton University for Independent Television (UK). Southampton (UK): Southampton University.
Bartoll, Eduard
2004 “Parameters for the Classification of Subtitles.” In Topics in Audiovisual Translation, edited by Pilar Orero, 53–60. Amsterdam: John Benjamins Publishing Company.
Bartoll, Eduard, and Anjana Martínez-Tejerina
2010 “The Positioning of Subtitles for the Deaf and Hard of Hearing.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 69–86. Bern: Peter Lang.
Bernard, Michael, Chia Hui Liao, and Melissa Mills
2001 “The Effect of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” In CHI EA ’01 Extended Abstracts on Human Factors in Computer Systems, 175–176. New York: ACM Press.
Brooke, John
1996 “SUS-A quick and dirty usability scale.” In Usability Evaluation in Industry, edited by Patrick W. Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard A. Weerdmeester, 4–7. London: CRC Press, [URL]
Brown, Andy, Rhianne Jones, and Michael Crabb
2015 “Dynamic Subtitles: The User Experience.” In TVX 15’ Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 103–112. New York: ACM Press.
Carmichael, Alex
1999 Style Guide for the Design of Interactive Television Services for Elderly Viewers, Winchester: Independent Television Commission. [URL]
Carroll, Mary, and Jan Ivarsson
1998 Subtitling. Simrishamn: TransEdit.
Costa-Montenegro, Enrique, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez
2016 “SubTitleMe, Subtitles in Cinemas in Mobile Devices.” Universal Access in the Information Society 15 (3): 461–472.
Crabb, Michael, Rhianne Jones, Michael Armstrong, and Chris J. Hughes
2015 “Online News Videos: The UX of Subtitle Position.” In ASSETS ’15 Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. New York: ACM Press.
Czaja, Sara J., Neil Charness, Arthur D. Fisk, Christopher Hertzog, Sankaran N. Nair, Wendy A. Rogers, and Joseph Sharit
2006 “Factors Predicting the Use of Technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE).” Psychology and Aging 21 (2): 333–352.
d’Ydewalle, Géry, and Ingrid Gielen
1992 “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition, edited by Keith Rayner, Springer Series in Neuropsychology, 415–527. New York: Springer.
d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
1991 “Watching Subtitled Television. Automatic Reading Behaviour.” Communication Research 18 (5): 650–666.
d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet
1987 “Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In Eye Movements From Physiology to Cognition: Selected/Edited Proceedings of the Third European Conference on Eye Movements, Dourdan, France, September 1985, edited by J. K. O’Regan, and A. Levy-Schoen, 313–321. Amsterdam: Elsevier Science Publishers.
De Bruycker, Wim, and Géry d’Ydewalle
2003 “Chapter 31. Reading Native and Foreign Language Television Subtitles in Children and Adults.” In The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, edited by Jukka Hyöna, Ralph Radach, and H. Deubel, 671–684. Amsterdam: Elsevier Science BV.
de Linde, Zoé, and Neil Kay
1999 The Semiotics of Subtitling. Manchester: St. Jerome Publishing.
DTV4All (Digital Television for All)
Dykstra, Dean Julian
1993 A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. Texas: A&M University.
Gottlieb, Henrik
1998 “Subtitles, Translation and Idioms.” PhD Thesis, University of Copenhagen.
2005 “Multidimensional Translation: Semantics turned Semiotics.” In MuTra 2005: Challenges of Multidimensional Translation: Conference Proceedings, edited by Sandra Nauert, and Heidrun Gerzymisch-Arbogast, EU-High-Level Scientific Conference Series, 33–61, [URL]
Greco, Gian Maria
2016 “On Accessibility as a Human Right, with an application to Media Accessibility.” In Researching Audio Description, edited by Anna Matamala, and Pilar Orero, Palgrave Studies in Translating and Interpreting Series, 11–13. London: Palgrave Macmillan.
Gulliver, Stephen, and Ghinea, George
2003 “How Level and Type of Deafness Affect User Perception of Multimedia Video Clips.” Universal Access in the Information Society 2 (4): 374–386.
HBB4ALL (Hybrid Broadcast Broadband For ALL)
Holken, Hamut, and Pilar Orero
2014 “TV Content Delivery to PC, Tablet, Smartphone: From the Accessibility Vision into Market Reality.” ThinkMind Mobility 2014: The Fourth International Conference on Mobile Services, Resources, and Users, 99–104, [URL]
Hughes, Chris J., Mike Armstrong, Rhianne Jones, and Michael Crabb
2015 “Responsive Design for Personalised Subtitles.” In W4A ’15 Proceedings of the 12th Web for All Conference, 81. New York: ACM Press.
ISO (International Organization for Standardization)
2017 Information Technology – User Interface Component Accessibility – Part 23: Guidance on the Visual Presentation of Audio Information (including Captions and Subtitles). ISO/IEC 20071-23. Paris: ISO.
Karamitroglou, Fotios
Kirkland, C. Eric
1999 “Evaluation of Captioning Features to Inform Development of Digital Television Captioning Capabilities.” American Annals of the Deaf 144 (3): 250–260.
Koolstra, Cees M., and Jonannes W. J. Beentjes
1999 “Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home.” Education Technology Research and Development 47 (1): 51–60.
Koolstra, Cees M., Tom H. A. van der Voort, and Leo J. Th. van der Kamp
1997 “Television’s Impact on Children’s Reading Comprehension and Decoding Skills: A 3-Year Panel Study.” Reading Research Quarterly 32 (2): 128–152.
Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz
2015 “Subtitles on the Moving Image: An Overview of Eye Tracking Studies.” Refractory: A Journal of Entertainment Media 251: 1–14.
Montagud, Mario, Fernando Boronat, Juan González, and Javier Pastor
2017 “Web-Based Platform for Subtitles Customization and Synchronization in Multi-Screen Scenarios.” In TVX ’17 Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 81–82. New York: ACM Press.
Nathan, John G., Daniel R. Anderson, and Diane E. Field
1984 “Television Viewing at Home: Distances and Visual Angles Adopted by Children and Adults.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting 28 (11): 978–982.
Nettelbeck, Ted, and Nicholas R. Burns
2010 “Processing Speed, Working Memory and Reasoning Ability from Childhood to Old Age.” Personality and Individual Differences 48 (4): 379–384.
Neves, Josélia
2007 “ ‘There is Research and Research’: Subtitling for the Deaf and Hard of Hearing (SDH).” In Traducción y Accesibilidad. Subtitulación para Sordos y Audiodescripción para Ciegos. Nuevas Modalidades de Traducción Audiovisual, edited by Catalina Jiménez Hurtado, Studien zur romanischen Sprachwissenschaft und interkulturellen Kommunikation Series, 27–40. Frankfurt am Main: Peter Lang.
Nielsen, Jakob, and Rolf Molich
1990 “Heuristic Evaluation of User Interfaces.” In CHI ’90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 249–256. New York: ACM Press.
Noland, Katy C., and Louise H. Truong
2015 A Survey of UK Television Viewing Conditions. BBC R&D White Paper WHP 287. British Broadcasting Corporation. [URL]
Orero, Pilar, John Birch, and Andrew Lambourne
2014 “Media accessibility in HBBTV: Interaction for All.” IET Conference Proceedings 11–15 Sept. 2014
Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
2018 “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” JosTrans: The Journal of Specialised Translation 301: 105–126, [URL]
Orero, Pilar, Javier Serrano, Olga Soler, Anna Matamala, Judit Castella, Maria Teresa Soto Sanfiel, Anna Vilaró, and Carme Mangiron
2014 “Accessibility to Digital Society: Interaction for All.” ICDS 2014. The Eighth International Conference on Digital Society, 188–191. [URL]
Orero, Pilar, and Irene Tor-Carroggio
2018 “User Requirements when Designing Learning e-Content: Interaction for All.” In Designing for the User Experience in Learning Systems, edited by Evangelos Kapros, and Maria Koutsombogera. Berlin: Springer.
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi
2010 “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 13 (3): 243–272.
Rayner, Keith
1998 “Eye Movements in Reading and Information Processing: Twenty Years of Research.” Psychological Bulletin 1241: 372–422.
Reder, Stephen, and John Bynner
(eds) 2009 Tracking Adult Literacy and Numeracy Skills: Findings from Longitudinal Research. New York and London: Routledge.
Reuter-Lorenz, Patricia A., and Denise C. Park
2014 “How Does it STAC Up? Revisiting the Scaffolding Theory of Aging and Cognition.” Neuropsychology Review 24 (3): 355–370.
Robson, Gary D.
2004 The Closed Captioning Handbook. Amsterdam and London: Focal Press.
Romero-Fresco, Pablo
2009 “More Haste Less Speed: Edited versus Verbatim Respoken Subtitles.” VIAL: Vigo International Journal of Applied Linguistics 61: 109–133, [URL]
2011 Subtitling through Speech Recognition: Respeaking. Manchester: Routledge.
Rudd, Rima E.
2007 “Health Literacy Skills of U.S. Adults.” American Journal of Health Behavior 311 (Suppl 1): S8–S18.
Sauro, Jeff
Sauro, Jeff, and James R. Lewis
2016 “Chapter 8. Standardized Usability Questionnaires.” In Quantifying the User Experience, edited by Jeff Sauro and James R. Lewis, 185–240. Amsterdam: Elsevier.
Sears, Andrew, and Vicki Hanson
2011 “Representing Users in Accessibility Research.” In CHI ’11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2235–2238. New York: ACM Press.
Sinclair II Robert, E., Gilma Annuska Perkins, Michael Edward Dulac Winser, Ramkumar Subramanian, and Paul Reid
Springett, Mark, Mark Rice, and Richard Griffiths
2011 “Towards Inclusive Digital Television.” Universal Access in the Information Society 121: 1–3.
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
2011 “Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.” American Annals of the Deaf 156 (4): 363–378.
Szarkowska, Agnieszka, Izabela Krejtz, Olga Pilipczuk, Łukasz Dutka, and Jan-Louis Kruger
2016 “The Effects of Text Editing and Subtitle Presentation Rate on the Comprehension and Reading Patterns of Interlingual and Intralingual Subtitles among Deaf, Hard of Hearing and Hearing Viewers.” Across Languages and Cultures 17 (2): 183–204.
Utray, Francisco, Ana Maria Pereira, and Pilar Orero
2009 “The Present and Future of Audio Description and Subtitling for the Deaf and Hard of Hearing in Spain.” Meta 54 (2): 248–263.
Utray, Francisco, Belén Ruiz, and José Antonio Moreiro
2010 “Maximum Font Size for Subtitles in Standard Definition Digital Television: Tests for a Font Magnifying Application.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 59–68. Bern: Peter Lang.
Cited by
Cited by 3 other publications
Abdel Latif, Muhammad M. M.
2020. Translation and Interpreting Assessment Research. In Translator and Interpreter Education Research [New Frontiers in Translation Studies, ], ► pp. 61 ff. 
Gorman, Benjamin M., Michael Crabb & Michael Armstrong
2021. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff.
Qiu, Lijian, Wenzheng Zhao & Xuezhi Liu
2022. Does subtitle size in teaching video influence learning outcomes?. Multimedia Tools and Applications 81:30 ► pp. 43253 ff.
This list is based on CrossRef data as of 17 may 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.