Article published in:
Translation Spaces
Vol. 7:2 (2018) ► pp. 263–284

Usability tests for personalised subtitles

| Universitat Pompeu Fabra
| Universitat Autònoma de Barcelona
Over the past decade, subtitles have developed along with broadcast and broadband technology. Viewers nowadays enjoy new opportunities to customize subtitles to best meet their personal preferences or needs. This study aims to identify end-user subtitle setting preferences, to investigate whether these settings have an effect on content comprehension, and to explore subtitle usability for two groups of participants, those under the age of 65 and those over 65. In an experiment, three subtitle features were open to customization: the position, the box and the size of the subtitle, before and after participants watched an on-demand TV documentary produced by the Catalan public broadcaster TVC. Results confirm a preference for bottom and medium subtitles. Furthermore, while the under 65 segment made satisfactory use of the system, the over 65 segment experienced different levels of usability and reported different capabilities and problems.
Keywords: subtitles, customization, user-centric design, accessibility, convergence, usability
Article outline
  • Introduction
  • Media accessibility and usability
  • Subtitle position and text size
  • Objectives and methodology
  • Participants, materials and procedure
  • Results
  • Discussion
  • Conclusions
  • Notes
  • References
Published online: 28 November 2018
https://doi.org/10.1075/ts.18016.man
References

References

AENOR (Asociación Española de Normalización y Certificación)
2012 Subtitulado para personas sordas y personas con discapacidad auditiva [Subtitling for the Deaf and Hard-of-Hearing People]. UNE 153010:2012. Madrid: AENOR.Google Scholar
Armstrong, Mike, Andy Brown, Michael Crabb, Chris J. Hughes, Rhianne Jones, and James Sandford
2015 Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape. Research & Development White Paper WHP 307. British Broadcasting Corporation. Accessed September 18, 2017. http://​downloads​.bbc​.co​.uk​/rd​/pubs​/whp​/whp​-pdf​-files​/WHP307​.pdf. Crossref
Arnáiz-Uzquiza, Verónica
2008 “La Objetividad en el Subtitulado. Justificación de los Parámetros Formales Mediante Eye Tracking.” In ULISES y la comunidad sorda: Hacia el desarrollo de tecnologías comunicativas para la igualdad de oportunidades, edited by Álvaro Pérez-Ugena, and Ricardo Vizcaíno Laorga, 73–85. Madrid: Observatorio de las Realidades Sociales y de la Comunicación.Google Scholar
Baker, Robert G.
1981 Guidelines for the Subtitling of Television Programmes. A report from Southampton University for Independent Television (UK). Southampton (UK): Southampton University.Google Scholar
Bartoll, Eduard
2004 “Parameters for the Classification of Subtitles.” In Topics in Audiovisual Translation, edited by Pilar Orero, 53–60. Amsterdam: John Benjamins Publishing Company. CrossrefGoogle Scholar
Bartoll, Eduard, and Anjana Martínez-Tejerina
2010 “The Positioning of Subtitles for the Deaf and Hard of Hearing.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 69–86. Bern: Peter Lang.Google Scholar
Bernard, Michael, Chia Hui Liao, and Melissa Mills
2001 “The Effect of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” In CHI EA ’01 Extended Abstracts on Human Factors in Computer Systems, 175–176. New York: ACM Press. CrossrefGoogle Scholar
Brooke, John
1996 “SUS-A quick and dirty usability scale.” In Usability Evaluation in Industry, edited by Patrick W. Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard A. Weerdmeester, 4–7. London: CRC Press, https://​www​.crcpress​.com​/product​/isbn​/9780748404605
Brown, Andy, Rhianne Jones, and Michael Crabb
2015 “Dynamic Subtitles: The User Experience.” In TVX 15’ Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 103–112. New York: ACM Press. CrossrefGoogle Scholar
Carmichael, Alex
1999 Style Guide for the Design of Interactive Television Services for Elderly Viewers, Winchester: Independent Television Commission. http://​projects​.computing​.dundee​.ac​.uk​/UTOPIA​/publications​/Carmichael%20​-%20DesignStyleGuideFinal​.pdf
Carroll, Mary, and Jan Ivarsson
1998 Subtitling. Simrishamn: TransEdit.Google Scholar
Costa-Montenegro, Enrique, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez
2016 “SubTitleMe, Subtitles in Cinemas in Mobile Devices.” Universal Access in the Information Society 15 (3): 461–472. CrossrefGoogle Scholar
Crabb, Michael, Rhianne Jones, Michael Armstrong, and Chris J. Hughes
2015 “Online News Videos: The UX of Subtitle Position.” In ASSETS ’15 Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. New York: ACM Press. CrossrefGoogle Scholar
Czaja, Sara J., Neil Charness, Arthur D. Fisk, Christopher Hertzog, Sankaran N. Nair, Wendy A. Rogers, and Joseph Sharit
2006 “Factors Predicting the Use of Technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE).” Psychology and Aging 21 (2): 333–352. CrossrefGoogle Scholar
d’Ydewalle, Géry, and Ingrid Gielen
1992 “Attention Allocation with Overlapping Sound, Image, and Text.” In Eye Movements and Visual Cognition, edited by Keith Rayner, Springer Series in Neuropsychology, 415–527. New York: Springer. CrossrefGoogle Scholar
d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
1991 “Watching Subtitled Television. Automatic Reading Behaviour.” Communication Research 18 (5): 650–666. CrossrefGoogle Scholar
d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet
1987 “Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” In Eye Movements From Physiology to Cognition: Selected/Edited Proceedings of the Third European Conference on Eye Movements, Dourdan, France, September 1985, edited by J. K. O’Regan, and A. Levy-Schoen, 313–321. Amsterdam: Elsevier Science Publishers. CrossrefGoogle Scholar
De Bruycker, Wim, and Géry d’Ydewalle
2003 “Chapter 31. Reading Native and Foreign Language Television Subtitles in Children and Adults.” In The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, edited by Jukka Hyöna, Ralph Radach, and H. Deubel, 671–684. Amsterdam: Elsevier Science BV. CrossrefGoogle Scholar
de Linde, Zoé, and Neil Kay
1999 The Semiotics of Subtitling. Manchester: St. Jerome Publishing.Google Scholar
DTV4All (Digital Television for All)
2010 European Research Project. http://​www​.psp​-dtv4all​.org/
Dykstra, Dean Julian
1993 A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. Texas: A&M University.Google Scholar
Gottlieb, Henrik
1998 “Subtitles, Translation and Idioms.” PhD Thesis, University of Copenhagen.Google Scholar
2005 “Multidimensional Translation: Semantics turned Semiotics.” In MuTra 2005: Challenges of Multidimensional Translation: Conference Proceedings, edited by Sandra Nauert, and Heidrun Gerzymisch-Arbogast, EU-High-Level Scientific Conference Series, 33–61, http://​www​.euroconferences​.info​/proceedings​/2005​_Proceedings​/2005​_Gottlieb​_Henrik​.pdf
Greco, Gian Maria
2016 “On Accessibility as a Human Right, with an application to Media Accessibility.” In Researching Audio Description, edited by Anna Matamala, and Pilar Orero, Palgrave Studies in Translating and Interpreting Series, 11–13. London: Palgrave Macmillan. CrossrefGoogle Scholar
Gulliver, Stephen, and Ghinea, George
2003 “How Level and Type of Deafness Affect User Perception of Multimedia Video Clips.” Universal Access in the Information Society 2 (4): 374–386. CrossrefGoogle Scholar
HBB4ALL (Hybrid Broadcast Broadband For ALL)
2017 European Research Project. http://​pagines​.uab​.cat​/hbb4all/
Holken, Hamut, and Pilar Orero
2014 “TV Content Delivery to PC, Tablet, Smartphone: From the Accessibility Vision into Market Reality.” ThinkMind Mobility 2014: The Fourth International Conference on Mobile Services, Resources, and Users, 99–104, http://​www​.thinkmind​.org​/index​.php​?view​=article​&articleid​=mobility​_2014​_4​_50​_70009
Hughes, Chris J., Mike Armstrong, Rhianne Jones, and Michael Crabb
2015 “Responsive Design for Personalised Subtitles.” In W4A ’15 Proceedings of the 12th Web for All Conference, 81. New York: ACM Press. CrossrefGoogle Scholar
ISO (International Organization for Standardization)
2017 Information Technology – User Interface Component Accessibility – Part 23: Guidance on the Visual Presentation of Audio Information (including Captions and Subtitles). ISO/IEC 20071-23. Paris: ISO.Google Scholar
Karamitroglou, Fotios
1997 “A Proposed Set of Subtitling Standards in Europe.” Translation Journal 2 (2), http://​translationjournal​.net​/journal​/04stndrd​.htm
Kirkland, C. Eric
1999 “Evaluation of Captioning Features to Inform Development of Digital Television Captioning Capabilities.” American Annals of the Deaf 144 (3): 250–260. CrossrefGoogle Scholar
Koolstra, Cees M., and Jonannes W. J. Beentjes
1999 “Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home.” Education Technology Research and Development 47 (1): 51–60. CrossrefGoogle Scholar
Koolstra, Cees M., Tom H. A. van der Voort, and Leo J. Th. van der Kamp
1997 “Television’s Impact on Children’s Reading Comprehension and Decoding Skills: A 3-Year Panel Study.” Reading Research Quarterly 32 (2): 128–152. CrossrefGoogle Scholar
Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz
2015 “Subtitles on the Moving Image: An Overview of Eye Tracking Studies.” Refractory: A Journal of Entertainment Media 251: 1–14.Google Scholar
Montagud, Mario, Fernando Boronat, Juan González, and Javier Pastor
2017 “Web-Based Platform for Subtitles Customization and Synchronization in Multi-Screen Scenarios.” In TVX ’17 Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 81–82. New York: ACM Press. CrossrefGoogle Scholar
Nathan, John G., Daniel R. Anderson, and Diane E. Field
1984 “Television Viewing at Home: Distances and Visual Angles Adopted by Children and Adults.” In Proceedings of the Human Factors and Ergonomics Society Annual Meeting 28 (11): 978–982. CrossrefGoogle Scholar
Nettelbeck, Ted, and Nicholas R. Burns
2010 “Processing Speed, Working Memory and Reasoning Ability from Childhood to Old Age.” Personality and Individual Differences 48 (4): 379–384. CrossrefGoogle Scholar
Neves, Josélia
2007 “ ‘There is Research and Research’: Subtitling for the Deaf and Hard of Hearing (SDH).” In Traducción y Accesibilidad. Subtitulación para Sordos y Audiodescripción para Ciegos. Nuevas Modalidades de Traducción Audiovisual, edited by Catalina Jiménez Hurtado, Studien zur romanischen Sprachwissenschaft und interkulturellen Kommunikation Series, 27–40. Frankfurt am Main: Peter Lang.Google Scholar
Nielsen, Jakob, and Rolf Molich
1990 “Heuristic Evaluation of User Interfaces.” In CHI ’90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 249–256. New York: ACM Press. CrossrefGoogle Scholar
Noland, Katy C., and Louise H. Truong
2015 A Survey of UK Television Viewing Conditions. BBC R&D White Paper WHP 287. British Broadcasting Corporation. http://​downloads​.bbc​.co​.uk​/rd​/pubs​/whp​/whp​-pdf​-files​/WHP287​.pdf
Orero, Pilar, John Birch, and Andrew Lambourne
2014 “Media accessibility in HBBTV: Interaction for All.” IET Conference Proceedings 11–15 Sept. 2014  CrossrefGoogle Scholar
Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
2018 “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” JosTrans: The Journal of Specialised Translation 301: 105–126, http://​www​.jostrans​.org​/issue30​/art​_orero​_et​_al​.pdf
Orero, Pilar, Javier Serrano, Olga Soler, Anna Matamala, Judit Castella, Maria Teresa Soto Sanfiel, Anna Vilaró, and Carme Mangiron
2014 “Accessibility to Digital Society: Interaction for All.” ICDS 2014. The Eighth International Conference on Digital Society, 188–191. http://​www​.thinkmind​.org​/index​.php​?view​=article​&articleid​=icds​_2014​_8​_10​_10031
Orero, Pilar, and Irene Tor-Carroggio
2018 “User Requirements when Designing Learning e-Content: Interaction for All.” In Designing for the User Experience in Learning Systems, edited by Evangelos Kapros, and Maria Koutsombogera. Berlin: Springer. CrossrefGoogle Scholar
Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi
2010 “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology 13 (3): 243–272. CrossrefGoogle Scholar
Rayner, Keith
1998 “Eye Movements in Reading and Information Processing: Twenty Years of Research.” Psychological Bulletin 1241: 372–422. CrossrefGoogle Scholar
Reder, Stephen, and John Bynner
(eds) 2009 Tracking Adult Literacy and Numeracy Skills: Findings from Longitudinal Research. New York and London: Routledge.Google Scholar
Reuter-Lorenz, Patricia A., and Denise C. Park
2014 “How Does it STAC Up? Revisiting the Scaffolding Theory of Aging and Cognition.” Neuropsychology Review 24 (3): 355–370. CrossrefGoogle Scholar
Robson, Gary D.
2004 The Closed Captioning Handbook. Amsterdam and London: Focal Press. CrossrefGoogle Scholar
Romero-Fresco, Pablo
2009 “More Haste Less Speed: Edited versus Verbatim Respoken Subtitles.” VIAL: Vigo International Journal of Applied Linguistics 61: 109–133, http://​vialjournal​.webs​.uvigo​.es​/pdf​/Vial​-2009​-Article6​.pdf
2011 Subtitling through Speech Recognition: Respeaking. Manchester: Routledge.Google Scholar
Rudd, Rima E.
2007 “Health Literacy Skills of U.S. Adults.” American Journal of Health Behavior 311 (Suppl 1): S8–S18. CrossrefGoogle Scholar
Sauro, Jeff
2011 “Measuring Usability with the System Usability Scale (SUS).” In Measuring U. https://​measuringu​.com​/sus/
Sauro, Jeff, and James R. Lewis
2016 “Chapter 8. Standardized Usability Questionnaires.” In Quantifying the User Experience, edited by Jeff Sauro and James R. Lewis, 185–240. Amsterdam: Elsevier. CrossrefGoogle Scholar
Sears, Andrew, and Vicki Hanson
2011 “Representing Users in Accessibility Research.” In CHI ’11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2235–2238. New York: ACM Press. CrossrefGoogle Scholar
Sinclair II Robert, E., Gilma Annuska Perkins, Michael Edward Dulac Winser, Ramkumar Subramanian, and Paul Reid
2009 Personalization of User Accessibility Options. U.S. Patent No. US7554522B2, https://​patents​.google​.com​/patent​/US7554522B2​/en
Springett, Mark, Mark Rice, and Richard Griffiths
2011 “Towards Inclusive Digital Television.” Universal Access in the Information Society 121: 1–3. CrossrefGoogle Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
2011 “Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.” American Annals of the Deaf 156 (4): 363–378. CrossrefGoogle Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Olga Pilipczuk, Łukasz Dutka, and Jan-Louis Kruger
2016 “The Effects of Text Editing and Subtitle Presentation Rate on the Comprehension and Reading Patterns of Interlingual and Intralingual Subtitles among Deaf, Hard of Hearing and Hearing Viewers.” Across Languages and Cultures 17 (2): 183–204. CrossrefGoogle Scholar
Utray, Francisco, Ana Maria Pereira, and Pilar Orero
2009 “The Present and Future of Audio Description and Subtitling for the Deaf and Hard of Hearing in Spain.” Meta 54 (2): 248–263. CrossrefGoogle Scholar
Utray, Francisco, Belén Ruiz, and José Antonio Moreiro
2010 “Maximum Font Size for Subtitles in Standard Definition Digital Television: Tests for a Font Magnifying Application.” In Listening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited by Anna Matamala, and Pilar Orero, 59–68. Bern: Peter Lang.Google Scholar
Cited by

Cited by 2 other publications

Abdel Latif, Muhammad M. M.
2020.  In Translator and Interpreter Education Research [New Frontiers in Translation Studies, ], ► pp. 61 ff. Crossref logo
Gorman, Benjamin M., Michael Crabb & Michael Armstrong
2021.  In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff. Crossref logo

This list is based on CrossRef data as of 11 november 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.