Cover not available
Article published In:
Cognitive Translation and Interpreting Studies in the Early Twenty First Century
Edited by Adolfo M. García, Edinson Muñoz and Néstor Singer
[Translation, Cognition & Behavior 6:2] 2023
► pp. 187–210

Cognition and behaviour of reception in museum spaces

A critical review of eye tracking research on museum translation (2010–2022)

ORCID logo | Tianjin University of Finance and Economics | Durham University
ORCID logo | Oxford University
ORCID logo | Durham University

In recent years, there has been a growing interest in translation studies within museum settings, enabling museums to enhance visitor engagement and create a more meaningful visiting experience. Within cognitive translation studies, the use of eye tracking technology has emerged as a widely adopted method for investigating translators’ allocation of visual attention and cognitive resources. However, the application of eye tracking in museum translation studies has received limited attention. This study provides a critical review of the utilisation of eye tracking to examine visitors’ perception and reception in museum settings from both behavioural and cognitive perspectives. The article begins by selecting and categorising the reviewed papers. It then describes the methods employed for collecting and analysing eye movement data, followed by summaries and critical comments on the findings from the existing literature. This article further evaluates the reliability, validity, and practicality of existing eye tracking research in museum translation, and finally proposes the potential directions for future cognitive translation studies in museums.

Keywords: museum translation, eye tracking, critical review, multimodality, cognitive translation studies
Article outline
  • 1.Introduction
  • 2.Methods
    • 2.1Research questions
    • 2.2Selection of the reviewed papers
    • 2.3Categorisation of the reviewed papers
    • 2.4Data analysis
  • 3.Results
    • 3.1Data collecting methods
    • 3.2Eye movement data analysis
    • 3.3Findings reported in the reviewed papers
      • 3.3.1Findings on six types of intermodal translation
        • Type one: Interaction between objects and written texts
        • Type two: Interaction between objects and audio description
        • Type three: Interaction between objects and digital devices
        • Type four: Interaction between written texts and digital devices
        • Type five: Interaction between different digital devices
        • Type six: Interaction between paper materials and digital devices
      • 3.3.2Findings on three types of intramodal translation
        • Type one: Interaction between written texts and audio description
        • Type two: Interlingual translation
        • Type three: Interaction between objects
  • 4.Discussion: Reliability, validity, and practicality of eye tracking research on museum translation
    • 4.1Reliability
    • 4.2Validity
    • 4.3Practicality
  • 5.Directions for future cognitive translation studies in museums
  • 6.Conclusion
  • References
Published online: 7 March 2024
DOI logo
https://doi.org/10.1075/tcb.00085.xu
References
Bal, Mieke
2011 “Exposing the Public.” In A Companion to Museum Studies, edited by Sharon Macdonald, 525–542. Oxford: Wiley-Blackwell.Google Scholar
Bitgood, Stephen
2013 Attention and Value: Keys to Understanding Museum Visitors. Walnut Creek: Left Coast Press.Google Scholar
Black, Graham
2005 The Engaging Museum: Developing Museums for Visitor Involvement. London: Routledge. DOI logoGoogle Scholar
Buquet, Coralie, Jacques Charlier, and Vincent Paris
1988 “Museum Application of an Eye Tracker.” Medical & Biological Engineering & Computing 261: 277–281. DOI logoGoogle Scholar
Di Giovanni, Elena
2020 “Eye Tracking and the Museum Experience in Italy.” Altre Modernità 241: 10–24. DOI logoGoogle Scholar
Dondi, Piercarlo, Porta, Marco, Angelo Donvito, and Giovanni Volpe
2021 “A Gaze-based Interactive System to Explore Artwork Imagery.” Journal on Multimodal User Interfaces 161: 55–67. DOI logoGoogle Scholar
Duchowski, Andrew T.
2002 “A Breadth-first Survey of Eye Tracking Applications.” Behavior Research Methods, Instruments, & Computers: A Journal of the Psychonomic Society 34 (4): 455–470. DOI logoGoogle Scholar
Falk, John H. and Lynn D. Dierking
1992 The Museum Experience. Walnut Creek: Left Coast Press.Google Scholar
2000 Learning from Museums: Visitor Experiences and the Making of Meaning. Walnut Creek: Alta Mira Press.Google Scholar
2013 Museum Experience Revisited. Walnut Creek: Left Coast Press.Google Scholar
Federici, Federico Marco, and Walker, Callum
2018 “A Mapping Exercise: Eye Tracking and Translation.” In Eye Tracking and Multidisciplinary Studies on Translation, edited by Callum Walker and Federico Marco Federici, 11–29. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Frisch, Juliette
2011 “How Can We Define the Role of Language in Museum Interpretation.” In Museum Gallery Interpretation and Material Culture, edited by Juliette Frisch, 97–105. New York: Routledge.Google Scholar
Garbutt, Michael, Scott East, Branka Spehar, Vicente Estrada-Gonzalez, Brooke Carson-Ewart, and Josephine Touma
2020 “The Embodied Gaze: Exploring Applications for Mobile Eye Tracking in the Art Museum.” Visitor Study 23 (1): 82–100. DOI logoGoogle Scholar
García, Adolfo M.
2014 “The Interpreter Advantage Hypothesis: Preliminary Data Patterns and Empirically Motivated Questions.” Translation and Interpreting Studies 91: 219–238. DOI logoGoogle Scholar
Hall, Edward T.
1966 The Hidden Dimension. New York: Doubleday.Google Scholar
Hooper-Greenhill, Eilean
2000 Museums and the Interpretation of Visual Culture, 1st ed. London: Routledge. DOI logoGoogle Scholar
Hsieh, Yu-Ling, Ming-Feng Lee, Guey-Shya Chen, and Wei-Jie Wang
2022 “Application of Visitor Eye Movement Information to Museum Exhibit Analysis.” Sustainability 14 (11): 6932. DOI logoGoogle Scholar
Hutchinson, Rachel S., and Alison F. Eardley
2019 “Museum Audio Description: The Problem of Textual Fidelity.” Perspectives 27 (1): 42–57. DOI logoGoogle Scholar
2021 “Inclusive Museum Audio Guides: ‘Guided Looking’ through Audio Description Enhances Memorability of Artworks for Sighted Audiences.” Museum Management and Curatorship 361: 427–446. DOI logoGoogle Scholar
ICOM
2022 “ICOM Approves a New Museum Definition.” Accessed 28 August 2022. [URL]
Jakobson, Roman
1959 “On Linguistic Aspects of Translation.” In On Translation, edited by Reuben A. Brower, 232–239. Cambridge, MA: Harvard University Press.Google Scholar
Kaindl, Klaus
2020 “A Theoretical Framework for a Multimodal Conception of Translation.” In Translation and Multimodality, edited by Monica Boria, Ángeles Carreres, María Noriega-Sánchez, and Marcus Tomalin, 49–70. London: Routledge.Google Scholar
Kastner, Sabine, and Mark A. Pinsk
2004 “Visual Attention as A Multilevel Selection Process.” Cognitive, Affective, & Behavioral Neuroscience 41: 483–500. DOI logoGoogle Scholar
Koliou, Adamantia
1997 “Foreign Languages and Their Role in Access to Museums.” Museum Management and Curatorship 16 (1): 71–76. DOI logoGoogle Scholar
Komarac, Tanja, Đurđana Ozretić Došen, and Vatroslav Škare
2014 “Museum Marketing and Virtual Museums in 21st Century: Can Museums Survive without it?” 5th EMAC Regional Conference – Marketing Theory Challenges in Emerging Markets. Katowice, Poland. DOI logoGoogle Scholar
Krogh-Jespersen, Sheila, Kimberly A. Quinn, William L. D. Krenzer, Christine Nguyen, Jana Greenslit, and C. Aaron Price
2020 “Exploring the Awe-some: Mobile Eye Tracking Insights into Awe in a Science Museum.” PLoS ONE 15 (9): e0239204. DOI logoGoogle Scholar
Liao, Min-Hsiu
2018 “Museums and Creative Industries: The Contribution of Translation Studies.” The Journal of Specialised Translation 291: 45–62. [URL]
2019 “Translating Multimodal Texts in Space: A Case Study of St Mungo Museum of Religious Life and Art.” Linguistica Antverpiensia New Series–Themes in Translation Studies 17 1: 84–98. [URL]. DOI logo
2020 “Translating Trauma: Time Journey in a Memorial Museum.” In Translation and Time: Migration, Culture and Identity, edited by James St. André, 126–141. Kent, Ohio: Kent State University Press.Google Scholar
2021 “A Journey Home? Cultural Back-translation of Ethnographic Artefacts in Museums.” In Translation – Art Communication – Museum, edited by Barbara Ahrens, Silvia Hansen-Schirra, Monika Krein-Kühle, Michael Schreiber, and Ursula Wienen, 99–115. Berlin: Frank & Timme.Google Scholar
2021 “Christianity on Display: A Semiotic Study of Two Museums of World Religions (Glasgow, Taipei).” Church, Communication and Culture 6 (2): 383–401. DOI logoGoogle Scholar
Liao, Min-Hsiu, and Phil Bartie
2022 “Translating Heritage: A Study of Visitors’ Experiences Mediated through Multilingual Audio Guides in Edinburgh Castle.” Journal of Heritage Tourism 17 (3): 283–295. DOI logoGoogle Scholar
Mandolesi, Serena, Danilo Gambelli, Simona Naspetti, and Raffaele Zanoli
2022 “Exploring Visitors’ Visual Behavior Using Eye Tracking: The Case of the ‘Studiolo Del Duca ’” Journal of Imaging 8 (1): 8. DOI logoGoogle Scholar
Marina, Manfredi
2021 “Professional Museum Translators for Promoting Multilingualism and Accessible Texts: Translation Practices in Some Italian Museums and a Proposal.” Journal of Translation Studies 1 (1): 59–86. DOI logoGoogle Scholar
Mayer, Richard E.
2005 “Cognitive Theory of Multimedia Learning.” In The Cambridge Handbook of Multimedia Learning, edited by Richard E. Mayer, 31–48. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Mayr, Eva, Kristin Knipfer, and Daniel Wessel
2009 “In-Sights into Mobile Learning: An Exploration of Mobile Eye Tracking Methodology for Learning in Museums.” In Researching Mobile Learning: Frameworks, Tools and Research Designs, edited by Giasemi Vavoula, Norbert Pachler, and Agnes Kukulska-Hulme, 189–204. Oxford: Peter Lang.Google Scholar
McManus, Paulette
1991 “Making Sense of Exhibits.” In Museum Languages: Objects and Texts, edited by Gaynor Kavanagh, 33–46. Leicester: Leicester University Press. DOI logoGoogle Scholar
Milekic, Slavko
2003 “The More You Look the More You Get: Intention-based Interface Using Gaze Tracking.” In Museums and the Web: Selected Papers from Museums and the Web 03, edited by David Bearman and Jennifer Trant. Pittsburgh: Archives & Museum Informatics. [URL]
2010 “Gaze Tracking and Museums: Current Research and Implications.” In Museums and the Web 2010: Proceedings, edited by Jennifer Trant and David Bearman. Toronto: Archives & Museum Informatics. [URL]
Morantes, Paola Patricia Parra, Sonia Andrea Peñarete, Giovanny Arbelaez, Mauricio Camargo, and Laurent Dupont
2016 “Understanding Museum Visitors’ Experience through an Eye Tracking Study and a Living Lab Approach.” 22nd ICE/IEEE International Technology Management Conference. Trondheim: Norway. DOI logoGoogle Scholar
Neather, Robert
2008 “Translating Tea: On the Semiotics of Interlingual Practice in the Hong Kong Museum of Teaware.” Meta 53 (1): 218–240. DOI logoGoogle Scholar
2021 “Museums as Translation Zones.” In The Routledge Handbook of Translation and Globalization, edited by Esperança Bielsa and Dionysios Kapsaskis, 306–319. Cham: Springer.Google Scholar
Ng, Tzi-Dong Jeremy, Xiao Hu, and Ying Peng Que
2022 “Towards Multi-modal Evaluation of Eye tracked Virtual Heritage Environment.” LAK22: 12th International Learning Analytics and Knowledge Conference, 451–457. DOI logoGoogle Scholar
Nitzke, Jean
2021 “The Processing of Website Contents in Native and Nonnative Language.” In Translation, Interpreting, Cognition: The Way out of the Box, edited by Tra&Co Group, 105–113. Berlin: Language Science. DOI logoGoogle Scholar
Paivio, Allan
1979 Imagery and Verbal Processes. 1st ed. New York: Psychology Press. DOI logoGoogle Scholar
Raffi, Francesca
2017 “Full Access to Cultural Spaces (FACS): Mapping and Evaluating Museum Access Services Using Mobile Eye Tracking Technologies.” Ars Aeterna 9 (2): 18–37. DOI logoGoogle Scholar
Rainoldi, Mattia, Barbara Neuhofer, and Mario Jooss
2018 “Mobile Eyetracking of Museum Learning Experiences.” In Information and Communication Technologies in Tourism 2018, edited by Brigitte Stangl and Juho Pesonen, 473–485. Cham: Springer. DOI logoGoogle Scholar
Rainoldi, Mattia, Chung-En Yu, and Barbara Neuhofer
2020 “The Museum Learning Experience Through the Visitors’ Eyes: An Eye Tracking Exploration of the Physical Context.” In Eye Tracking in Tourism, edited by Mattia Rainoldi and Mario Jooss, 183–199. Cham: Springer. DOI logoGoogle Scholar
Reitstätter, Luise, Karolin Galter, and Flora Bakondi
2022 “Looking to Read: How Visitors Use Exhibit Labels in the Art Museum.” Visitor Studies 25 (2): 127–150. DOI logoGoogle Scholar
Rentschler, Ruth, and Anne-Marie Hede
2007 Museum Marketing: Competing in the Global Marketplace. Oxford: Butterworth-Heinemann.Google Scholar
Schiele, Bernard
1995 “Text in the Exhibition Medium.” In Text in the Exhibition Medium, edited by Alexandre Blais, 33–47. La Société Des Musées Québécois: Musée de la civilisation.Google Scholar
Schwan, Stephan, Melissa Gussmann, Peter Gerjets, Axel Drecoll, and Albert Feiber
2020 “Distribution of Attention in a Gallery Segment on the National Socialists’ Führer Cult: Diving Deeper into Visitors’ Cognitive Exhibition Experiences Using Mobile Eye Tracking.” Museum Management and Curatorship 35 (1): 71–88. DOI logoGoogle Scholar
Severin, Werner
1967 “Another Look at Cue Summation.” AV Communication Review 15 (4): 233–245. DOI logoGoogle Scholar
Smith, Jeffrey K., and Smith, Lisa F.
2001 “Spending Time on Art.” Empirical Studies of the Arts 19 (2): 229–236. DOI logoGoogle Scholar
Smith, Lisa F., Jeffrey K. Smith and Pablo P. L. Tinio
2017 “Time Spent Viewing Art and Reading Labels.” Psychology of Aesthetics, Creativity, and the Arts 11 (1): 77–85. DOI logoGoogle Scholar
Spinzi, Cinzia
2019 “A Cross-Cultural Study of Figurative Language in Museum Audio Descriptions. Implications for Translation.” Lingue e Linguaggi 331: 303–316. DOI logoGoogle Scholar
Sturge, Kate
2007 Representing Others: Translation, Ethnography and Museum. Manchester: St Jerome Publishing.Google Scholar
Szarkowska, Agnieszka, Izabela Krejtz, Krzysztof Krejtz, and Andrew Duchowski
2013 “Harnessing the Potential of Eyetracking for Media Accessibility.” In Translation Studies and Eye Tracking Analysis, edited by Sambor Grucza, Monika Pluzyczka, and Justyna Zajac, 153–183. Oxford: Peter Lang.Google Scholar
Yang, Jing, and Cyrus Yin-Ho Chan
2019 “Audio-augmented Museum Experiences with Gaze Tracking.” Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia 461, 1–5. DOI logoGoogle Scholar