Cover not available
Part of
Eye Tracking and Multidisciplinary Studies on Translation
Edited by Callum Walker and Federico M. Federici
[Benjamins Translation Library 143] 2018
► pp. 71–94

Chapter 5
Analysing variable relationships and time-course data in eye-tracking studies of translation processes and products

ORCID logo
Eye tracking has become a central research method in quantitative approaches in Translation Studies over the past decade. While the number of such studies is growing, methodological limitations have arisen in the application of eye tracking to the study of translation processes and their products. This chapter discusses two interrelated limitations of our current application of eye tracking: the analysis of the relationships between variables within eye tracking data, and the analysis of individuals and groups over time. Firstly, after a concise review of current applications of eye tracking in the discipline, I discuss the strengths and limitations of the traditional factorial designs used within Translation Studies. I then build upon previous arguments for the adoption of regression modeling in the future eye-tracking studies in our discipline, where I use simple in-discipline examples to show the advantages of regression modeling over factorial designs. I then extend this argument by presenting growth curve modeling as a means to analyse the rich time-course data found in eye-tracking studies of translation. Finally, I conclude by identifying the ways in which this approach can become more accessible to researchers in our discipline and by arguing that Translation Studies provides a unique and challenging testing ground for the cognitive and psychological sciences.
Article outline
  • 1.Introduction
  • 2.Background
  • 3.Factorial designs in eye-tracking studies in TS
    • 3.1Forced categorisation
    • 3.2Limitation on factors
    • 3.3Missing data
    • 3.4Treatment of individual differences
  • 4.Regression modelling in eye-tracking studies in TS
    • 4.1Forced categorisation
    • 4.2Limitation on factors
    • 4.3Missing data
    • 4.4Treatment of individual differences
    • 4.5Moving from factorial to regression designs
  • 5.Growth curve modelling for time-course data
  • 6.Conclusion
  • References
Published online: 16 October 2018
DOI logo
https://doi.org/10.1075/btl.143.05doh
References (40)
References
Alves, Fabio, Adriana Pagano, and Igor da Silva. 2009. “A New Window on Translators’ Cognitive Activity: Methodological Issues in the Combined Use of Eye Tracking, Key Logging and Retrospective Protocols.” In Methodology, Technology and Innovation in Translation Process Research, ed. by Inger Mees, Fabio Alves, and Susanne Göpferich, 267–291. Frederiksberg: Samfundslitteratur.Google Scholar
Alves, Fabio, Adriana Pagano, and Igor de Silva. 2011. “Towards an investigation of reading modalities in/for translation: An exploratory study using eye-tracking data.” In Cognitive Explorations of Translation, ed. by Sharon O’Brien, 175–196. London, UK: Continuum.Google Scholar
American Psychological Association, 2009. Publication Manual of the American Psychological Association 6th Edition. Washington, DC, USA: American Psychological Association.Google Scholar
Balling, Laura Winther. 2008. “A Brief Introduction to Regression Designs and Mixed-effects Modeling by a Recent Convert.” In Looking at Eyes, ed. by Susanne Göpferich, Inger Mees, and Arnt Lykke Jakobsen, 175–192. Frederiksberg: Samfundslitteratur.Google Scholar
Balling, Laura Winther, and Kristian Tangsgaard Hvelplund. 2015. “Design and Statistics in Quantitative Translation (Process) Research.” Translation Spaces 4 (1): 169–186.DOI logoGoogle Scholar
Balling, Laura Winther, Kristian Tangsgaard Hvelplund, and Annette C. Sjørup. 2014. “Evidence of Parallel Processing During Translation.” Translators’ Journal 59 (2): 234–259.Google Scholar
Bisson, Marie-Josée, Walter J. B. Van Heuven, Kathy Conklin, and Richard J. Tunney. 2014. “Processing of Native and Foreign Language Subtitles in Films: An Eye Tracking Study.” Applied Psycholinguistics 35 (2): 399–418.DOI logoGoogle Scholar
Cambra, Cristina, Olivier Penacchio, Nuria Silvestre, and Aurora Leal. 2014. “Visual Attention to Subtitles When Viewing a Cartoon by Deaf and Hearing Children: An Eye-tracking Pilot Study.” Perspectives: Studies in Translatology 22 (4): 607–617.DOI logoGoogle Scholar
Cohen, Jacob. 1983. “The Cost of Dichotomization.” Applied Psychological Measurement 7: 249–254.DOI logoGoogle Scholar
Creswell, John, and Vicki Plano Clark. 2007. Designing and Conducting Mixed Methods Research. New York, USA: Sage.Google Scholar
Curran, Patrick J., Khawla Obeidat, and Diane Losardo. 2010. “Twelve Frequently Asked Questions About Growth Curve Modeling.” Journal of Cognition and Development 11 (2): 121–136.DOI logoGoogle Scholar
Doherty, Stephen. 2012. “Investigating the Effects of Controlled Language on the Reading and Comprehension of Machine Translated Texts: A Mixed-methods Approach Using Eye Tracking.” PhD dissertation, Dublin City University.Google Scholar
. 2016. “The Impact of Translation Technologies on the Process and Product of Translation.” International Journal of Communication 10: 947–969.Google Scholar
Doherty, Stephen, and Jan-Louis Kruger. 2018a. “The Development of Eye Tracking in Empirical Research on Subtitling and Captioning.” In Seeing into Screens: Eye Tracking and the Moving Image, ed. by Tessa Dwyer, Clare Perkins, Sean Redmond, and Jodi Sita, 46–64. London and New York, UK: Bloomsbury.Google Scholar
. 2018b. “Assessing Quality in Human- and Machine-generated Subtitles and Captions.” In Translation Quality Assessment: From Principles to Practice, ed. by Joss Moorkens, Sheila Castilho, Federico Gaspari, and Stephen Doherty, 179–197. Cham, Switzerland: Springer.DOI logoGoogle Scholar
Doherty, Stephen, and Sharon O’Brien. 2014. “Assessing the Usability of Raw Machine Translated Output: A User-centered Study Using Eye Tracking.” International Journal of Human-Computer Interaction 30 (1): 40–51.DOI logoGoogle Scholar
Doherty, Stephen, Sharon O’Brien, and Michael Carl. 2010. “Eye Tracking as an MT Evaluation Technique.” Machine Translation 24 (1): 1–13.DOI logoGoogle Scholar
Dragsted, Barbara, and Inge Gorm Hansen. 2008. “Comprehension and Production in Translation: A Pilot Study on Segmentation and the Coordination of Reading and Writing Processes.– In Looking at Eyes: Eye-tracking Studies of Reading and Translation Processing, ed. by Susanne Gopferich, Arnt Lykke Jakobsen, and Inger M. Mees, 9–29. Frederiksberg, Denmark: Samfundslitteratur.Google Scholar
Duchowski, Andrew. 2007. Eye Tracking Methodology: Theory and Practice. Berlin, Germany: Springer.Google Scholar
Dörnyei, Zoltán. 2007. Research Methods in Applied Linguistics: Quantitative, Qualitative, and Mixed Methodologies. Oxford, UK: Oxford University Press.Google Scholar
D’Ydewalle, Géry, Patrick Muylle, and Johan Van Rensbergen. 1985. “Attention Shifts in Partially Redundant Information Situations.” Eye Movements and Human Information Processing: 375–384.Google Scholar
Holmqvist, Kenneth, Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van De Weijer. 2011. Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford, UK: Oxford University Press.Google Scholar
Hvelplund, Kristian Tangsgaard. 2011. Allocation of Cognitive Resources in Translation: An Eye-tracking and Key-logging Study. PhD dissertation, University of Copenhagen.Google Scholar
. 2014. “Eye Tracking and the Translation Process: Reflections on the Analysis and Interpretation of Eye-tracking Data.” In MonTI Special Issue – Minding Translation, ed. by Ricardo Muñoz Martín, 201–223. Alicante, Spain: Universidad de Alicante.Google Scholar
Jakobsen, Arnt Lykke, and Kristian Hvelplund Jensen. 2008. “Eye Movement Behaviour Across Four Different Types of Reading Tasks.” In Looking at Eyes: Eye‐Tracking Studies of Reading and Translation Processing, ed. by Susanne Göpferich, Arnt Lykke Jakobsen, and Inger M. Mees, 103–124. Frederiksberg: Samfundslitteratur.Google Scholar
Kruger, Jan-Louis, and Stephen Doherty. 2016. “Measuring Cognitive Load in the Presence of Educational Video: Towards a Multimodal Methodology.” Australasian Journal of Educational Technology 32 (6): 19–31.DOI logoGoogle Scholar
Kruger, Jan-Louis, Stephen Doherty, Wendy Fox, and Peter de Lissa. 2018. “Multimodal Measurement of Cognitive Load During Subtitle Processing: Same-language Subtitles for Foreign Language Viewers.” In Innovation and Expansion in Translation Process Research, ed. by Isabel Lacruz, and Riitta Jääskeläinen, 267–294. Amsterdam: John Benjamins.DOI logoGoogle Scholar
Kruger, Jan-Louis, María T. Soto-Sanfiel, and Stephen Doherty. 2017. “Original Language Subtitles: Their Effects on the Native and Foreign Viewer.” Comunicar 50 (1): 23–32.DOI logoGoogle Scholar
Kruger, Jan-Louis, María T. Soto-Sanfiel, Stephen Doherty, and Ronny Ibrahim. 2016. “Towards a Cognitive Audio-visual Translatology: Subtitles and Embodied Cognition.” In Reembedding Translation Process Research, ed. by Ricardo Muñoz Martín, 171–194. Amsterdam: John Benjamins.DOI logoGoogle Scholar
Liversedge, Simon P., Iain Gilchrist, and Stefan Everling (eds). 2011. The Oxford Handbook of Eye Movements. Oxford, UK: Oxford University Press.DOI logoGoogle Scholar
Mellinger, Christopher D., and Thomas A. Hanson. 2016. Quantitative Research Methods in Translation and Interpreting Studies. London, UK: Routledge.DOI logoGoogle Scholar
Mirman, Daniel. 2014. Growth Curve Analysis and Visualization Using R. London UK: Chapman and Hall/CRC.Google Scholar
. 2017. Growth Curve Analysis [Online]. [URL] (accessed 19 April, 2018)
Mirman, Daniel, James A. Dixon, and James S. Magnuson. 2008. “Statistical and Computational Models of the Visual World Paradigm: Growth Curves and Individual Differences.” Journal of Memory and Language 59 (4): 475–494.DOI logoGoogle Scholar
Muñoz Martín, Ricardo. 2014. “A Blurred Snapshot of Advances in Translation Process Research.” In MonTI Special Issue – Minding Translation, ed. by Ricardo Muñoz Martín, 49–84. Alicante, Spain: Universidad de Alicante.Google Scholar
O’Brien, Sharon. 2006. “Eye-tracking and Translation Memory Matches.” Perspectives: Studies in Translatology 14 (3): 185–205.Google Scholar
. 2008. “Processing Fuzzy Matches in Translation Memory Tools: An Eye Tracking Analysis.” In Looking at Eyes: Eye‐Tracking Studies of Reading and Translation Processing, ed. by Susanne Göpferich, Inger M. Mees, and Arnt Lykke Jakobsen, 79–102. Frederiksberg: Samfundslitteratur.Google Scholar
. 2010. “Eye Tracking in Translation Process Research: Methodological Challenges and Solutions.” In Methodology, Technology and Innovation in Translation Process Research, ed. by Inger M. Mees, Fabio Alves, and Susanne Göpferich, 251–266. Frederiksberg: Samfundslitteratur.Google Scholar
Pavlović, Nataša, and Kristian T. H. Jensen. 2009. “Eye Tracking Translation Directionality.” In Translation Research Projects 2, ed. by Anthony Pym, and Alexander Perekrestenko, 93–109. Tarragona, Spain: Intercultural Studies Group.Google Scholar
Saldanha, Gabriela, and Sharon O’Brien. 2014. Research Methodologies in Translation Studies. London, UK: Routledge.DOI logoGoogle Scholar
Cited by (7)

Cited by seven other publications

Doherty, Stephen, Natalie Martschuk, Jane Goodman-Delahunty & Sandra Hale
2022. An Eye-Movement Analysis of Overt Visual Attention During Consecutive and Simultaneous Interpreting Modes in a Remotely Interpreted Investigative Interview. Frontiers in Psychology 13 DOI logo
Greco, Gian Maria, Anna Jankowska & Agnieszka Szarkowska
2022. Addressing methodological issues in experimental research in audiovisual translation. Translation Spaces 11:1 ► pp. 1 ff. DOI logo
Doherty, Stephen
2021. Introduction. Translation, Cognition & Behavior 4:2 ► pp. 244 ff. DOI logo
Walker, Callum
2021. Towards an Empirical Study of Literary Translation or Cognitive Translation Reception Studies. In An Eye-Tracking Study of Equivalent Effect in Translation, ► pp. 361 ff. DOI logo
Walker, Callum
2021. The Cognitive Paradigm in Translation Studies. In An Eye-Tracking Study of Equivalent Effect in Translation, ► pp. 13 ff. DOI logo
Wu, Zhiwei & Zhuojia Chen
2021. A systematic review of experimental research in audiovisual translation 1992–2020. Translation, Cognition & Behavior 4:2 ► pp. 281 ff. DOI logo
Lee, James F. & Stephen Doherty
2019. NATIVE AND NONNATIVE PROCESSING OF ACTIVE AND PASSIVE SENTENCES. Studies in Second Language Acquisition 41:04 ► pp. 853 ff. DOI logo

This list is based on CrossRef data as of 26 june 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.