Shorter than a text, longer than a sentence: Source text length for ecologically valid translation experiments

Arndt Heilmann, Tatiana Serbina, Daniel Couto Vale and Stella Neumann

This paper investigates what effect the length of the source text has both on the translation process and on the translation product. In an eye-tracking and keystroke logging experiment, we compared three conditions, namely full texts, three-sentence sequences and single sentences as source items. The results suggest that translations of single sentences differ significantly from full texts, whereas three-sentence sequences are representative of the full text condition. Therefore, research in process-based translation studies might benefit from using shorter source texts without endangering the ecological validity of experiments.

Publication history
Table of contents

Process-based translation studies, the branch of empirical translation studies that is concerned with investigating the actual process of translating from language A into language B and specifically with how cognitive factors affect the outcome of this process, is riddled with methodological problems. One of the most important insights into translation is that it operates on text as a unit rather than on individual words or sentences – even if most of the time the actual translation is partitioned into smaller units (see Alves 2003 on the translation unit). This is in line with language-theoretical claims about text as the unit of meaning (Halliday and Hasan 1976). Alves and Couto Vale (2011), for instance, discuss translators’ patterns of modifying parts of an unfolding translation based on their linguistic decisions elsewhere in a text – rather than in a sentence. Such patterns also underline the role cohesion plays for the translator. Dragsted and Hansen (2008) report early identification of translation problems by translators long before they actually translate a challenging source text element. This, in turn, corroborates the holistic character of translating, which consists of an orientation phase, during which possible translation problems are identified, the drafting phase, during which the translation is drafted, and the revision phase, during which the drafted target text is reviewed (e.g., Jakobsen 2002; Carl, Dragsted, and Jakobsen 2011).

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.


Alves, Fabio
2003Triangulating Translation: Perspectives in Process Oriented Research. Amsterdam: Benjamins. DOI logoGoogle Scholar
Alves, Fabio, and Daniel Couto Vale
2009 “Probing the Unit of Translation in Time: Aspects of the Design and Development of a Web Application for Storing, Annotating, and Querying Translation Process Data.” Across Languages and Cultures 10 (2): 251–273. DOI logoGoogle Scholar
2011 “On Drafting and Revision in Translation: A Corpus Linguistics Oriented Analysis of Translation Process Data.” Translation: Computation, Corpora, Cognition 1: 105–122.Google Scholar
Alves, Fabio, Adriana Pagano, and Igor da Silva
2014 “Effortful Text Production in Translation: A Study of Grammatical (De)metaphorization Drawing on Product and Process Data.” Translation and Interpreting Studies 9 (1): 25–51. DOI logoGoogle Scholar
Alves, Fabio, Adriana Pagano, Stella Neumann, Erich Steiner, and Silvia Hansen-Schirra
2010 “Translation Units and Grammatical Shifts: Towards an Integration of Product- and Process-based Translation Research.” In Translation and Cognition, edited by Gregory Shreve and Erik Angelone, 109–142. Amsterdam: Benjamins. DOI logoGoogle Scholar
Bates, Douglas, Martin Maechler, Ben Bolker, and Steve Walker
2015 “Fitting Linear Mixed-Effects Models Using lme4.” Journal of Statistical Software 67 (1): 1–48. DOI logoGoogle Scholar
Benjamini, Yoav, and Yosef Hochberg
1995 “Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing.” Journal of the Royal Statistical Society 57 (1): 289–300.Google Scholar
Bursac, Zoran, C. Heath Gauss, David Keith Williams, and David W. Hosmer
2008 “Purposeful Selection of Variables in Logistic Regression.” Source Code for Biology and Medicine 3 (17). http://​www​.scfbm​.org​/content​/3​/1​/17. DOI logo
Camblin, C. C., Peter C. Gordon, and Tamara Y. Swaab
2007 “The Interplay of Discourse Congruence and Lexical Association during Sentence Processing: Evidence from ERPs and Eye Tracking.” Journal of Memory and Language 56: 103–128. DOI logoGoogle Scholar
Carl, Michael
2012 “Translog – II: A Program for Recording User Activity Data for Empirical Reading and Writing Research.” In Proceedings of the Eight International Conference on Language Resources and Evaluation, 4108–4112.Google Scholar
Carl, Michael, Srinivas Bangalore, and Moritz Schaeffer
eds. 2016New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB. Cham: Springer. DOI logoGoogle Scholar
Carl, Michael, Barbara Dragsted, and Arnt L. Jakobsen
2011 “A Taxonomy of Human Translation Styles.” Translation Journal 16 (2). http://​translationjournal​.net​/journal​/56taxonomy​.htm
Chesterman, Andrew
2011 “Reflections on the Literal Translation Hypothesis.” In Methods and Strategies of Process Research: Integrative Approaches in Translation Studies, edited by Cecilia Alvstad, Adelina Hild and Elisabet Tiselius, 23–35. Amsterdam: Benjamins. DOI logoGoogle Scholar
Couto Vale, Daniel
2017 “What Does a Translator Do When Not Writing?” In Empirical Modelling of Translation and Interpreting, edited by Silvia Hansen-Schirra, Oliver Czulo, and Sascha Hoffmann, 177–208. Berlin: Language Science Press.Google Scholar
da Silva, Igor
2012(Des)compactação de significados e esforço cognitivo no processo tradutório: Um estudo da metáfora grammatical na construção do texto traduzido. PhD thesis Federal University of Minas Gerais.Google Scholar
Davies, Mark
2004- BYU-BNC. (Based on the British National Corpus from Oxford University Press). http://​corpus​.byu​.edu​/bnc/
Dragsted, Barbara
2005 “Segmentation in Translation: Differences across Levels of Expertise and Difficulty.” Target 17 (1): 49–70. DOI logoGoogle Scholar
Dragsted, Barbara, and Inge G. Hansen
2008 “Comprehension and Production in Translation: A Pilot Study on Segmentation and the Coordination of Reading and Writing Processes.” In Looking at Eyes: Eye-Tracking Studies of Reading and Translation Processing, edited by Susanne Göpferich, Arnt L. Jakobsen, and Inger M. Mees, 9–29. Copenhagen: Samfundslitteratur.Google Scholar
Efron, Bradley
2010 “Correlated z-Values and the Accuracy of Large-Scale Statistical Estimates.” Journal of the American Statistical Association 105 (491): 1042–1055. DOI logoGoogle Scholar
Englund Dimitrova, Birgitta
2005Expertise and Explicitation in the Translation Process. Amsterdam: Benjamins. DOI logoGoogle Scholar
Halliday, Michael A. K., and Ruqaiya Hasan
1976Cohesion in English. London: Longman.Google Scholar
Halliday, Michael A. K.
2001 “Literacy and Linguistics: Relationships between Spoken and Written Language.” In Analysing English in a Global Context, edited by Anne Burns and Caroline Coffin, 181–193. London: Routledge.Google Scholar
Halverson, Sandra
2015 “Cognitive Translation Studies and the Merging of Empirical Paradigms: The Case of ‘Literal Translation’.” Translation Spaces 4 (2): 310–340. DOI logoGoogle Scholar
Hansen-Schirra, Silvia, Jean Nitzke, and Katharina Oster
2017 “Predicting Cognate Translation.” In Empirical Modelling of Translation and Interpreting, edited by Silvia Hansen-Schirra, Oliver Czulo, and Sascha Hoffmann, 3–22. Berlin: Language Science Press.Google Scholar
Holmqvist, Kenneth, Marcus Nyström, Richard Andersson, Richard Dewhurst, Halszka Jarodzka, and Joost Van de Weijer
2011Eye Tracking: A Comprehensive Guide to Methods and Measures. Oxford: Oxford University Press.Google Scholar
Jakobsen, Arnt L.
1999 “Logging Target Text Production with Translog.” In Probing the Process in Translation Methods and Results, edited by Gyde Hansen, 9–20. Copenhagen: Samfundslitteratur.Google Scholar
2002 “Orientation, Segmentation, and Revision in Translation.” In Empirical Translation Studies: Process and Product, edited by Gyde Hansen, 191–204. Copenhagen: Samfundslitteratur.Google Scholar
Kruger, Haidee, and Bertus van Rooy
2016 “Syntactic and Pragmatic Transfer Effects in Reported-Speech Constructions in Three Contact Varieties of English Influenced by Afrikaans.” Language Sciences 56: 118–131. DOI logoGoogle Scholar
Kuznetsova, Alexandra, Per B. Brockhoff, and Rune H. B. Christensen
2016lmerTest: Tests in Linear Mixed Effects Models: R package. https://​CRAN​.Rproject​.org​/package​=lmerTest
Mauranen, Anna
2004 “Corpora, Universals and Interference.” In Translation Universals: Do They Exist? edited by Anna Mauranen and Pekka Kujamäki, 65–82. Amsterdam: Benjamins. DOI logoGoogle Scholar
McNamee, Roseanne
2005 ”Regression Modelling and Other Methods to Control Confounding.” Occupational and Environmental Medicine 62 (7): 500–506. DOI logoGoogle Scholar
Mougeon, Raymond, Terry Nadasdi, and Katherine Rehner
2005 “Contact-Induced Linguistic Innovations on the Continuum of Language Use: The Case of French in Ontario.” Bilingualism: Language and Cognition 8 (2): 99–115. DOI logoGoogle Scholar
Neumann, Stella, Adriana Pagano, Fabio Alves, Pirita Pyykkönen, and Igor da Silva
2010 “Targeting (De-)metaphorization: Process-Based Insights.” The 22nd ESFCW, Koper, Slovenija, July 2010.Google Scholar
O’Brien, Sharon
2009 “Eye Tracking in Translation Process Research: Methodological Challenges and Solutions.” In Methodology, Technology and Innovation in Translation Process Research: A Tribute to Arnt Lykke Jakobsen, edited by Inger M. Mees, Fabio Alves, and Susanne Göpferich, 251–266. Copenhagen: Samfundslitteratur.Google Scholar
O’Donnell, Michael
2003RSTTool: An RST Markup Tool. http://​www​.wagsoft​.com​/RSTTool
Pyykkönen, Pirita, and Juhani Järvikivi
2010 “Activation and Persistence of Implicit Causality Information in Spoken Language Comprehension.” Experimental Psychology 57 (1): 5–16. DOI logoGoogle Scholar
R Core Team
2017R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing. http://​www​.R​-project​.org/
Radach, Ralph, Lynn Huestegge, and Ronan Reilly
2008 “The Role of Global Top-Down Factors in Local Eye-Movement Control in Reading.” Psychological Research 72 (6): 675–688. DOI logoGoogle Scholar
Rautenberg, Rosa
2011(De-)Metaphorization in English-German Translation: A Quantitative Analysis of a Keystroke-Logging Experiment. State examination thesis RWTH Aachen University.Google Scholar
Schaeffer, Moritz, and Michael Carl
2014 “Measuring the Cognitive Effort of Literal Translation Processes.” In Workshop on Humans and Computer-Assisted Translation, 29–37.Google Scholar
Stamenov, Maxim I., Alexander Gerganov, and Ivo D. Popivanov
2010 “Prompting Cognates in the Bilingual Lexicon: Optimizing Access during Translation.” In Translation and Cognition, edited by Gregory Shreve and Erik Angelone, 323–347. Amsterdam: Benjamins. DOI logoGoogle Scholar
Teich, Elke
2003Cross-linguistic Variation in System and Text: A Methodology for the Investigation of Translations and Comparable Texts. Berlin: de Gruyter. DOI logoGoogle Scholar
Tirkkonen-Condit, Sonja
2005 “The Monitor Model Revisited: Evidence from Process Research.” Meta 50 (2): 405–414. DOI logoGoogle Scholar
Toury, Gideon
2012Descriptive Translation Studies – and Beyond. Amsterdam: Benjamins. DOI logoGoogle Scholar