Use of statistical methods in translation and interpreting research: A longitudinal quantitative analysis of eleven peer-reviewed journals (2000–2020)

Chao Han, Xiaolei Lu and Peixin Zhang
Abstract

The study reported on in the article examines the patterns and trends of statistical analysis in translation and interpreting (T&I) research, based on a longitudinal quantitative analysis of more than 3300 research articles sampled from eleven leading T&I journals (2000–2020). This evidence-based review is the first study to provide a systematic mapping of statistical methods used by T&I researchers. Our analyses suggest that (a) about 40% of the articles use statistics, and the use of statistics has been increasing over time; (b) the most frequently used inferential statistical techniques are the t-test, Pearson’s correlation, and chi-squared test; and (c) although the use of statistical methods has become increasingly diversified, about 90% of the methods used are basic-level statistics. We discuss these findings in relation to statistical teaching and learning for relevant stakeholders, especially T&I researchers.

Keywords:
Publication history
Table of contents

The past decades have witnessed an increase in the amount of quantitative data generated in translation and interpreting (T&I) research, a trend catalyzed by a number of interconnected factors. One notable driver behind this is the increasing sophistication of research designs in which multiple strands and/or phases of data are collected and integrated (e.g., parallel and sequential mixed-methods research) to examine complex and multifactorial T&I-related phenomena (Han 2018; Meister 2018). Another important driver relates to the fast-paced development of quantitatively oriented research such as corpus-based T&I studies (De Sutter and Lefer 2020), cognitive T&I studies (Muñoz Martín, Sun, and Li 2021), and other data-driven research such as testing and assessment of T&I (Han 2022) and quantitative surveys of T&I stakeholders (Mellinger and Hanson 2020). The third driver pertains to the growing use of sophisticated data-collection instruments, which has led to the increased complexity and availability of quantitative data. A case in point is the application of keylogging, eye tracking, brain imaging, and psychological testing to capture psycho-cognitive processes in cognitive T&I studies (Carl, Bangalore, and Schaeffer 2016). The last driver is the easier accessibility of powerful statistical programs (e.g., SPSS, R) that make data processing and analysis more flexible and less time-consuming (Mellinger and Hanson 2017). As a result of these interrelated factors, there seems to be greater frequency, diversity, and complexity in statistical analyses conducted to explore and understand quantitative data in T&I research.

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.

References

Balling, Laura Winther
2008 “A Brief Introduction to Regression Designs and Mixed-Effects Modelling by a Recent Convert.” Copenhagen Studies in Language 36: 175–192.Google Scholar
Balling, Laura Winther, and Kristian Tangsgaard Hvelplund
2015 “Design and Statistics in Quantitative Translation (Process) Research.” In Translation as a Cognitive Activity, edited by Fabio Alves, Amparo Hurtado Albir, and Isabel Lacruz, special issue of Translation Spaces 4 (1): 169–186. DOI logoGoogle Scholar
Blanca, María J., Rafael Alarcón, and Roser Bono
2018 “Current Practices in Data Analysis Procedures in Psychology: What Has Changed?Frontiers in Psychology 9: 2558. DOI logoGoogle Scholar
Carl, Michael, Srinivas Bangalore, and Moritz Schaeffer
eds. 2016New Directions in Empirical Translation Process Research: Exploring the CRITT TPR-DB. Cham: Springer. DOI logoGoogle Scholar
De Sutter, Gert, and Marie-Aude Lefer
2020 “On the Need for a New Research Agenda for Corpus-Based Translation Studies: A Multi-Methodological, Multifactorial and Interdisciplinary Approach.” Perspectives 28 (1): 1–23. DOI logoGoogle Scholar
Eyckmans, June, Philippe Anckaert, and Winibert Segers
2009 “The Perks of Norm-Referenced Translation Evaluation.” In Testing and Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and Practice, edited by Claudia V. Angelelli and Holly E. Jacobson, 73–93. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Field, Andy
2009Discovering Statistics Using SPSS. 3rd ed. Thousand Oaks: Sage.Google Scholar
Franco Aixelá, Javier
2001–2022BITRA – Bibliography of Interpreting and Translation. Open-access database. http://​dti​.ua​.es​/en​/bitra​/introduction​.html
Gile, Daniel
1998 “Observational Studies and Experimental Studies in the Investigation of Conference Interpreting.” Target 10 (1): 69–93. DOI logoGoogle Scholar
2009 “Interpreting Studies: A Critical View from within.” In A (Self-)Critical Perspective of Translation Theories, edited by Àfrica Vidal and Javier France, special issue of MonTI 1: 135–155. DOI logoGoogle Scholar
Gile, Daniel, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager
eds. 2001Getting Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for Beginners. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Goodwin, Laura D., and William L. Goodwin
1985 “Statistical Techniques in AERJ Articles, 1973–1983: The Preparation of Graduate Students to Read the Educational Research Literature.” Educational Researcher 14 (2): 5–11.Google Scholar
Han, Chao
2016 “Reporting Practices of Rater Reliability in Interpreting Research: A Mixed-Methods Review of 14 Journals (2004–2014).” In Mixed Methods, edited by Anna Kuznik and Joan Miquel Verd, special issue of Journal of Research Design and Statistics in Linguistics and Communication Science 3 (1): 49–75. DOI logoGoogle Scholar
2017 “Using Analytic Rating Scales to Assess English/Chinese Bi-Directional Interpreting: A Longitudinal Rasch Analysis of Scale Utility and Rater Behavior.” In Translator Quality – Translation Quality: Empirical Approaches to Assessment and Evaluation, edited by Geoffrey S. Koby and Isabel Lacruz, special issue of Linguistica Antverpiensia, New Series – Themes in Translation Studies 16: 196–215.Google Scholar
2018 “Mixed-Methods Research in Interpreting Studies: A Methodological Review (2004–2014).” Interpreting 20 (2): 155–187. DOI logoGoogle Scholar
2019 “A Generalizability Theory Study of Optimal Measurement Design for A Summative Assessment of English/Chinese Consecutive Interpreting.” Language Testing 36 (3): 419–438. DOI logoGoogle Scholar
2022 “Interpreting Testing and Assessment: A State-of-the-art Review.” Language Testing 39 (1): 30–55. DOI logoGoogle Scholar
Han, Chao, and Xiaoqi Shang
2023 “An Item-based, Rasch-Calibrated Approach to Assessing Translation Quality.” Target 35 (1): 63–96. DOI logoGoogle Scholar
Jenkins, Stephen J., Dale R. Fuqua, and Thomas C. Froehle
1984 “A Critical Examination of Use of Non-Parametric Statistics in the Journal of Counseling Psychology .” Perceptual and Motor Skills 59 (1): 31–35. DOI logoGoogle Scholar
Khany, Reza, and Khalil Tazik
2019 “Levels of Statistical Use in Applied Linguistics Research Articles: From 1986 to 2015.” Journal of Quantitative Linguistics 26 (1): 48–65. DOI logoGoogle Scholar
Larson-Hall, Jenifer
2015A Guide to Doing Statistics in Second Language Research Using SPSS and R. 2nd ed. New York: Routledge. DOI logoGoogle Scholar
Liu, Minhua
2011 “Methodology in Interpreting Studies: A Methodological Review of Evidence-Based Research.” In Advances in Interpreting Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 85–119. Amsterdam: Johan Benjamins. DOI logoGoogle Scholar
2016 “Putting the Horse before the Cart: Righting the Experimental Approach in Interpreting Studies.” In Addressing Methodological Challenges in Interpreting Studies Research, edited by Claudio Bendazzoli and Claudia Monacelli, 87–105. Newcastle upon Tyne: Cambridge Scholars.Google Scholar
Marco, Josep
2009 “Training Translation Researchers: An Approach Based on Models and Best Practice.” The Interpreter and Translator Trainer 3 (1): 13–35. DOI logoGoogle Scholar
Mason, Ian
2009 “Research Training in Translation Studies.” The Interpreter and Translator Trainer 3 (1): 1–12. DOI logoGoogle Scholar
Mead, Peter
2001 “Doctoral Work on Interpretation: A Supervisee’s Perspective.” In Getting Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for Beginners, edited by Daniel Gile, Helle V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, 121–144. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Meister, Lova
2018 “On Methodology: How Mixed Methods Research Can Contribute to Translation Studies.” Translation Studies 11 (1): 66–83. DOI logoGoogle Scholar
Mellinger, Christopher D., and Thomas A. Hanson
2017Quantitative Research Methods in Translation and Interpreting Studies. Abingdon: Routledge.Google Scholar
2019 “Meta-Analyses of Simultaneous Interpreting and Working Memory.” Interpreting 21 (2): 165–195. DOI logoGoogle Scholar
2020 “Methodological Considerations for Survey Research: Validity, Reliability, and Quantitative Analysis.” In Cognitive Translation Studies – Theoretical Models and Methodological Criticism, edited by Ricardo Muñoz Martín and Kairong Xiao, special issue of Linguistica Antverpiensia, New Series – Themes in Translation Studies 19: 172–190.Google Scholar
Muñoz Martín, Ricardo, Sanjun Sun, and Defeng Li
2021Advances in Cognitive Translation Studies. Singapore: Springer Nature. DOI logoGoogle Scholar
Oakes, Michael
2019 “Statistics for Corpus-Based and Corpus-Driven Approaches to Empirical Translation Studies.” In Advances in Empirical Translation Studies: Developing Translation Resources and Technologies, edited by Meng Ji and Michael Oakes, 28–52. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Oakes, Michael, and Meng Ji
2012Quantitative Methods in Corpus-Based Translation Studies: A Practical Guide to Descriptive Translation Research. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Olohan, Maeve, and Mona Baker
2009 “Coherence and Clarity of Objectives in Doctoral Projects: A Research Design Workshop.” The Interpreter and Translator Trainer 3 (1): 143–164. DOI logoGoogle Scholar
Page, Matthew J., Joanne E. McKenzie, Patrick M. Bossuyt, Isabelle Boutron, Tammy C. Hoffmann, Cynthia D. Mulrow, Larissa Shamseer et al.
2021 “The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews.” British Medical Journal 372 (71): 1–9.Google Scholar
Pöchhacker, Franz
2011 “Researching Interpreting: Approaches to Inquiry.” In Advances in Interpreting Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 5–25. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Pöchhacker, Franz, and Minhua Liu
2021 “Interpreting Research in Print: A Quarter-Century Update.” Interpreting 23 (1): 1–17. DOI logoGoogle Scholar
Saldanha, Gabriela, and Sharon O’Brien
2013Research Methodologies in Translation Studies. Manchester: St Jerome.Google Scholar
Schäffner, Christina
ed. 2004Translation Research and Interpreting Research: Traditions, Gaps and Synergies. Clevedon: Multilingual Matters. DOI logoGoogle Scholar
Shang, Xiaoqi, and Guixia Xie
2020 “Aptitude for Interpreting Revisited: Predictive Validity of Recall Across Languages.” In Remote Interpreting, edited by Mariachiara Russo, Emilia Iglesias Fernàndez, and Sabine Braun, special issue of The Interpreter and Translator Trainer 14 (3): 344–361. DOI logoGoogle Scholar
Zanettin, Federico, Gabriela Saldanha, and Sue-Ann Harding
2015 “Sketching Landscapes in Translation Studies: A Bibliographic Study.” In Bibliometric and Bibliographical Research in Translation Studies, edited by Sara Rovira-Esteva, Pilar Orero, and Javier Franco Aixelá, special issue of Perspectives 23 (2): 161–182. DOI logoGoogle Scholar