Use of statistical methods in translation and interpreting research: A longitudinal quantitative analysis of eleven peer-reviewed journals (2000–2020)
ChaoHan,XiaoleiLu and PeixinZhang
Xiamen University
Abstract
The study reported on in the article examines the patterns and trends of statistical analysis in translation and
interpreting (T&I) research, based on a longitudinal quantitative analysis of more than 3300 research articles sampled from
eleven leading T&I journals (2000–2020). This evidence-based review is the first study to provide a systematic mapping of
statistical methods used by T&I researchers. Our analyses suggest that (a) about 40% of the articles use statistics, and the
use of statistics has been increasing over time; (b) the most frequently used inferential statistical techniques are the
t-test, Pearson’s correlation, and chi-squared test; and (c) although the use of statistical methods has
become increasingly diversified, about 90% of the methods used are basic-level statistics. We discuss these findings in relation
to statistical teaching and learning for relevant stakeholders, especially T&I researchers.
The past decades have witnessed an increase in the amount of quantitative data generated in translation and interpreting
(T&I) research, a trend catalyzed by a number of interconnected factors. One notable driver behind this is the increasing
sophistication of research designs in which multiple strands and/or phases of data are collected and integrated (e.g., parallel and
sequential mixed-methods research) to examine complex and multifactorial T&I-related phenomena (Han 2018; Meister 2018). Another important driver relates to the
fast-paced development of quantitatively oriented research such as corpus-based T&I studies (De Sutter and Lefer 2020), cognitive T&I studies (Muñoz Martín, Sun, and Li
2021), and other data-driven research such as testing and assessment of T&I (Han
2022) and quantitative surveys of T&I stakeholders (Mellinger and Hanson
2020). The third driver pertains to the growing use of sophisticated data-collection instruments, which has led to the
increased complexity and availability of quantitative data. A case in point is the application of keylogging, eye tracking, brain
imaging, and psychological testing to capture psycho-cognitive processes in cognitive T&I studies (Carl, Bangalore, and Schaeffer 2016). The last driver is the easier accessibility of powerful statistical
programs (e.g., SPSS, R) that make data processing and analysis more flexible and less time-consuming (Mellinger and Hanson 2017). As a result of these interrelated factors, there seems to be greater frequency,
diversity, and complexity in statistical analyses conducted to explore and understand quantitative data in T&I research.
References
Balling, Laura
Winther
2008 “A Brief Introduction to
Regression Designs and Mixed-Effects Modelling by a Recent Convert.” Copenhagen Studies in
Language 36: 175–192.
Balling, Laura
Winther, and Kristian
Tangsgaard Hvelplund
2015 “Design
and Statistics in Quantitative Translation (Process)
Research.” In Translation as a Cognitive
Activity, edited by Fabio Alves, Amparo
Hurtado Albir, and Isabel Lacruz, special
issue of Translation
Spaces 4 (1): 169–186.
Blanca, María
J., Rafael Alarcón, and Roser Bono
2018 “Current
Practices in Data Analysis Procedures in Psychology: What Has Changed?” Frontiers in
Psychology 9: 2558.
Carl, Michael, Srinivas Bangalore, and Moritz Schaeffer
eds.2016New
Directions in Empirical Translation Process Research: Exploring the CRITT
TPR-DB. Cham: Springer.
De
Sutter, Gert, and Marie-Aude Lefer
2020 “On
the Need for a New Research Agenda for Corpus-Based Translation Studies: A Multi-Methodological, Multifactorial and
Interdisciplinary
Approach.” Perspectives 28 (1): 1–23.
Eyckmans, June, Philippe Anckaert, and Winibert Segers
2009 “The
Perks of Norm-Referenced Translation Evaluation.” In Testing and
Assessment in Translation and Interpreting Studies: A Call for Dialogue between Research and
Practice, edited by Claudia
V. Angelelli and Holly
E. Jacobson, 73–93. Amsterdam: John
Benjamins.
Field, Andy
2009Discovering
Statistics Using SPSS. 3rd ed. Thousand
Oaks: Sage.
1998 “Observational
Studies and Experimental Studies in the Investigation of Conference
Interpreting.” Target 10 (1): 69–93.
Gile, Daniel
2009 “Interpreting
Studies: A Critical View from within.” In A (Self-)Critical
Perspective of Translation Theories, edited by Àfrica Vidal and Javier France, special
issue
of MonTI 1: 135–155.
Gile, Daniel, Helle
V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager
eds.2001Getting
Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for
Beginners. Amsterdam: John
Benjamins.
Goodwin, Laura
D., and William
L. Goodwin
1985 “Statistical
Techniques in AERJ Articles, 1973–1983: The Preparation of Graduate Students to Read the Educational Research
Literature.” Educational
Researcher 14 (2): 5–11.
Han, Chao
2016 “Reporting
Practices of Rater Reliability in Interpreting Research: A Mixed-Methods Review of 14 Journals
(2004–2014).” In Mixed Methods, edited
by Anna Kuznik and Joan
Miquel Verd, special issue
of Journal of Research Design and Statistics in Linguistics and Communication
Science 3 (1): 49–75.
Han, Chao
2017 “Using
Analytic Rating Scales to Assess English/Chinese Bi-Directional Interpreting: A Longitudinal Rasch Analysis of Scale Utility
and Rater Behavior.” In Translator Quality – Translation Quality:
Empirical Approaches to Assessment and Evaluation, edited by Geoffrey
S. Koby and Isabel Lacruz, special
issue of Linguistica Antverpiensia, New Series – Themes in Translation
Studies 16: 196–215.
Han, Chao
2018 “Mixed-Methods
Research in Interpreting Studies: A Methodological Review
(2004–2014).” Interpreting 20 (2): 155–187.
Han, Chao
2019 “A
Generalizability Theory Study of Optimal Measurement Design for A Summative Assessment of English/Chinese Consecutive
Interpreting.” Language
Testing 36 (3): 419–438.
Han, Chao
2022 “Interpreting
Testing and Assessment: A State-of-the-art Review.” Language
Testing 39 (1): 30–55.
Jenkins, Stephen
J., Dale
R. Fuqua, and Thomas
C. Froehle
1984 “A
Critical Examination of Use of Non-Parametric Statistics in the Journal of Counseling
Psychology.” Perceptual and Motor
Skills 59 (1): 31–35.
Khany, Reza, and Khalil Tazik
2019 “Levels
of Statistical Use in Applied Linguistics Research Articles: From 1986 to 2015.” Journal of
Quantitative
Linguistics 26 (1): 48–65.
Larson-Hall, Jenifer
2015A
Guide to Doing Statistics in Second Language Research Using SPSS and R. 2nd
ed. New
York: Routledge.
Liu, Minhua
2011 “Methodology
in Interpreting Studies: A Methodological Review of Evidence-Based
Research.” In Advances in Interpreting Research: Inquiry in
Action, edited by Brenda Nicodemus and Laurie Swabey, 85–119. Amsterdam: Johan
Benjamins.
Liu, Minhua
2016 “Putting
the Horse before the Cart: Righting the Experimental Approach in Interpreting
Studies.” In Addressing Methodological Challenges in Interpreting
Studies Research, edited by Claudio Bendazzoli and Claudia Monacelli, 87–105. Newcastle
upon Tyne: Cambridge Scholars.
Marco, Josep
2009 “Training
Translation Researchers: An Approach Based on Models and Best Practice.” The Interpreter and
Translator
Trainer 3 (1): 13–35.
Mason, Ian
2009 “Research
Training in Translation Studies.” The Interpreter and Translator
Trainer 3 (1): 1–12.
Mead, Peter
2001 “Doctoral
Work on Interpretation: A Supervisee’s Perspective.” In Getting
Started in Interpreting Research: Methodological Reflections, Personal Accounts and Advice for
Beginners, edited by Daniel Gile, Helle
V. Dam, Friedel Dubslaff, Bodil Martinsen, and Anne Schjoldager, 121–144. Amsterdam: John
Benjamins.
Meister, Lova
2018 “On
Methodology: How Mixed Methods Research Can Contribute to Translation Studies.” Translation
Studies 11 (1): 66–83.
Mellinger, Christopher
D., and Thomas
A. Hanson
2017Quantitative
Research Methods in Translation and Interpreting
Studies. Abingdon: Routledge.
Mellinger, Christopher
D., and Thomas
A. Hanson
2019 “Meta-Analyses
of Simultaneous Interpreting and Working
Memory.” Interpreting 21 (2): 165–195.
Mellinger, Christopher
D., and Thomas
A. Hanson
2020 “Methodological
Considerations for Survey Research: Validity, Reliability, and Quantitative
Analysis.” In Cognitive Translation Studies – Theoretical Models and
Methodological Criticism, edited by Ricardo
Muñoz Martín and Kairong Xiao, special
issue of Linguistica Antverpiensia, New Series – Themes in Translation
Studies 19: 172–190.
Muñoz
Martín, Ricardo, Sanjun Sun, and Defeng Li
2021Advances
in Cognitive Translation Studies. Singapore: Springer
Nature.
Oakes, Michael
2019 “Statistics
for Corpus-Based and Corpus-Driven Approaches to Empirical Translation
Studies.” In Advances in Empirical Translation Studies: Developing
Translation Resources and Technologies, edited by Meng Ji and Michael Oakes, 28–52. Cambridge: Cambridge
University Press.
Oakes, Michael, and Meng Ji
2012Quantitative
Methods in Corpus-Based Translation Studies: A Practical Guide to Descriptive Translation
Research. Amsterdam: John
Benjamins.
Olohan, Maeve, and Mona Baker
2009 “Coherence
and Clarity of Objectives in Doctoral Projects: A Research Design Workshop.” The Interpreter
and Translator
Trainer 3 (1): 143–164.
Page, Matthew
J., Joanne
E. McKenzie, Patrick
M. Bossuyt, Isabelle Boutron, Tammy
C. Hoffmann, Cynthia
D. Mulrow, Larissa Shamseeret al.
2021 “The
PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews.” British Medical
Journal 372 (71): 1–9.
Pöchhacker, Franz
2011 “Researching
Interpreting: Approaches to Inquiry.” In Advances in Interpreting
Research: Inquiry in Action, edited by Brenda Nicodemus and Laurie Swabey, 5–25. Amsterdam: John
Benjamins.
Pöchhacker, Franz, and Minhua Liu
2021 “Interpreting
Research in Print: A Quarter-Century
Update.” Interpreting 23 (1): 1–17.
Saldanha, Gabriela, and Sharon O’Brien
2013Research
Methodologies in Translation Studies. Manchester: St
Jerome.
Schäffner, Christina
ed.2004Translation
Research and Interpreting Research: Traditions, Gaps and
Synergies. Clevedon: Multilingual
Matters.
Shang, Xiaoqi, and Guixia Xie
2020 “Aptitude
for Interpreting Revisited: Predictive Validity of Recall Across
Languages.” In Remote Interpreting, edited
by Mariachiara Russo, Emilia
Iglesias Fernàndez, and Sabine Braun, special
issue of The Interpreter and Translator
Trainer 14 (3): 344–361.
Zanettin, Federico, Gabriela Saldanha, and Sue-Ann Harding
2015 “Sketching
Landscapes in Translation Studies: A Bibliographic
Study.” In Bibliometric and Bibliographical Research in Translation
Studies, edited by Sara Rovira-Esteva, Pilar Orero, and Javier
Franco Aixelá, special issue
of Perspectives 23 (2): 161–182.