Test validation in interpreter certification performance testing
An argument-based approach
Over the past decade, interpreter certification performance testing has gained momentum. Certification tests often involve high stakes, since they can play an important role in regulating access to professional practice and serve to provide a measure of professional competence for end users. The decision to award certification is based on inferences from candidates’ test scores about their knowledge, skills and abilities, as well as their interpreting performance in a given target domain. To justify the appropriateness of score-based inferences and actions, test developers need to provide evidence that the test is valid and reliable through a process of test validation. However, there is little evidence that test qualities are systematically evaluated in interpreter certification testing. In an attempt to address this problem, this paper proposes a theoretical argument-based validation framework for interpreter certification performance tests so as to guide testers in carrying out systematic validation research. Before presenting the framework, validity theory is reviewed, and an examination of the argument-based approach to validation is provided. A validity argument for interpreter tests is then proposed, with hypothesized validity evidence. Examples of evidence are drawn from relevant empirical work, where available. Gaps in the available evidence are highlighted and suggestions for research are made.
Keywords: performance testing, argument-based approach, interpreter certification, validity argument, validation, validity
Published online: 01 November 2016
Al-Khanji, R., El-Shiyab, S. & Hussein, R.
ALTA Language Services
(2007) Study of California’s court interpreter certification and registration testing. http://www.courts.ca.gov/documents/altafinalreport.pdf (accessed 10 June 2015).
American Psychological Association, American Educational Research Association, & National Council on Measurement in Education
Arocha, I.S. & Joyce, L.
Bachman, L.F. & Palmer, A.S.
Bachman, L.F., Davidson, F. & Milanovic, M.
Bond, T.G. & Fox, C.M.
Campbell, S. & Hale, S.
Cardinet, J., Johnson, S. & Pini, G.
Certification Commission for Healthcare Interpreters
(2010) Job task analysis study and results. http://www.cchicertification.org/images/webinars/cchi%20jta%20report-public.pdf (accessed 22 May 2015).
Chain News Service
(2013) 全国翻译资格考试报考人数近5万 入围中大型考试. [CATTI becomes one of large and medium-scale tests in China, with nearly 50,0000 registered candidates]. http://www.chinanews.com/edu/2013/01-09/4474762.shtml?flashget_edu_jsp (accessed 10 June 2015).
Chapelle, C.A., Enright, M.E. & Jamieson, J.
Christoffels, I.K., De Groot, A.M.B. & Waldorp, L.J.
Cronbach, L.J. & Meehl, P.E.
Crooks, T.J., Kane, M.T. & Cohen, A.S.
Darò, V., Lambert, S. & Fabbro, F.
Dawrant, A., & Jiang, H.
(2001) Conference interpreting in Mainland China. Communicate! http://www.aiic.net/ViewPage.cfm?page_id=365 (accessed 10 June 2015).
De Groot, A.M.B.
Fulcher, G., Davidson, F. & Kemp, J.
(2013) EU member states country profiles: The current state of affairs in Europe. http://www.qualitas-project.eu/sites/qualitas-project.eu/files/Leaflet.pdf (accessed 10 June 2015).
Hale, S., Garcia, I., Hlavac, J., Kim, M., Lai, M., Turner, B. & Slatyer, H.
(2012) Development of a conceptual overview for a new model for NAATI standards, testing and assessment. Sydney, Australia. http://www.naati.com.au/PDF/INT/INTFinalReport.pdf (accessed 22 May 2015).
Jacobs, E.A., Lauderdale, D.S., Meltzer, D., Shorey, J.M., Levinson, W. & Thisted, R.A.
Kane, M.T., Crooks, T. & Cohen, A.
Lissitz, R.W. & Samuelsen, K.
MacCorquodale, K. & Meehl, P.E.
Meuleman, C. & Van Besien, F.
Mislevy, R.J., Almond, R.G. & Lukas, J.
(2004) A brief introduction to evidence-centered design (CSE Technical Report 632). http://www.cresst.org/reports/r632.pdf (accessed 10 June 2015).
Mislevy, R.J., Steinberg, L.S. & Almond, R.G.
Office of China Accreditation Tests for Translators and Interpreters
PSI Services LLC
(2010) Development and validation of oral and written examinations for medical interpreter certification: Technical report. Burbank, California, USA. http://www.certifiedmedicalinterpreters.org//sites/default/files/oral-and-written-medical-interpreter-technical-report-final.pdf (accessed 22 May 2015).
(2013) Development and validation of oral examinations for Medical Interpreter Certification: Mandarin, Russian, Cantonese, Korean, and Vietnamese forms. http://www.certifiedmedicalinterpreters.org/sites/default/files/tech-report-development-validation-language-forms.pdf (accessed 22 May 2015).
Ra, S. & Napier, J.
(2006) Certification of health care interpreters in the United States: A primer, a status report and considerations for national certification. Los Angeles, CA. http://www.calendow.org/uploadedFiles/certification_of_health_care_interpretors.pdf (accessed 22 May 2015).
Russell, D. & Malcolm, K.
Schumacker, R. & Lomax, R.G.
Shavelson, R.J., Baxter, G.P. & Gao, X.
Slatyer, H., Elder, C., Hargreaves, M. & Luo, K.
Turner, B., Lai, M. & Huang, N.
Vermeiren, H., Gucht, J.V. & De Bontridder, L.
(2009) Standards as critical success factors in assessments: Certifying social interpreters in Flanders, Belgium. In C.V. Angelelli & H.E. Jacobson (Eds.), Testing and assessment in translation and interpreting studies: A call for dialogue between research and practice. Amsterdam: John Benjamins, 291–330.
Xie, Q. & Andrews, S.
(2005) T&I labor market in China. Sydney, Australia. http://www.ling.mq.edu.au/translation/lmtip_china.htm (accessed 22 May 2015).
Cited by 5 other publications
This list is based on CrossRef data as of 29 august 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.