Article published in:
The Language Testing Cycle: From inception to washbackEdited by Gillian Wigglesworth and Catherine Elder
[Australian Review of Applied Linguistics. Series S 13] 1996
► pp. 105–136
Specific-purpose language performance tests
Task and interaction
Tom Lumley | The University of Melbourne
Annie Brown | The University of Melbourne
Oral performance tests designed to assess candidates’ ability to function in a particular professional role typically involve role plays which simulate aspects of professional interaction between a candidate, in his/her professional role, and an interlocutor, in the role of client or consumer of the professional services. The validity of such tests is dependent both on the incorporation of appropriate content and on the extent to which the interaction between candidate and interlocutor simulates authentic professional interaction. Materials for such role plays are commonly produced according to specifications developed by language testers following consultation with professional informants, but there has been little investigation of how well tasks reflect their purpose (i.e. the aims/intentions of the professional experts). Test interlocutors, generally language teachers, normally undergo some form of training in the test administration procedure, but there has been little analysis of how well their behaviour reflects client behaviour.This paper reports on an investigation into the role which expert professional informants can play in providing post hoc content validation of tasks used in this kind of occupation-specific test, focusing on both the content of the tasks and the behaviour of the interlocutors. The study draws on data from the oral interaction component of an occupation-specific test, the Occupational English Test (McNamara 1996), a 4-skills test for overseas-trained health professionals (with attention in this study to nurses). The study involved a two-day workshop where representatives of the nursing profession, in conjunction with the researchers, analysed both written test materials and audiotaped test data, contributing to an analysis of the realism of the tasks and the features of interlocutor behaviour.
Published online: 01 January 1996
https://doi.org/10.1075/aralss.13.06lum
https://doi.org/10.1075/aralss.13.06lum
References
Bachman, L.F.
Brown, A.
Cafarella, C.
Cumming, A. and R. Berwick
Davies, A.D.
Davies, A.
Douglas, D.
forthcoming) Field-specific language testing. Unpublished manuscript.
Douglas, D. and L. Selinker
Elder, C.
Filipi, A.
Lazaraton, A. and N. Saville
(1994) Processes and outcomes in oral assessment. Paper presented at the Language Testing Research Colloquium, Washington, April.
McNamara, T.F.
McNamara, T.F. and T. Lumley
(1993) The effect of interlocutor and assessment mode variables in offshore assessments of speaking skills in occupational settings. Paper presented at the Fifteenth Language Testing Research Colloquium, University of Cambridge, August.
Morton, J., G. Wigglesworth and D. Williams
forthcoming) Approaches to the evaluation of interviewer behaviour in oral tests. In Wigglesworth, G. and G. Brindley eds access:: issues in English language test design and delivery Sydney NCELTR
O’Loughlin, K.
Ross, S.
Ross and Berwick
Wesche, M.B.
Wolf, L.F. and J.K. Smith
Cited by
Cited by 8 other publications
Brooks, Lindsay
Elder, Catherine & Alan Davies
Hamp-Lyons, Liz & Jane Lockwood
Harding, Luke, John Pill & Kerry Ryan
Kim, Hyejeong & Catherine Elder
Macqueen, Susy, John Pill & Ute Knoch
McNamara, T.F. & Tom Lumley
Woodward-Kron, Robyn & Catherine Elder
This list is based on CrossRef data as of 03 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.