Article published in:
The Language Testing Cycle: From inception to washback
Edited by Gillian Wigglesworth and Catherine Elder
[Australian Review of Applied Linguistics. Series S 13] 1996
► pp. 188–207

Test interpretation, test use, and pedagogical implications

| University of Minnesota
Test score interpretation and use are the staple of construct validity. As such, in addition to the concern with measurement accuracy, it is imperative that the meaning of test scores and their intended use(s) be also documented. Along these lines, qualitative speech analyses are undertaken in the present paper to help in the interpretation of the dimensions underlying student performance on oral tasks. Results of these analyses yield rich information that explicate the meaning of the dimensions by delineating their specific features as manifested in the speech samples. Also discussed in the paper are the ramifications of these results for pedagogical use. Insights that linguistic accuracy and communicative skills in general, and their specific features specifically, provide for instructional material and activities are addressed. Furthermore, a case is made for curricular improvements to help learners develop well-rounded L2 abilities and to improve their use of the language for real-life communication. Finally, with regard to assessment, it is argued that generic assessment criteria do not reflect the critical features operating in a given context, and assessment practitioners are urged to study their contexts of use and to tailor their criteria according to the particulars of those contexts.
Published online: 01 January 1996
https://doi.org/10.1075/aralss.13.08cha
References
Al-Batal, M.
(1995) Issues in the teaching of the productive skills in Arabic. In M. Al-Batal (ed.) The Teaching of Arabic as a Foreign Language Provo, UT, American Association of Teachers of Arabic.Google Scholar
Alosh, M.
(1991) Arabic diglossia and its impact on teaching Arabic as a foreign language. In G. Ervin (ed.) International Perspectives on Foreign Language Teaching. Chicago, IL, National Textbook Company.Google Scholar
Alderson, C. & Clapham, C.
(1995) Assessing student performance in the ESL classroom. TESOL Quarterly, 291, 184–187. CrossrefGoogle Scholar
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education
(1985) Standards for Educational and Psychological Testing. Washington, DC, Author.Google Scholar
Anastasi, A.
(1986) Evolving concepts of test validation. Annual Review of Psychology, 371: 1–15. CrossrefGoogle Scholar
(1990) Ability testing in the 1980’s and beyond: Some major trends. Public Personnel Management, 181:471–485. CrossrefGoogle Scholar
Bachman, L.
(1990) Fundamental Considerations in Language Testing. Oxford, Oxford University Press.Google Scholar
Barnwell, D.
(1989) ‘Naive’ native speakers and judgements of oral proficiency in Spanish. Language Testing, 61:152–163. CrossrefGoogle Scholar
Belnap, K.
(1995) The institutional setting of Arabic language teaching: A survey of program coordinators and teachers of Arabic in U.S. institutions of higher learning. In M. Al-Batal (ed.) The Teaching of Arabic as a Foreign Language. Provo, UT, American Association of Teachers of Arabic.Google Scholar
Brown, A.
(1995) The effect of rater variables in the development of an occupation-specific language performance test. Language Testing, 121:1–15. CrossrefGoogle Scholar
Chalhoub-Deville, M.
forthcoming) Theoretical models, assessment frameworks, and test construction. Language Testing.
(1995a) Deriving oral assessment scales across different tests and rater groups. Language Testing, 121:16–33. CrossrefGoogle Scholar
(1995b) A contextualized approach to describing oral language proficiency. Language Learning, 451: 251–281. CrossrefGoogle Scholar
Douglas, D. & Chapelle, C.
(1993) In D. Douglas & C. Chapelle (Eds.), A New Decade of Language Testing Research. Alexandria VA, Teachers of English to Speakers of Other Languages Inc.Google Scholar
Elgibali, A. & Taha, Z.
(1995) Teaching Arabic as a foreign language: Challenges of the nineties. In M. Al-Batal (Ed.), The Teaching of Arabic as a Foreign Language. Provo UT, American Association of Teachers of Arabic.Google Scholar
Ellis, R.
(1995) Interpretation tasks for grammar teaching. TESOL Quarterly, 291: 87–105. CrossrefGoogle Scholar
Galloway, V.
(1980) Perceptions of the communicative efforts of American students of Spanish. Modern Language Journal, 641: 428–433. CrossrefGoogle Scholar
Guion, R.
(1980) On trinitarian doctrines of validity. Professional Psychology, 111:385–398. CrossrefGoogle Scholar
Hadden, B.
(1991) Teacher and non-teacher perceptions of second-language communication. Language Learning, 411, 1–24. CrossrefGoogle Scholar
Kramsch, C.
(1991) The order of discourse in language teaching. In B. Freed (ed.) Foreign Language Acquisition Research and the Classroom. Lexington MA, D. C. Heath and Company.Google Scholar
Ludwig, J.
(1982) Native-speaker judgments of second language learners’ efforts at communication: A review. Modern Language Journal, 661: 274–283. CrossrefGoogle Scholar
Messick, S.
(1975) The standard problem: Meaning and values in measurement and evaluation. American Psychologist, 301, 955–966. CrossrefGoogle Scholar
(1989) Validity. In R. L. Linn (ed.) Educational Measurement (3rd ed). New York, American Council on Education/Macmillan.Google Scholar
Moss, P.A.
(1992) Shifting conceptions of validity in educational measurement: Implications for performance assessment. Review of Educational Research, 621:229–58. CrossrefGoogle Scholar
National Council on Measurement in Education
(1995) Code of Professional Responsibilities in Educational Measurement. Washington, DC: Author.Google Scholar
Rutherford, W.
(1987) Second Language Grammar: Learning and Teaching. NY: Longman.Google Scholar
Ryding, K.
(1995) Discourse competence in TAFL: Skill levels and choice of language variety in the Arabic classroom. In M. Al-Batal (ed.) The Teaching of Arabic as a Foreign Language. Provo, UT, American Association of Teachers of Arabic.Google Scholar
Shepard, L. A.
(1993) Evaluating test validity. In L. Darling-Hammond (ed.) Review of research in education, 191. Washington, DC, American Educational Research Association. CrossrefGoogle Scholar
Taha, Z.
(1995) The grammar controversy: What to teach and why. In M. Al-Batal (ed.) The Teaching of Arabic as a Foreign Language. Provo, UT, American Association of Teachers of Arabic.Google Scholar
Younes, M.
(1995) An integrated curriculum for elementary Arabic. In M. Al-Batal (ed.) The Teaching of Arabic as a Foreign Language. Provo, UT, American Association of Teachers of Arabic.Google Scholar
Upshur, J. & Turner, C.
(March, 1995) Task, judge and scale effects in the rating of speaking ability of primary school ESL learners. Paper presented at the Annual Meeting of Language Testing Research Colloquium, Long Beach, CA.
Wesche, M.
(1992) Performance testing for work-related second language assessment. In E. Shohamy & R. Walton (eds) Language Assessment for Feedback: Testing and Other Strategies. Dubuque, IA: Kendall/Hunt Publishing Company.Google Scholar