The French CAT
An assessment of its empirical validity
This paper investigates the empirical validity of the Monash-Melbourne computer adaptive test for French (French CAT), a single parameter Rasch model measurement of underlying morphosyntactic proficiency. It focuses, in particular, on the accuracy of the French CAT as a tool for streaming incoming university students into three levels of a first year (post high school) French course. Psychometric ability estimations of the Rasch model are compared against instructors’ assessment of students’ overall linguistic competence. A comparison is also made between the theoretical confidence interval of predicted abilities and the actual distribution of testee scores. Finally, individual student French CAT scores are correlated with end-of-semester language examination results. In all instances, Item Response Theory, upon which the French CAT is based, is shown to provide a highly valid means of determining linguistic ability for the purposes of course placement. Moreover, given the significant correlation between initial streaming and end-of-semester results, the French CAT is also demonstrated to be a good predictor of short-term achievement.
Published online: 01 January 1995
Burston, J., M. Monville-Burston and J. Harfouch
(1994) Comparison of evaluation measures in first year students’ placement. Paper presented at the Second Conference of the Australian Society of French Studies Conference, Melbourne, 12–14 July 1994.
Burston J. and M. Monville-Burston
forthcoming) Practical design and implementation considerations of a computer-adaptive foreign language test: the Monash/Melbourne French CAT. CALICO Journal.
Hambleton, R. K. and L. L. Cook
Hatch, E. and A. Lazaraton
Lord, F. M.
Lunz, M. E. and B. A. Bergstrom
Lunz, M. E., J. A. Stahl, and B. A. Bergstrom
(1993) Targeting, test length, test precision and decision accuracy for computerized adaptive tests. Paper presented at the annual meeting of the American Educational Research Association, Atlanta, April 1993.
Traub, R. E. and R. G. Wolfe
Weiss, D. J.
Weiss, D. J. and G. G. Kinsbury