Article published In:
Australian Review of Applied LinguisticsVol. 34:1 (2011) ► pp.40–59
Evaluating locally-developed language testing
A predictive study of ‘direct entry’ language programs at an Australian University
The study reported here investigates the predictive validity of language assessments by ‘Direct Entry’ programs at an Australian University – programs developed on site for Non English Speaking Background international students, principally to provide (i) pre-entry academic and language preparation and (ii) language assessment for university admissions purposes. All 138 students in the sample had entered degree studies via one of the three programs that made up the locally-developed Direct Entry pathway. Inferential statistics (correlation and regression) showed the assessments awarded by two programs to satisfactorily predict academic outcomes, while predictive validity for one was not demonstrated. Descriptive statistics (mean pass rates and academic averages) then revealed a pattern of relatively poor academic performance in certain university disciplines to which particular Direct Entry programs were dedicated. Informed by principles of language program evaluation, the study’s outcomes were seen as both summative and formative: remedial strategies are accordingly recommended. While the specific relevance of the study’s findings is to the particular institutional context in which the study was conducted, the study instantiates a perspective on language assessment validation of broader relevance in an Australian context where locally-developed Direct Entry programs – about which the research literature is largely silent – are increasingly widespread.
Keywords: language tests, test validity and reliability, English for academic purposes, Australia, higher education, academic achievement
Available under the Creative Commons Attribution-NonCommercial (CC BY-NC) 4.0 license.
For any use beyond this license, please contact the publisher at [email protected].
References (25)
Alderson, J., Clapham, C. & Wall, D. (1995). Language test construction and evaluation. Cambridge: CUP.
Bachman, L. (1990). Fundamental considerations in language testing. Oxford: OUP.
Bellingham, L. (1993). The relationship of language proficiency to academic success of international students. New Zealand Journal of Educational Studies, 30(2), 229–232.
Black, J. (1991). Performance in English skills courses and overall academic achievement. TESL Canada Journal, 9(1), 42–53. 
Burns, R. (1997). Introduction to research methods. Melbourne: Longman.
Cotton, F. & Conrow, F. (1995). An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. IELTS Research Reports (Vol. 11). Canberra: IELTS Australia.
Dooey, P. & Oliver, R. (2002). An investigation into the predictive validity of the IELTS test as an indicator of future academic success. Prospect, 17(1), 36–54.
Elder, C. (1993). Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Applied Linguistics, 2(1), 68–85.
Feast, V. (2002). The impact of IELTS scores on performance at university. International Education Journal, 3(4), 70–85.
Ferguson, G. & White, E. (1998). A predictive study of IELTS. Institute for Applied Language Studies, University of Edinburgh.
Graham, J. (1987). English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505–521.
Hale, G., Stansfield, C. & Duran, R. (1984). Summaries of studies involving the Test of English as a Foreign Language, 1963—1982 (Report no. RR-84-03, TOEFL-RR-16). Princeton, N. J.: Educational Testing Service.
Hill, K., Storch, N. & Lynch, B. (1999). A comparison of IELTS and TOEFL as predictors of academic performance. IELTS Research Reports (Vol. 21). Canberra: IELTS Australia.
Huong, T. (2001). The predictive validity of the International English Language Testing System (IELTS) test. Post-Script, 2(1), 66–94.
Ingram, D. & Bayliss, A. (2007). IELTS as a predictor of academic language performance, Part 1. IELTS Research Reports (Vol. 71). Canberra: IELTS Australia.
Kerstjens, M. & Nery, C. (2000). Predictive validity in the IELTS test: A study of the relationship between IELTS scores and students’ subsequent academic performance. IELTS Research Reports (Vol. 31). Canberra: IELTS Australia.
Lynch, B. (1996). Language program evaluation: Theory and practice. Cambridge: Cambridge University Press.
Lynch, T. (1994). The University of Edinburgh Test of English at Matriculation: Validation report. Edinburgh Working Papers in Applied Linguistics, No. 51. Scotland: Edinburgh University.
(2000). An evaluation of the revised Test of English at Matriculation at the University of Edinburgh. Edinburgh Working Papers in Applied Linguistics, 101, 61–71.
Macquarie University. (2002). Macquarie University handbook of undergraduate studies. Sydney: Macquarie University.
McGovern, P. & Walsh, S. (Eds.). (2007) IELTS research reports (Vol. 71). Canberra: IELTS Australia.
Tulloh, R. (Ed.). (1999). IELTS research reports (Vol. 21). Canberra: IELTS Australia.
(Ed.). (2000). IELTS research reports (Vol. 31). Canberra: IELTS Australia.
Wood, S. (Ed.). (1998). IELTS research reports (Vol. 11). Sydney: ELICOS Association.
Woodrow, L. (2006). Academic success of international postgraduate education students and the role of English proficiency. University of Sydney Papers in TESOL, 11, 51–70.
Cited by (2)
Cited by two other publications
O'Dwyer, John, Elif Kantarcıoğlu & Carole Thomas
2018. An Investigation of the Predictive Validity of the TOEFL iBT® Test at an English‐Medium University in Turkey. ETS Research Report Series 2018:1 ► pp. 1 ff. 
Oliver, Rhonda, Honglin Chen & Stephen Moore
2016. Review of selected research in applied linguistics published in Australia (2008–2014). Language Teaching 49:4 ► pp. 513 ff.
This list is based on CrossRef data as of 4 august 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.