Article In:
ITL - International Journal of Applied Linguistics: Online-First Articles

Academic and general language proficiency in post-entry language assessment

Linguistic predictors of domestic L1 student achievement in the first year of university education

ORCID logo | KU Leuven,
In higher education systems with no or low entry requirements for domestic students, post-entry language assessments (PELAs) are often used to detect at-risk students. This study investigates how two language proficiency measures relate to students’ academic achievement: an academic reading and vocabulary (ARV) screening test, and the computer test of the Interuniversitaire Taaltest Nederlands voor Anderstaligen (ITNA), a Dutch L2-entrance test. The ARV screening test, ITNA and its language in use subtest show moderate to weak correlations with achievement. While the ARV screening test selects a large potential at-risk group; the few students failing the ITNA, language in use or scoring lower than ‘very good’ on language in use have a higher risk of underperforming. When controlling for students’ background variables, only academic language proficiency remains a significant predictor. While academic language proficiency seems more appropriate as a PELA construct, general language proficiency may identify a small, but high-risk group.
Keywords: post-entry language assessment, predictive validity, first-year university students, academic language proficiency, general language proficiency
Article outline
  • Introduction
  • Language proficiency and academic achievement
  • Data and methods
    • Participants and background variables
    • Language measures
  • Analyses
  • Results
  • Discussion
  • Limitations
  • Conclusion
  • Acknowledgements
  • References
This content is being prepared for publication; it may be subject to changes.
References (86)
References
Angoff, W. H., & Sharon, A. T. (1971). A comparison of scores earned on the Test of English as a Foreign Language by native American college students and foreign applicants to U.S. colleges. TESOL Quarterly, 5 (2), 129–136. DOI logoGoogle Scholar
Bridgeman, B., Cho, Y., & DiPietro, S. (2016). Predicting grades from an English language assessment: The importance of peeling the onion. Language Testing, 33 (3), 307–318. DOI logoGoogle Scholar
Cho, Y., & Bridgeman, B. (2012). Relationship of TOEFL iBT® scores to academic performance: Some evidence from American universities. Language Testing, 29 (3), 421–442. DOI logoGoogle Scholar
Clark, J. L. (1977). The performance of native speakers of English on the Test of English as a Foreign Language. TOEFL Research Reports, 1.Google Scholar
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (second edition). Lawrence Erlbaum Associates.Google Scholar
Cotton, F., & Conrow, F. (1998). An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. In S. Wood (Ed.), IELTS Research Reports (Vol.11). ELICOS.Google Scholar
Council of Europe. (2001). Common European Framework of Reference for Languages: Learning, teaching, assessment. Strasbourg, France: Council of Europe.Google Scholar
Dąbrowska, E. (2012). Different speakers, different grammars. Individual differences in native language attainment. Linguistic Approaches to Bilingualism, 2 (3), 219–253. DOI logoGoogle Scholar
(2019). Experience, aptitude and individual differences in linguistic attainment: A comparison of native and nonnative speakers. Language Learning, 69 (1), 72–100. DOI logoGoogle Scholar
de Koning, B., Loyens, S., Rikers, E., Smeets, G., & van der Molen, H. (2012). Generation Psy: Student characteristics and academic achievement in a three-year problem-based learning bachelor program. Learning and Individual Differences, 22 (3), 313–323. DOI logoGoogle Scholar
De Moor, A., & Colpaert, T. (2019). Taal telt: Taalscreening in het eerste jaar hoger onderwijs om studiesucces te bevorderen. [Language matters: language proficiency screening in the first year of higher education to improve study success]. In D. Berckmoes, P. Bonne, J. Heeren, M. Leuridan, I. Mestdagh & J. Vrijders (Eds.), Taalbeleid en taalondersteuning: Wat werkt? (pp. 267–275). Lannoo.Google Scholar
Department of Education and Training (2008). Education in Flanders. A broad view of the Flemish educational landscape. Brussels: Agency for Educational Communication.Google Scholar
De Wachter, L., & Heeren, J. (2013). Een taaltest als signaal. De ontwikkeling en implementatie van een strategische taalvaardigheidstoets aan de KU Leuven. [A language test as a signal: the development and implementation of a strategic language proficiency test at the KU Leuven]. Levende Talen Tijdschrift, 14 (1), 19–27.Google Scholar
De Wachter, L., Heeren, J., Marx, S., & Huyghe, S. (2013). Taal: een noodzakelijke, maar niet de enige voorwaarde tot studiesucces. De correlatie tussen de resultaten van een taalvaardigheidstoets en de slaagcijfers bij eerstejaarsstudenten aan de KU Leuven. [Language proficiency: A necessary, but not the only precondition for study success. The correlation between language test results and achievement of first-year students at the KU Leuven]. Levende Talen Tijdschrift, 14 (4), 28–36.Google Scholar
Deygers, B., Peters, E., & Van Den Branden, K. (2017). Checking assumed proficiency: Comparing L1 and L2 performance on a university entrance test. Assessing Writing, 32 1, 43–56. DOI logoGoogle Scholar
Deygers, B., Zeidler, B., Vilcu, D., & B., Carlsen, C. H. (2018). One framework to unite them all? Use of the CEFR in European university entrance policies, Language Assessment Quarterly, 15 (1), 3–15. DOI logoGoogle Scholar
Dooey, P., & Oliver, R. (2002). An investigation into the predictive validity of the IELTS test as an indicator of future academic success. Prospect, 17 1, 36–54.Google Scholar
Dunn, P. K. & Smyth, G. K. (2018). Generalized linear models with examples in R. Springer. DOI logoGoogle Scholar
Elder, C. (1993). Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Language Testing, 2 (1), 68–85.Google Scholar
(2017). Language assessment in higher education. In E. Shohamy, I. Or, & S. May (Eds.), Language testing and assessment. Encyclopedia of language and education (pp. 271–286). Springer. DOI logoGoogle Scholar
Elder, C., Bright, C., & Bennet, S. (2007). The role of language proficiency in academic success: Perspectives from a New Zealand university. Melbourne Papers in Language Testing, 12 (1), 24–58.Google Scholar
Feast, V. (2002). The impact of IELTS scores on performance at university. International Education Journal, 31, 70–85.Google Scholar
Ferguson, G., & White, E. (1998). A small-scale study of predictive validity. Melbourne Papers in Language Testing, 7 (2), 15–63.Google Scholar
Field, A., Miles, J., & Field, Z. (2012). Discovering statistics using R. Sage.Google Scholar
Fonteyne, L., De Fruyt, F., Dewulf, N., Duyck, W., Erauw, K., Goeminne, K., … & Rosseel, Y. (2015). Basic mathematics test predicts statistics achievement and overall first year academic success. European Journal of Psychology of Education, 30 (1), 95–118. DOI logoGoogle Scholar
Fouché, I., Van Dyk, T., & Butler, G. (2017). An “enlightening course that empowers first years”?: A holistic assessment of the impact of a first-year academic literacy course. Journal of English for Academic Purposes, 27 1, 14–30. DOI logoGoogle Scholar
Fox, J. (2015). Applied regression analysis and generalized linear models. Sage.Google Scholar
Gagen, T. & Faez, F. (2023). The predictive validity of IELTS scores: a meta-analysis. Higher Education Research & Development, 1–16.Google Scholar
Gilin, E., Heeren, J., & De Wachter, L. (2021). Een taalvaardigheidstest voor anderstaligen voorgelegd aan leerlingen in het Nederlandstalig middelbaar onderwijs: Een onverwacht effect? [A language proficiency test for non-native speakers presented to students in Dutch-speaking secondary education: An unexpected effect?]. Internationale Neerlandistiek, 59 (2), 99–113. DOI logoGoogle Scholar
Ginther, A., & Yan, X. (2018). Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, policy, and profiles. Language Testing, 35 (2), 271–295. DOI logoGoogle Scholar
Glorieux, I., Laurijssen, I., & Sobczyk, O. (2015). Studiesucces in het eerste jaar hoger onderwijs in Vlaanderen. Een analyse van de impact van kenmerken van studenten en van opleidingen. [Study success in the first year of higher education in Flanders. An analysis of the impact of the characteristics of students and study programs]. Steunpunt SSL.Google Scholar
Graham, J. G. (1987). English language proficiency and the prediction of academic success. TESOL Quarterly, 21 (3), 505–521. DOI logoGoogle Scholar
Hamilton, J., Lopes, M., McNamara, T., & Sheridan, E. (1993). Rating scales and native speaker performance on a communicatively oriented EAP test. Language Testing, 10 (3), 337–353. DOI logoGoogle Scholar
Harrell, F. E., Jr. (2024). Hmisc: Harrell Miscellaneous (version 5.1–3). [URL]
Harsch, C., Ushioda, E., & Ladroue, C. (2017). Investigating the predictive validity of TOEFL iBT® test scores and their use in informing policy in a United Kingdom university setting. ETS Research Report Series, 2017(1), 1–80.Google Scholar
Heeren, J. (2021). Academic language proficiency as a predictor of academic achievement. A validity argument of a low-stakes post-entry academic reading and vocabulary screening test for first-year university students [Unpublished doctoral dissertation]. KU Leuven.
Heeren, J., Deygers, B., Speelman, D., & De Wachter, L. (2021c). Halen we de norm? De scores van moedertaalsprekers op een talige toegangstest voor anderstaligen aan de universiteit. [Do we meet the standard? The scores of native speakers on a language proficiency test for non-native speakers at the university]. Levende Talen Tijdschrift, 22 (1), 3–13.Google Scholar
Heeren, J., Speelman, D., & De Wachter, L. (2021a). A practical academic reading and vocabulary screening test as a predictor of achievement in first-year university students: Implications for test purpose and use. International Journal of Bilingual Education and Bilingualism, 24 (10), 1458–1473. DOI logoGoogle Scholar
(2021b). Bepaalt taal wie het haalt? De samenhang tussen een academische taalvaardigheidscreening en het behalen van een bachelordiploma aan de universiteit. [Does language proficiency determine who makes it? The relation between an academic language proficiency screening test and obtaining a Bachelor’s degree at the university]. Tijdschrift voor Hoger Onderwijs, 39 (1), 39–54. DOI logoGoogle Scholar
(2021d). Post-entry language assessment in higher education: ensuring fairness by including the voice of the test-taker. Collated Papers for the ALTE 7th International Conference, Madrid (pp. 45–48). ALTE.Google Scholar
Hill, K., Storch, N., & Lynch, B. (1999). A comparison of IELTS and TOEFL as predictors of academic success. In R. Tulloh (Ed.), IELTS research reports 2 1 (pp.53–63). IELTS Australia.Google Scholar
Hulstijn, J. H. (2011). Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8 (3), 229–249. DOI logoGoogle Scholar
(2019). An individual-differences framework for comparing nonnative with native speakers: Perspectives from BLC theory. Language Learning, 691, 157–183. DOI logoGoogle Scholar
Hyland, K. (2006). English for academic purposes. Routledge. DOI logoGoogle Scholar
(2016). General and specific EAP. In K. Hyland & P. Shaw (Eds.). The Routledge handbook of English for academic purposes (pp. 17–29). Routledge. DOI logoGoogle Scholar
Ihlenfeldt, S. D., & Rios, J. A. (2023). A meta-analysis on the predictive validity of English language proficiency assessments for college admissions. Language Testing, 40 (2), 276–299. DOI logoGoogle Scholar
Interuniversity Testing Consortium (2020). Testonderdelen: B2 [Test components: B2], retrieved from [URL] on 28 January 2020.
Johnson, D. C. (1977). The TOEFL and domestic students: Conclusively inappropriate. TESOL Quarterly, 11 (1), 79–86. DOI logoGoogle Scholar
Kerstjens, K., & Nery, C. (2000). Predictive validity in the IELTS test. In R. Tulloh (Ed.), IELTS research reports (Vol. 31) (pp. 85–108). IELTS.Google Scholar
Kidd, E., Donnely, S., & Christiansen, M. H. (2018). Individual differences in language acquisition and processing. Trends in Cognitive Sciences, 22 (2), 154–169. DOI logoGoogle Scholar
Knoch, U., & Elder, C. (2013). A framework for validating post-entry language assessments (PELAs). Papers in Language Testing and Assessment, 2(2), pp. 48–66. DOI logoGoogle Scholar
Krausz, J., Schiff, A., Schiff, J., Hise, J. V. (2005). The impact of TOEFL scores on placement and performance of international students in the initial graduate accounting class. Accounting Education, 14(1), 103–111. DOI logoGoogle Scholar
Kuiken, F., & Vedder, I. (2021). The interplay between academic writing abilities of Dutch undergraduate students, a remedial writing programme, and academic achievement. International Journal of Bilingual Education and Bilingualism, 24 (10), 1474–1485. DOI logoGoogle Scholar
KU Leuven (2021). Cumulative study efficiency (CSE). [URL]
Lacante, M., De Metsenaere, M., Lens, W., Van Esbroeck, R., De Jaeger, K., De Conick, T., … & Santy, L. (2001). Drop-out in het hoger onderwijs: Onderzoek naar de achtergronden en motieven van drop-out in het eerste jaar hoger onderwijs. [Drop out in higher education: Research into the backgrounds and motives of drop out in higher education]. Vrije Universiteit Brussel/ Katholieke Universiteit Leuven.Google Scholar
Lee, Y. J., & Greene, J. (2007). The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1 (4), 366–389. DOI logoGoogle Scholar
McNamara, T., & Ryan, K. (2011). Fairness versus justice in language testing: The place of English literacy in the Australian Citizenship Test. Language Assessment Quarterly, 8 (2), 161–178. DOI logoGoogle Scholar
Milton, J., & Treffers-Daller, J. (2013). Vocabulary size revisited: the link between vocabulary size and academic achievement. Applied Linguistics Review, 4 (1), 151–172. DOI logoGoogle Scholar
Mol, S. E., & Bus, A. G. (2011). To read or not to read: a meta-analysis of print exposure from infancy to early adulthood. Psychological Bulletin, 137(2), 267–96. DOI logoGoogle Scholar
Mulder, K., & Hulstijn, J. H. (2011). Linguistic skills of adult native speakers as a function of age and level of education. Applied Linguistics, 32 (5), 475–494. DOI logoGoogle Scholar
O’Dwyer, J., Kantarcıoğlu, E., & Thomas, C. (2018). An investigation of the predictive validity of the TOEFL iBT® test at an English-medium university in Turkey. ETS Research Report Series, 2018(1), 1–13. DOI logoGoogle Scholar
Peters, E., Van Houtven, T., & El Morabit, Z. (2010). Is meten echt meer weten? Taalvaardigheid van instromende studenten in het hoger onderwijs in kaart gebracht. [Is to measure really to know? Charting the language proficiency of incoming students in higher education]. In E. Peters & T. Van Houtven (red.), Taalbeleid in het hoger onderwijs: de hype voorbij? (pp. 51–66). Acco.Google Scholar
R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.Google Scholar
Read, J. (2000). Assessing Vocabulary. Cambridge University Press. DOI logoGoogle Scholar
(2015). Assessing English proficiency for university study. Palgrave Macmillan. DOI logoGoogle Scholar
(2016). Some key issues in post-admission language assessment. In J. Read (Ed.), Post-admission language assessment (pp. 3–20). Springer. DOI logoGoogle Scholar
Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students’ academic performance: a systematic review and meta-analysis. Psychological Bulletin, 138 (2), 353. DOI logoGoogle Scholar
Rizopoulos, D. (2006). ltm: An R package for latent variable modelling and item response theory analyses, Journal of Statistical Software, 17 (5), 1–25. DOI logoGoogle Scholar
Schleppegrell, M. J. (2001). Linguistic features of the language of schooling. Linguistics and Education, 12 (4), 431–459. DOI logoGoogle Scholar
Schoepp, K. (2018). Predictive validity of the IELTS in an English as a medium of instruction environment. Higher Education Quarterly, 72 (4), 271–285. DOI logoGoogle Scholar
Sirin, S. R. (2005). Socioeconomic status and academic achievement: a meta-analytic review of research. Review of Educational Research, 75 (3), 417–453. DOI logoGoogle Scholar
Snow, C. E. (2010). Academic language and the challenge of reading for learning about science. Science, 328 1, 450–452. DOI logoGoogle Scholar
Stricker, L. J. (2004). The performance of native speakers of English and ESL speakers on the computer-based TOEFL and GRE General Test. Language Testing, 21 (2), 146–173. DOI logoGoogle Scholar
Trenkic, D., & Warmington, M. (2019). Language and literacy skills of home and international university students: How different are they, and does it matter? Bilingualism: Language and Cognition, 22 (2), 349–365. DOI logoGoogle Scholar
Vandervieren, E., & Casteleyn, J. (2020). De relatie tussen taalcompetentie, numerieke geletterdheid en academisch studiesucces: Een verkennende studie. [The relation between language proficiency, numeric literacy and academic achievement: an exploratory study]. Pedagogische Studiën, 97 (2), 76–95.Google Scholar
Van Dyk, T. (2015). Tried and tested: Academic literacy tests as predictors of academic success. Tijdschrift voor Taalbeheersing, 37 (2), 159–186. DOI logoGoogle Scholar
Van Houtven, T., Peters, E., & El Morabit, Z. (2010). Hoe staat het met de taal van studenten? Exploratieve studie naar begrijpend lezen en samenvatten bij instromende studenten in het Vlaamse hoger onderwijs. [What is the state of students’ language proficiency? An explorative study into reading comprehension and summary writing in starting students in Flemish higher education]. Levende Talen Tijdschrift, 11 (3), 29–44.Google Scholar
van Kalsbeek, A., & Kuiken, F. (2014). Academisch taalgebruik in het Nederlandse wetenschappelijk onderwijs: Stand van zaken en blik op de toekomst. [Academic language use in Dutch scientific education: state of affairs and future developments]. Internationale Neerlandistiek, 52 (3), 221–236. DOI logoGoogle Scholar
van Rooij, E., Brouwer, J., Fokkens-Bruinsma, M., Jansen, E., Donche, V., & Noyens, D. (2017). A systematic review of factors related to first-year students’ success in Dutch and Flemish higher education. Pedagogische Studiën, 94 (5), 360–405.Google Scholar
Van Soom, C., & Donche, V. (2014). Profiling first-year students in STEM programs based on autonomous motivation and academic self-concept and relationship with academic achievement. PloS one, 9 (11), e112489. DOI logoGoogle Scholar
Verlinde, S., & Peeters, G. (2012). Data access revisited: The Interactive Language Toolbox. In S. Granger & M. Paquot (Eds.), Electronic lexicography. Oxford university press. DOI logoGoogle Scholar
Vinke, A. A., & Jochems, W. M. G. (1993). English proficiency and academic success in international postgraduate education. Higher education, 26 (3), 275–285. DOI logoGoogle Scholar
Weir, C. J. (2005). Language testing and validation. Palgrave McMillan. DOI logoGoogle Scholar
Willems, J., Noyens, D., Coertjens, L., Van Petegem, P., & Donche, V. (2018). Studiesucces voorspellen in het eerste jaar hoger onderwijs: een kwestie van wikken en wegen? [Predicting achievement in the first year of higher education: a matter of careful consideration?] In F. Glastra, & D. van Middelkoop (Eds.), Studiesucces in het hoger onderwijs: Van rendement naar maatschappelijke relevantie. Edubron.Google Scholar