Loanword proportion in vocabulary size tests
Does it make a difference?
We investigated the effect of English-Hebrew loanwords on English vocabulary test scores when the number of loanwords in the test is random and when it is representative of their proportion in the vocabulary lists from which the test items were taken. 303 EFL learners, speakers of Hebrew as L1, at three L2 proficiency levels, received tests with no loanwords, with a representative number of loanwords and with a random number of loanwords in four modalities: word form recall, word meaning recall, word form recognition, word meaning recognition. Though different effects were found for different modalities and different language proficiencies, the score increases from the representative loanword test version to the random loanword version were low and the effect sizes of the differences were very low. We suggest that the inclusion of loanwords in vocabulary tests may not inflate the true vocabulary knowledge score.
Article outline
- 1.Introduction
- 2.The study
- 2.1Research aim and questions
- 2.2Participants
- 2.3Instruments, procedure and data analysis
- The original – the ‘random number of loanwords’ version
- The ‘non loanword’ test version
- The ‘representative number of loanwords’ version
- 3.Results
- 4.Discussion
- 5.Concluding remarks
- Notes
-
References
References
Aviad-Levitzky, T., Laufer, B., & Goldstein, Z.
In preparation).
A new test of computer adaptive test of size and strength (CATSS): A validation study.
Cobb, T.
(
2000)
One size fits all? Francophone learners and English vocabulary tests.
Canadian Modern Language Review, 571, 295–324.


Cobb. T. Lextutor
Retrieved from
[URL] ‘ongoing unpublished development work’
Coxhead, A.
(
2000),
A New Academic Word List.
TESOL Quarterly, 34(2) 213–238.


Daulton, F. E.
(
2008)
Japan’s built-in lexicon of English-based loanwords. Clevedon: Multilingual Matters

Elgort, I.
(
2013)
Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test.
Language Testing, 30(2) 253–272.


Jordan, E.
(
2012)
Cognates in vocabulary size testing – A distorting influence? Language Testing in Asia, 2(3), 5–17.


Laufer, B., & Nation, P.
(
1999)
A vocabulary-size test of controlled productive ability.
Language Testing, 16(1), 33–51.


Laufer, B., & Goldstein, Z.
(
2004)
Testing vocabulary knowledge: Size, strength, and computer adaptiveness.
Language Learning, 541, 469–52.


Laufer, B., Elder, C., Hill, K., & Congdon, P.
(
2004)
Size and strength: Do we need both to measure vocabulary knowledge? Language Testing, 211, 202–226.


Laufer, B., & McLean, S.
(
2016)
Loanwords and vocabulary size test scores: A case of different estimates for different L1 learners.
Language Assessment Quarterly, 13(3), 202–2177.


McLean, S., Hogg, N., & Kramer, B.
(
2014)
Estimations of Japanese university learners’ English vocabulary sizes using the vocabulary size test.
Vocabulary Learning and Instruction, 3(2), 47–55.


McLean, S., Kramer, B., & Beglar, D.
(
2015)
The creation and validation of a listening vocabulary levels test.
Language Teaching Research, 19(6), 741–760.


McLean, S., & Kramer, B.
(
2016)
The development of a Japanese bilingual version of the New Vocabulary Levels Test.
VERB, 5(1), 2–5.

Nation, I. S. P.
(
1983)
Testing and teaching vocabulary.
Guidelines, 51, 12–25.

Nation, I. S. P., & Beglar, D.
(
2007)
A vocabulary size test.
The Language Teacher, 311, 9–13

Schmitt, N., Schmitt, D. & Clapham, C.
(
2001)
Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test.
Language Testing, 18(1), 55–88.


Webb, S., Sasao, Y., & Ballance, O.
(
2017)
The updated Vocabulary Levels Test: Developing and validating two new forms of the VLT.
ITL – International Journal of Applied Linguistics, 168(1), 34–70. Available on
[URL].
Cited by
Cited by 10 other publications
B. Silva, Breno
2022.
The Importance of General and Academic Vocabulary Learning. In
Writing to Learn Academic Words [
Second Language Learning and Teaching, ],
► pp. 1 ff.

Noreillie, Ann-Sophie, Britta Kestemont, Kris Heylen, Piet Desmet & Elke Peters
Otwinowska, Agnieszka, Małgorzata Foryś‐Nogala, Weronika Kobosko & Jakub Szewczyk
2020.
Learning Orthographic Cognates and Non‐Cognates in the Classroom: Does Awareness of Cross‐Linguistic Similarity Matter?.
Language Learning 70:3
► pp. 685 ff.

Peters, Elke
Peters, Elke, Tom Velghe & Tinne Van Rompaey
2019.
The VocabLab tests.
ITL - International Journal of Applied Linguistics 170:1
► pp. 53 ff.

Silva, Breno B. & Agnieszka Otwinowska
2019.
VST as a reliable academic placement tool despite cognate inflation effects.
English for Specific Purposes 54
► pp. 35 ff.

Snoder, Per & Batia Laufer
2022.
EFL Learners' Receptive Knowledge of Derived Words: The Case of Swedish Adolescents.
TESOL Quarterly 56:4
► pp. 1242 ff.

Zeng, Yuntao, Qiuxia Lu, Matthew P. Wallace, Yawei Guo, Chun-Wai Fan & Xiaofei Chen
2022.
Understanding Sustainable Development of English Vocabulary Acquisition: Evidence from Chinese EFL Learners.
Sustainability 14:11
► pp. 6532 ff.

[no author supplied]
This list is based on CrossRef data as of 22 march 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.