Cover not available
Part of
Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 115–136

Phraseological complexity in EFL learners’ spoken production across proficiency levels

| UCLouvain
| Lancaster University
| Lancaster University
| UCLouvain

This study explores phraseological complexity in English as a Foreign Language (EFL) learners’ spoken production across proficiency levels in the Trinity Lancaster Corpus. Phraseological diversity and sophistication are operationalized as root type-token ratios and median mutual information scores of verb + object co-occurrences respectively. Results draw a complex picture of phraseological complexity in EFL learners’ oral performance, with phraseological diversity increasing on the whole and phraseological sophistication decreasing significantly from B1 to B2. These findings can at least partly be explained by the fact that, unlike EFL learners at B1, EFL learners at B2 and above repeat fewer combinations and use more specific vocabulary, which sometimes leads to less idiomatic combinations that should nevertheless be considered as traces of qualitative development.

Keywords: phraseological complexity, EFL learner speech, proficiency, pointwise mutual information
Article outline
  • 1.Introduction
  • 2.Method
    • 2.1Learner data
    • 2.2Data preparation: Co-occurrence extraction and analysis
    • 2.3Statistical evaluation
  • 3.Results
  • 4.Discussion
  • 5.Conclusion
  • Acknowledgements
  • Notes
  • References
Published online: 1 December 2022
DOI logo
https://doi.org/10.1075/scl.104.05paq
References
Ackermann, Kristen & Chen, Yu-Hua
2013 Developing the Academic Collocation List (ACL): A corpus-driven and expert-judged approach. Journal of English for Academic Purposes 12(4): 235–247. DOI logoGoogle Scholar
Alexopoulou, Theodora, Michel, Marije, Murakami, Akira & Meurers, Detmar
2017 Task effects on linguistic complexity and accuracy: A large-scale learner corpus analysis employing natural language processing techniques. Language Learning 67(S1): 180–208. DOI logoGoogle Scholar
Barton, Kamil
2020 MuMIn: Multi-Model Inference. R package version 1.43.17. [URL] (20 December 2021).
Biber, Douglas, & Gray, Bethany
2013 Discourse characteristics of writing and speaking task types on the TOEFL iBT® test : A lexico-grammatical analysis. ETS Research Report Series 2013(1): i–128. DOI logoGoogle Scholar
Biber Douglas, Johansson, Stig, Leech, Geoffrey, Conrad, Susan & Finegan, Edward
1999 Longman Grammar of Spoken and Written English. Harlow: Longman. Also published as Biber, Douglas, Johansson, Stig, Leech, Geoffrey, Conrad, Susan, & Finegan, Edward 2021 Grammar of Spoken and Written English. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Brezina, Vaclav & Fox, Lorrae
2021 Adjective + noun collocations in L2 and L1 speech: Evidence from the Trinity Lancaster Corpus and the spoken BNC2014. In Perspectives on the Second Language Phrasicon: The View from Learner Corpora, Sylviane Granger (ed.), 152–177. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Bulté, Bram & Housen, Alex
2012 Defining and operationalising L2 complexity. In Dimensions of L2 Performance and Proficiency: Complexity, Accuracy and Fluency in SLA [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 23–46. Amsterdam: John Benjamins. DOI logoGoogle Scholar
De Marneffe, Marie-Catherine & Manning, Christopher D.
2013 Stanford Typed Dependencies Manual. [URL] (30 April 2021).
Eguchi, Masaki & Kyle, Kristopher
2020 Continuing to explore the multidimensional nature of lexical sophistication: The case of oral proficiency interviews. The Modern Language Journal 104(2): 381–400. DOI logoGoogle Scholar
Ellis, Rod & Yuan, Fangyuan
2005 The effects of careful within-task planning on oral and written task performance. In Planning and Task Performance in a Second Language, Rod Ellis (ed.), 167–192. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Fox, John & Weisberg, Sanford
2019 An R Companion to Applied Regression (3rd edn). Thousand Oaks CA: Sage. [URL] (20 December 2021).
Gablasova, Dana, Brezina, Vaclav & McEnery, Tony
2017 Collocations in corpus-based language learning research: Identifying, comparing, and interpreting the evidence. Language Learning 67(S1): 155–179. DOI logoGoogle Scholar
2019 The Trinity Lancaster Corpus: Development, description and application. International Journal of Learner Corpus Research 5(2): 126–158. DOI logoGoogle Scholar
Granger, Sylviane
1998 Prefabricated patterns in advanced EFL writing: Collocations and formulae. In Phraseology: Theory, Analysis and Applications, Anthony Cowie (ed.), 145–160. Oxford: OUP.Google Scholar
Granger, Sylviane & Bestgen, Yves
2017 Using collgrams to assess L2 phraseological development: A replication study. In Language, Learners and Levels: Progression and Variation, Pieter de Haan, Rina de Vries & Sanne van Vuuren (eds), 385–408. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar
Granger, Sylviane & Paquot, Magali
2008 Disentangling the phraseological web. In Phraseology: An Interdisciplinary Perspective, Sylviane Granger & Fanny Meunier (eds), 27–49. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Gries, Stefan T.
2018 On over- and underuse in learner corpus research and multifactoriality in corpus linguistics more generally. Journal of Second Language Studies 1(2): 277–309. DOI logoGoogle Scholar
2019 Priming of syntactic alternations by learners of English: An analysis of sentence-completion and collostructional results. In Using Corpus Methods to Triangulate Linguistic Analysis, Jesse Egbert & Paul Baker (eds), 219–238. New York NY: Routledge. DOI logoGoogle Scholar
Hanks, Patrick
2013 Lexical Analysis: Norms and Exploitations. Cambridge MA: The MIT Press. DOI logoGoogle Scholar
Jones, Christian, Byrne, Shelley & Halenko, Nicola
2017 Successful Spoken English: Findings from Learner Corpora. New York NY: Routledge. DOI logoGoogle Scholar
Kilgarriff, Adam, Baisa, Vít, Bušta, Jan, Jakubíček, Miloš, Kovář, Vojtěch, Michelfeit, Jan, Rychlý, Pavel & Suchomel, Vít
2014 The Sketch Engine: Ten years on. Lexicography 1: 7–36. DOI logoGoogle Scholar
Kormos, Judit
2014 Speech Production and Second Language Acquisition. New York NY: Routledge. DOI logoGoogle Scholar
Kuznetsova, Alexandra, Brockhoff, Per B., Christensen, Rune H. B.
2017 lmerTest Package: Tests in Linear Mixed Effects Models. Journal of Statistical Software 82(13): 1–26. DOI logoGoogle Scholar
Kyle, Kristopher & Crossley, Scott
2015 Automatically assessing lexical sophistication: Indices, tools, findings, and application. TESOL Quarterly 49(4): 757–786. DOI logoGoogle Scholar
Laufer, Batia
1994 The lexical profile of second language writing: Does it change over time? RELC Journal 25: 21–33. DOI logoGoogle Scholar
Laufer, Batia & Nation, Paul
1995 Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics 16(3): 307–322. DOI logoGoogle Scholar
Laufer, Batia & Waldman, Tina
2011 Verb-noun collocations in second language writing: A corpus analysis of learners’ English. Language Learning 61(2): 647–672. DOI logoGoogle Scholar
Leech, Geoffrey
2000 Grammars of spoken English: New outcomes of corpus-oriented research. Language Learning 50(4): 675–724. DOI logoGoogle Scholar
Lüdecke, Daniel, Ben-Shachar, Mattan S., Patil, Indrajeet, Waggoner, Philip & Makowski, Dominique
2021 Performance: An R Package for Assessment, Comparison and Testing of Statistical Models. Journal of Open Source Software 6(60): 3139. DOI logoGoogle Scholar
McDonough, Kim & Kim, Youjin
2009 Syntactic priming, type frequency, and EFL learners’ production of wh-questions. The Modern Language Journal 93(3): 386–398. DOI logoGoogle Scholar
Nesselhauf, Nadja
2005 Collocations in a Learner Corpus [Studies in Corpus Linguistics 14]. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Nippold, Marilyn A., Ward-Lonergan, Jeannene M. & Fanning, Jessica L.
2015 Persuasive writing in children, adolescents, and adults: A study of syntactic, semantic, and pragmatic development. Language, Speech, and Hearing Services in Schools 36: 125–138. DOI logoGoogle Scholar
Ortega, Lourdes
2003 Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics 24(4): 492–518. DOI logoGoogle Scholar
Paquot, Magali
2018 Phraseological competence: A useful toolbox to delimitate CEFR levels in higher education? Insights from a study of EFL learners’ use of statistical collocations. Language Assessment Quarterly 15(1): 29–43. DOI logoGoogle Scholar
2019 The phraseological dimension in interlanguage complexity research. Second Language Research 35(1): 121–145. DOI logoGoogle Scholar
Paquot, Magali, Hasselgård, Hilde & Oksefjell Ebeling, Signe
2013 Writer/reader visibility in learner writing across genres: A comparison of the French and Norwegian components of the ICLE and VESPA learner corpora. In Twenty Years of Learner Corpus Research: Looking Back, Moving Ahead [Corpora and Language in Use – Proceedings 1], Sylviane Granger, Gaëtanelle Gilquin & Fanny Meunier (eds), 377–387. Louvain-la-neuve: Presses universitaires de Louvain.Google Scholar
Paquot, Magali, Naets, Hubert & Gries, Stefan T.
2021 Using syntactic co-occurrences to trace phraseological complexity development in learner writing: verb + object structures in LONGDALE. In Learner Corpus Research Meets Second Language Acquisition, Bert Le Bruyn & Magali Paquot (eds), 122–147. Cambridge: CUP.Google Scholar
Römer, Ute & Garner, James R.
2019 The development of verb constructions in spoken learner English: Tracing effects of usage and proficiency. International Journal of Learner Corpus Research 5(2): 207–230. DOI logoGoogle Scholar
Rubin, Rachel, Housen, Alex & Paquot, Magali
2021 Phraseological complexity as an index of L2 Dutch writing proficiency: A partial replication study. In Perspectives on the Second Language Phrasicon: The View from Learner Corpora, Sylviane Granger (ed.), 101–125. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Schäfer, Roland
2015 Processing and querying large web corpora with the COW14 architecture. In Proceedings of the 3rd Workshop on Challenges in the Management of Large Corpora (CMLC-3), Lancaster, 20 July 2015, Piotr Bański, Hanno Biber, Evelyn Breiteneder, Marc Kupietz, Harald Lüngen & Andreas Witt (eds), 28–34. Mannheim: Institut für Deutsche Sprache. [URL] (14 October 2021).
Schäfer, Roland & Bildhauer, Felix
2012 Building large corpora from the web using a new efficient tool chain. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk & Stelios Piperidis (eds), 486–493. European Language Resources Association (ELRA) [URL] (14 October 2021).
Sinclair, John M.
1991 Corpus, Concordance, Collocation. Oxford: OUP.Google Scholar
Thewissen, Jennifer
2013 Capturing L2 accuracy developmental patterns: Insights from an error-tagged EFL learner corpus. The Modern Language Journal 97(S1): 77–101. DOI logoGoogle Scholar
Vandeweerd, Nathan, Housen, Alex & Paquot, Magali
2021 Applying phraseological complexity measures to L2 French: A partial replication study. International Journal of Learner Corpus Research 7(2): 197–228. DOI logoGoogle Scholar
Submitted. Comparing the longitudinal development of phraseological complexity across oral and written tasks.
Vasylets, Olena, Gilabert, Roger & Manchón, Rosa M.
2017 The effects of mode and task complexity on second language production. Language Learning 67(2): 394–430. DOI logoGoogle Scholar
Venables, William N. & Ripley, Brian D.
2002 Modern Applied Statistics with S (4th edn). New York NY: Springer. DOI logoGoogle Scholar
Xu, Jing
2018 Measuring “spoken collocational competence” in communicative speaking assessment. Language Assessment Quarterly 15(3): 255–272. DOI logoGoogle Scholar
Yuan, Fangyuan & Ellis, Rod
2003 The effects of pre-task planning and on-line planning on fluency, complexity and accuracy in L2 monologic oral production. Applied Linguistics 24(1): 1–27. DOI logoGoogle Scholar
Cited by

Cited by 2 other publications

Riemenschneider, Anja, Zarah Weiss, Pauline Schröter & Detmar Meurers
2023. The Interplay of Task Characteristics, Linguistic Complexity, and Language Proficiency in High‐Stakes English as a Foreign Language Writing. TESOL Quarterly DOI logo
Vandeweerd, Nathan, Alex Housen & Magali Paquot
2023. Comparing the longitudinal development of phraseological complexity across oral and written tasks. Studies in Second Language Acquisition 45:4 ► pp. 787 ff. DOI logo

This list is based on CrossRef data as of 28 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.