Cover not available
Part of
Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 137–158

Persistent errors in spoken English among Taiwanese and Czech learners at CEFR B2 and C1

| Charles University
| National Pingtung University

The study provides empirical evidence illustrating the development of grammatical accuracy in spoken learner English from CEFR’s B2 to C1 levels of accuracy. It uses the CEFR-rated and error-tagged Taiwanese and Czech sub-corpora of LINDSEI containing altogether 54 B2 and 36 C1 speakers. The analysis of the 5,120 identified errors revealed a threefold increase in accuracy at the C1 level. However, some errors which might be labelled persistent were identified, namely errors in some aspects of the use of articles and errors in the use of some verb tenses. The study contributes to the discussion of criterial features for proficiency levels.

Keywords: learner corpus, computer-aided error analysis, speaking accuracy, LINDSEI, CEFR
Article outline
  • 1.Introduction
  • 2.Accuracy in spoken learner language
  • 3.Data and methods
  • 4.Results
    • 4.1Overall comparison of errors produced by the B2 and C1 learners
    • 4.2Error types made by the B2 and C1 learners
    • 4.3Grammatical errors
  • 5.Discussion
  • 6.Conclusions
  • Notes
  • References
Published online: 1 December 2022
DOI logo
https://doi.org/10.1075/scl.104.06gra
References
Alderson, Charles J.
2007 The CEFR and the need for more research. The Modern Language Journal 91(4): 659–663. DOI logoGoogle Scholar
Balgová, Šárka
2018 Errors in Expressing the Past in Advanced EFL Learners with Spanish as L1. BA dissertation, Charles University.
Barrett, Neil Edward & Chen, Li-mei
2011 English article errors in Taiwanese college students’ EFL writing. Computational Linguistics and Chinese Language Processing 16(3–4): 1–20.Google Scholar
Biber, Douglas, Finegan, Edward, Johansson, Stig, Conrad, Susan & Leech, Geoffrey
1999 Longman Grammar of Spoken and Written English. Harlow: Pearson Education.Google Scholar
Biber, Douglas, Johansson, Stig, Leech, Geoffrey, Conrad, Susan, & Finegan, Edward
2021 Grammar of Spoken and Written English. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Carter, Ronald & McCarthy, Michael
2006 Cambridge Grammar of English. Cambridge: CUP.Google Scholar
Cohen, Jacob
1988 Statistical Power Analysis for the Behavioral Sciences (2nd edn). Hillsdale NJ: Lawrence Earlbaum Associates.Google Scholar
Corder, Stephen Pit
1967 The significance of learner’s errors. International Journal of Applied Linguistics 5(4): 161–170. DOI logoGoogle Scholar
Council of Europe
2001 Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Cambridge: CUP.Google Scholar
2018 Common European Framework of Reference for Languages: Learning, Teaching, Assessment Companion Volume with New Descriptors. Strasbourg: Council of Europe.Google Scholar
Dagneaux, Estelle, Denness, Sharon, Granger, Sylviane, Meunier, Fanny, Neff, JoAnne & Thewissen, Jennifer
2008 The Louvain Error Tagging Manual Version 1.3. Louvain-la-neuve: Centre for English Corpus Linguistics, Université catholique de Louvain.Google Scholar
Davydova, Julia
2011 The Present Perfect in Non-Native Englishes: A Corpus-Based Study of Variation. Berlin: De Gruyter Mouton. DOI logoGoogle Scholar
Deygers, Bart
2019 The CEFR companion volume: Between research-based policy and policy-based research. Applied Linguistics 42(1): 186–191. DOI logoGoogle Scholar
Díez-Bedmar, María Belén
2015 Article use and criterial features in Spanish EFL writing. In Learner Corpora in Language Testing and Assessment, Marcus Callies & Sandra Götz (eds), 163–190. Amsterdam: John Benjamins. DOI logoGoogle Scholar
2021 Error analysis. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 90–104. New York NY: Routledge.Google Scholar
Díez-Bedmar, María Belén & Byram, Michael
2019 The current influence of the CEFR in secondary education: teachers’ perceptions. Language, Culture and Curriculum 32(1): 1–15. DOI logoGoogle Scholar
Ellis, Rod
1999 The Study of Second Language Acquisition. Oxford: OUP. DOI logoGoogle Scholar
Figueras, Neus
2012 The impact of the CEFR. ELT Journal 66(4): 477–485. DOI logoGoogle Scholar
Foster, Pauline & Skehan, Peter
1996 The influence of planning and task type on second language performance. Studies in Second Language Acquisition 18(3): 299–323. DOI logoGoogle Scholar
Fox Tree, Jean E.
1995 The effects of false starts and repetitions on the processing of subsequent words in spontaneous speech. Journal of Memory and Language 34(6): 709–738. DOI logoGoogle Scholar
Fuchs, Robert, Götz, Sandra & Werner, Valentin
2016 The present perfect in learner Englishes: A corpus-based case study on L1 German intermediate and advanced speech and writing. In Re-Assessing the Present Perfect, Valentin Werner, Elena Seoane & Cristina Suárez-Gómez (eds), 297–338. Berlin: De Gruyter. DOI logoGoogle Scholar
Gennaro, Kristen di & Ekiert, Monika
2021 The impact of corrective feedback on English articles. ELT Journal 75(3): 290–299. DOI logoGoogle Scholar
Gillová, Lucie
2014 Tagging a Spoken Learner Corpus. MA dissertation, Charles University.
Gilquin, Gaëtanelle, De Cock, Sylvie & Granger, Sylviane
2010 LINDSEI Louvain International Database of Spoken English Interlanguage. Handbook and CD-ROM. Louvain-la-neuve: Presses universitaires de Louvain.Google Scholar
Gilquin, Gaëtanelle & De Cock, Sylvie
2011 Errors and disfluencies in spoken corpora: Setting the scene. International Journal of Corpus Linguistics 16(2): 141–172. DOI logoGoogle Scholar
Glaboniat, Manuela, Müller, Martin, Rusch, Paul, Schmitz, Helen and Wertenschlag, Lukas
2005 Profile deutsch: Gemeinsamer europäischer Referenzrahmen; Lernzielbestimmungen; Kannbeschreibungen; kommunikative Mittel; Niveau A1-A2, B1-B2; C1-C2. Berlin: Langenscheidt.Google Scholar
Götz, Sandra
2015 Tense and aspect errors in spoken learner English: Implications for language testing and assessment. In Learner Corpora in Language Testing and Assessment [Studies in Corpus Linguistics 70], Marcus Callies & Sandra Götz (eds), 191–215. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Granger, Sylviane, Dagneaux, Estelle, Meunier, Fanny & Paquot, Magali
2009 The International Corpus of Learner English. Handbook and CD-ROM (2nd edn). Louvain-la-neuve: Presses Universitaires de Louvain.Google Scholar
Gráf, Tomáš
2015 Accuracy and Fluency in the Speech of the Advanced Learner of English. PhD dissertation, Charles University.
2017 Verb errors in advanced spoken English. Philologica 1 / Prague Studies in English 2017(1): 131–149. DOI logoGoogle Scholar
Gráf, Tomáš & Huang, Lan-fen
2019 Repeats in advanced spoken English. In Fluency and Disfluency across Languages and Language Varieties, Liesbeth Degand, Gaëtanelle Gilquin, Laurence Meurant & Anne Catherine Simon (eds), 219–241. Louvain-la-neuve: Presses Universitaires de Louvain.Google Scholar
Gwynne, Steve, Linder, Don & Santamaria, Jenni C.
2019 StartUp 6. Hoboken NY: Pearson Education.Google Scholar
Hawkins, John A., & Buttery, Paula
2010 Criterial features in learner corpora: Theory and illustrations. English Profile Journal 1(1): 1–23. DOI logoGoogle Scholar
Hawkins, John A. & Filipović, Luna
2012 Criterial Features in L2 English: Sepficying the Reference Levels of the Common European Framework. Cambridge: CUP.Google Scholar
Huang, Lan-fen
2014 Constructing the Taiwanese component of the Louvain International Database of Spoken English Interlanguage (LINDSEI). Taiwan Journal of TESOL 11(1): 31–74.Google Scholar
Huang, Lan-fen, Kubelec, Simon, Keng, Nicole & Hsu, Lung-hsun
2018 Evaluating CEFR rater performance through the analysis of spoken learner corpora. Language Testing in Asia 8(14): 1–17. DOI logoGoogle Scholar
Hubáčková, Iva
2018 Errors in the Usage of Article in Advanced EFL Learners with Spanish as L1. BA dissertation, Charles University.
Hulstijn, Jan H.
2007 The shaky ground beneath the CEFR: Quantitative and qualitative dimensions of language proficiency. The Modern Language Journal 91(4): 663–667. DOI logoGoogle Scholar
Ionin, Tania & Díez-Bedmar, María B.
2021 Article use in Russian and Spanish learner writing at CEFR B1 and B2 levels: Effects of proficiency, native language, and specificity. In Learner Corpus Research Meets Second Language Acquisition, Bert Le Bruyn & Magali Paquot (eds), 10–38. Cambridge: CUP. DOI logoGoogle Scholar
Kämmerer, Susanne
2009 Error-tagging spoken features of (learner) language: The UCL Error Editor ‘revised’. Paper presented at the 30th Annual Conference of the International Computer Archive of Modern and Medieval English (ICAME30), Lancaster, UK.
Kormos, Judit & Dénes, Mariann
2004 Exploring measures and perceptions of fluency in the speech of second language learners. System 32(2): 145–164. DOI logoGoogle Scholar
Lennon, Paul
1991 Error: Some problems of definition, identification and distinction. Applied Linguistics 12(2): 180–196. DOI logoGoogle Scholar
Lüdeling, Anke & Hirschmann, Hagen
2015 Error annotation systems. In The Cambridge Handbook of Learner Corpus Research, Sylviane Granger, Gaëtanelle Gilquin & Fanny Meunier (eds), 135–157. Cambridge: CUP. DOI logoGoogle Scholar
Master, Peter
1997 The English article system: Acquisition, function and pedagogy. System 25(2): 215–232. DOI logoGoogle Scholar
2002 Information structure and English article pedagogy. System 30(4): 331–334. DOI logoGoogle Scholar
McCarthy, Michael, McCarten, Jeanne & Sandiford, Helen
2014 Touchstone Student’s Book 3. Cambridge: CUP.Google Scholar
Milton, James
2009 Measuring Second Language Vocabulary Acquisition. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Nation, Paul
1999 Fluency and accuracy. In Consice Encyclopedia of Educational Linguistics, Bernard Spolsky (ed.), 611–612. Amsterdam: Elsevier.Google Scholar
Ortega, Lourdes & Byrnes, Heidi
(eds) 2008 The Longitudinal Study of Advanced L2 Capacities. New York NY: Routledge. DOI logoGoogle Scholar
Pazderová, Tereza
2019 Errors in the Use of Articles in Czech Advanced Learner English. BA dissertation. Charles University.
Rayson, Paul, Damon, Berridge & Brian, Francis
2004 Extending the Cochran rule for the comparison of word frequencies between corpora. In Le Poids des Mots: Proceedings of the 7th International Conference on Statistical Analysis of Textual Data (JADT 2004) Louvain-la-neuve, Belgium, March 10–12, 2004 Vol. II, Gérald Purnelle, Cédrick Fairon & Anne Dister (eds), 926–936. Louvain-la-neuve: Presses universitaires de Louvain.Google Scholar
Scott, Mike
2016 WordSmith Tools, Version 7. Stroud: Lexical Analysis Software.Google Scholar
Sinclair, John
1991 Corpus, Concordance, Collocation. Oxford: OUP.Google Scholar
Skehan, Peter
1996 Second language acquisition research and task-based instruction. In Challenge and Change in Language Teaching, Dave Willis & Jane Willis (eds), 17–30. Oxford: Heinemann.Google Scholar
Thewissen, Jennifer
2015 Accuracy across Proficiency Levels: A Learner Corpus Approach. Louvain-la-neuve: Presses universitaires de Louvain.Google Scholar
Wilson, Andrew
2013 Embracing Bayes factors for key item analysis in corpus linguistics. In New Approaches to the Study of Linguistic Variability: Language Competence and Language Awareness in Europe, Markus Bieswanger & Amei Koll-Stobbe (eds), 3–11. Frankfurt: Peter Lang.Google Scholar