Cover not available
Part of
Complexity, Accuracy and Fluency in Learner Corpus Research
Edited by Agnieszka Leńko-Szymańska and Sandra Götz
[Studies in Corpus Linguistics 104] 2022
► pp. 209–240

Interaction between grammatical accuracy and syntactic complexity at different proficiency levels

Insights from a learner corpus

| University of Antwerp | Université Saint-Louis
| University of Antwerp

This learner corpus study tracks the development and interactional dynamics between grammatical accuracy (GrA) and syntactic complexity (SC) at four Common European Framework proficiency levels (intermediate and advanced levels B1/B2/C1/C2). Data from the International Corpus of Learner English (Granger et al. 2020) were error-tagged and submitted to the automatic L2 Syntactic Complexity Analyzer (Lu 2010). Interaction between B1 and B2 is characterised by a competitive relationship between GrA and SC, with the most marked improvement displayed in accuracy. Development between B2 and C1 displays subtle shifts, with GrA improving slightly and SC showing mild signs of reorganisation. Between C1 and C2, a more supportive relationship appears: SC shows the most marked signs of development, with GrA continuing to subtly improve.

Keywords: grammatical accuracy, syntactic complexity, interactional dynamics, proficiency levels
Article outline
  • 1.Introduction and study rationale
  • 2.Construct definitions: Grammatical accuracy and syntactic complexity
  • 3.The dynamic relationship between L2 accuracy and complexity
  • 4.Is more syntactically complex better?
  • 5.Data and methodology
    • 5.1Learner corpus data
    • 5.2Grammatical accuracy and syntactic complexity indices
    • 5.3Study design
  • 6.Results
    • 6.1Mapping the grammatical accuracy and syntactic complexity constructs
    • 6.2Capturing dynamic developmental patterns
  • 7.Conclusion and avenues for further research
  • Notes
  • References
  • Appendix
Published online: 1 December 2022
DOI logo
https://doi.org/10.1075/scl.104.09the
References
Abdel Latif, Muhammad M. Mahmoud
2013 What do we mean by writing fluency and how can it be validly measured? Applied Linguistics 34(1): 99–105. DOI logoGoogle Scholar
Alexopoulou, Theodora, Michel, Marije, Murakami, Akira & Meurers, Detmar
2017 Task effects on linguistic complexity and accuracy. A large-scale learner corpus analysis employing natural language processing techniques. Language Learning 67(1): 180–208. DOI logoGoogle Scholar
Biber, Douglas & Conrad, Lauren
2009 Register, Genre, and Style. Cambridge: CUP. DOI logoGoogle Scholar
Biber, Douglas, Gray, Bethany & Poonpon, Kornwipa
2011 Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly 45(1): 5–35. DOI logoGoogle Scholar
Brand, Christiane & Götz, Sandra
2011 Fluency versus accuracy in advanced spoken learner language: A multi-method approach. International Journal of Corpus Linguistics 16(2): 255–275. DOI logoGoogle Scholar
Bulté, Bram & Housen, Alex
2014 Conceptualizing and measuring short-term changes in L2 writing complexity. Journal of Second Language Writing 26(4): 42–65. DOI logoGoogle Scholar
2012 Defining and operationalizing L2 complexity. In Dimensions of L2 Performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 21–46. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Chan, HuiPing, Verspoor, Marjolijn & Vahtrick, Louisa
2015 Dynamic development in speaking vs. writing in identical twins. Language Learning 65(2): 298–325. DOI logoGoogle Scholar
Chen, Xiaobin & Meurers, Detmar
2016 CTAP: A web-based tool supporting automatic complexity analysis. In Proceedings of The Workshop on Computational Linguistics for Linguistic Complexity, Dominique Brunato, Felice Dell’Orletta, Giulia Venturi, Thomas François & Philippe Blache (eds), 113–119. Osaka: The COLING 2016 Organizing Committee.Google Scholar
Council of Europe
2001 Common European Framework of Reference for Languages: Learning, Teaching, Assessment. Strasbourg: Council of Europe.Google Scholar
Crossley, Scott & McNamara, Danielle
2014 Does writing development equal writing quality? A computational investigation of syntactic complexity in L2 learners. Journal of Second Language Writing 26: 66–79. DOI logoGoogle Scholar
Dagneaux, Estelle, Denness, Sharon & Granger Sylviane
1998 Computer-aided error analysis. System: An International Journal of Educational Technology and Applied Linguistics 26(2): 163–174. DOI logoGoogle Scholar
Dagneaux, Estelle, Denness, Sharon, Granger, Sylviane, Meunier, Fanny, Neff, JoAnne, & Thewissen, Jennifer
2008 Error Tagging Manual Version 1.3. Centre for English Corpus Linguistics. Université catholique de Louvain, Louvain-la-Neuve. Unpublished manual.Google Scholar
de Bot, Kees & Larsen-Freeman, Diane
2011 Researching second language development from a dynamic systems theory perspective. In A Dynamic Approach to Second Language Development: Methods and Techniques [Language Learning and Language Teaching 29], Marjolijn Verspoor, Kees de Bot & Wander Lowie (eds), 5–24. Amsterdam: John Benjamins. DOI logoGoogle Scholar
De Clercq, Bastien & Housen, Alex
2019 The development of morphological complexity: A cross-linguistic study of L2 French and English. Second Language Research 35(1): 71–98. DOI logoGoogle Scholar
de Graaff, Rick
2019 You’ve got to crack a few eggs to make an omelette. Linguistic complexity and instruction in SLA: What’s in it for SLA? Instructed Second Language Acquisition 3(2): 249–258. DOI logoGoogle Scholar
de Leeuw, Jan & Mair, Patrick
2009 Multidimensional Scaling Using Majorization: SMACOF in R. Journal of Statistical Software 31(3): 1–30. DOI logoGoogle Scholar
Díez-Bedmar, María Belén
2021 Error analysis. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 90–104. New York NY: Routledge.Google Scholar
Ellis, Rod & Yuan, Fangyuan
2004 The effects of planning on fluency, complexity and accuracy in second language narrative writing. Studies in Second Language Acquisition 26(1): 59–84. DOI logoGoogle Scholar
Fogel, Alan
2011 Theoretical and applied dynamic systems research in developmental science. Child Developmental Perspectives 5: 267–272. DOI logoGoogle Scholar
Foster, Pauline & Skehan, Peter
1996 The influence of planning and task type on second language performance. Studies in Second Language Acquisition 18(3): 299–324. DOI logoGoogle Scholar
Garside, Roger & Smith, Nicholas
1997 A hybrid grammatical tagger: CLAWS4. In Corpus Annotation: Linguistic Information from Computer Text Corpora, Roger Garside, Geoffrey Leech & Anthony McEnery (eds), 102–121. London: Longman. DOI logoGoogle Scholar
Götz, Sandra
2013 Fluency in Native and Nonnative English Speech [Studies in Corpus Linguistics 53]. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Granger, Sylviane, Dupont, Maïté, Meunier, Fanny, Naets, Hubert & Paquot, Magali
2020 The International Corpus of Learner English, Version 3. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar
Hasko, Victoria
2013 Capturing the dynamics of second language development via learner corpus research: A very long engagement. The Modern Language Journal 97(1): 1–10. DOI logoGoogle Scholar
Housen, Alex, De Clercq, Bastien, Kuiken, Folkert & Vedder, Ineke
2019 Multiple approaches to complexity in second language research. Second Language Research 35(1): 3–21. DOI logoGoogle Scholar
Housen, Alex, Kuiken Folkert & Vedder, Ineke
2012 Complexity, accuracy, fluency. International Journal of Applied Linguistics 23(2): 1–20. DOI logoGoogle Scholar
Housen, Alex & Kuiken, Folkert
2009 Complexity, accuracy, and fluency in Second Language Acquisition. Applied Linguistics 30(4): 461–473. DOI logoGoogle Scholar
Jin, Tan, Lu, Xiaofei & Ni, Jing
2020 Syntactic complexity in adapted teaching materials: Differences among grade levels and implications for benchmarking. The Modern Language Journal 104(1): 192–208. DOI logoGoogle Scholar
Kuiken, Folkert, Housen, Alex, Vedder, Ineke & De Clercq, Bastien
2019 Variation in syntactic complexity: Introduction. International Journal of Applied Linguistics 29(2): 161–170. DOI logoGoogle Scholar
Kuiken, Folkert & Vedder, Ineke
2019 Investigating teachers’ perceptions of syntactic complexity in L2 academic writing. Instructed Second Language Acquisition 3(2): 228–248. DOI logoGoogle Scholar
Kyle, Kristopher
2016 Measuring Syntactic Development in L2 Writing: Fine Grained Indices of Syntactic Complexity and Usage-based Indices of Syntactic Sophistication. PhD Dissertation, Georgia State University.
Kyle, Kristopher & Crossley, Scott
2018 Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices. The Modern Language Journal 102(2): 333–349. DOI logoGoogle Scholar
Lambert, Craig & Kormos, Judit
2014 Complexity, accuracy and fluency in task-based L2 research: Toward more developmentally based measures of second language acquisition. Applied Linguistics 35(5): 607–614. DOI logoGoogle Scholar
Larsen-Freeman, Diane
2018 Second Language Acquisition, WE, and language as a complex adaptive system (CAS). World Englishes 37(1): 80–92. DOI logoGoogle Scholar
2009 Adjusting expectations: The study of complexity, accuracy and fluency in second language acquisition. Applied Linguistics 30(4): 579–589. DOI logoGoogle Scholar
2006 The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics 27(4): 590–619. DOI logoGoogle Scholar
Lennon, Paul
1991 Error: Some problems of definition, identification, and distinction. Applied Linguistics 12(2): 180–196. DOI logoGoogle Scholar
Lowie, Wander, Michel, Marije, Keijzer, Merel & Steinkrauss, Rasmus
2020 Usage-Based Dynamics in Second Language Development. Bristol: Multilingual Matters. DOI logoGoogle Scholar
Lowie, Wander & Verspoor, Marjolijn
2007 A Dynamic Systems Theory approach to second language acquisition. Bilingualism: Language and Cognition 10(1): 7–21. DOI logoGoogle Scholar
Lu, Xiaofei
2017 Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Language Testing 34(4): 493–511. DOI logoGoogle Scholar
2012 The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal 96(2): 190–208. DOI logoGoogle Scholar
2011 A corpus-based evaluation of syntactic complexity measures as indices of college-level ESL writers’ language development. TESOL Quarterly 45(1): 36–62. DOI logoGoogle Scholar
2010 Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics 15(4): 36–62. DOI logoGoogle Scholar
Mair, Patrick, Groenen, Patrick J. F. & de Leeuw, Jan
2021 More on multidimensional scaling in R: Smacof version 2. Journal of Statistical Software. [URL] (12 February 2022)
McNamara, Danielle, Graesser, Arthur, McCarthy, Philip & Cai, Zhiqiang
2014 Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge: CUP. DOI logoGoogle Scholar
Meunier, Fanny
2016 Introduction to the LONGDALE project. In Studies in Learner Corpus Linguistics: Research and Applications for Foreign Language Teaching and Assessment, Erik Castello, Katherine Ackerley & Francesca Coccetta (eds), 123–126. Berlin: Peter Lang.Google Scholar
Michel, Marije, Murakami, Akira, Alexopoulou, Theodora & Meurers, Detmar
2019 Effects of task type on morphosyntactic complexity: Evidence from a large learner corpus of A1 to C2 writings. Instructed Second Language Acquisition 3(2): 124–152. DOI logoGoogle Scholar
Norris, John & Ortega, Lourdes
2009 Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics 30(4): 555–578. DOI logoGoogle Scholar
Ortega, Lourdes
2015 Syntactic complexity in L2 writing: Progress and expansion. Journal of Second Language Writing 29: 82–94. DOI logoGoogle Scholar
Pallotti, Gabriele
2015 A simple view of linguistic complexity. Second Language Research 31(1): 117–134. DOI logoGoogle Scholar
2009 CAF: Defining, refining and differentiating constructs. Applied Linguistics 30(4): 590–601. DOI logoGoogle Scholar
Paquot, Magali
2019 The phraseological dimension in interlanguage complexity research. Second Language Research 35(1): 121–145. DOI logoGoogle Scholar
Plakans, Lia, Gebril, Ata & Bilki, Zeynep
2019 Shaping a score: Complexity, accuracy, and fluency in integrated writing performances. Language Testing 36(2): 161–179. DOI logoGoogle Scholar
Polio, Charlene & Shea, Mark
2014 An investigation into current measures of linguistic accuracy in second language writing research. Journal of Second Language Writing 26(1): 10–27. DOI logoGoogle Scholar
Polio, Charlene & Yoon, Hyung-Jo
2018 The reliability and validity of automated tools for examining variation in syntactic complexity across genres. International Journal of Applied Linguistics 28(1): 165–188. DOI logoGoogle Scholar
Rosmawati, Rosmawati
2014 Dynamic development of complexity and accuracy: A case study in second language academic writing. Australian Review of Applied Linguistics 37(2): 75–100. DOI logoGoogle Scholar
Skehan, Peter
2009 Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics 30(4): 510–532. DOI logoGoogle Scholar
Skehan, Peter & Foster, Pauline
2012 Complexity, accuracy, fluency and lexis in task-based performance: A synthesis of the Ealing research In Dimensions of L2 performance and Proficiency [Language Learning & Language Teaching 32], Alex Housen, Folkert Kuiken & Ineke Vedder (eds), 199–220. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Spoelman, Marianne & Verspoor, Marjolijn
2010 Dynamic patterns in development of accuracy and complexity: A longitudinal case study in the acquisition of Finnish. Applied Linguistics 31(4): 532–553. DOI logoGoogle Scholar
Thelen, Esther & Smith, Linda B.
1994 A Dynamic Systems Approach to the Development of Cognition and Action. Cambridge MA: The MIT Press.Google Scholar
Thewissen, Jennifer
2021 Accuracy. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 305–317. New York NY: Routledge.Google Scholar
2015 Accuracy across Proficiency Levels: A Learner Corpus Approach. Louvain-la-Neuve: Presses universitaires de Louvain.Google Scholar
Thewissen, Jennifer & Anishchanka, Alena
2019 An integrative approach to L2 accuracy and complexity development. Paper presented at the 5th Learner Corpus Research Conference. 12–14 September 2019. University of Warsaw, Poland.
Verspoor, Marjolijn, Schmid, Monika & Xu, Xiaoyan
2012 A dynamic usage based perspective on L2 writing. Journal of Second Language Writing 21: 239–263. DOI logoGoogle Scholar
Van Waes, Luuk & Leijten, Mariëlle
2015 Fluency in writing: A multidimensional perspective on writing fluency applied to L1 and L2. Computers and Composition 38: 79–95. DOI logoGoogle Scholar
Vyatkina, Nina & Housen, Alex
2021 Complexity. In The Routledge Handbook of Second Language Acquisition and Corpora, Nicole Tracy-Ventura & Magali Paquot (eds), 318–330. New York NY: Routledge.Google Scholar
Yang, Weiwei, Lu, Xiaofei, Cushing Weigle, Sarah
2015 Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgements of writing quality. Journal of Second Language Writing 28: 53–67. DOI logoGoogle Scholar
Yu, Hanjing & Lowie, Wander
2020 Dynamic paths of complexity and accuracy in second language speech: A longitudinal case study of Chinese learners. Applied Linguistics 41(6): 855–877. DOI logoGoogle Scholar