Article In: International Journal of Learner Corpus Research: Online-First Articles
The design, measurement, and analysis of longitudinal learner corpus research
A methodological synthesis
This content is being prepared for publication; it may be subject to changes.
Abstract
Longitudinal learner corpus research (LCR) has grown substantially in recent years, resulting in rich and varied study designs, analyses, and findings. Yet its design, measurement, and analysis practices have not been systematically assessed. To address this gap, this review synthesizes 120 longitudinal learner corpus studies published between 1996 and 2025, identified through systematic database searches and supplementary searching of the Learner Corpus Bibliography. Many studies collected data at two to four time points; written and same-genre data predominated, and task counterbalancing was rare. Additionally, analytical sophistication rose markedly over time, with mixed-effects models increasingly used in recent studies. We identify five priorities for the field: aligning observation schedules with developmental trajectories, transparently reporting time-based parameters, designing tasks with clear rationales, matching analytic tools to learner-language data, and adopting longitudinal statistical models more widely. These priorities offer a roadmap for studies yielding cumulative, comparable evidence about L2 development over time.
Article outline
- 1.Introduction
- 2.Literature review
- 2.1Longitudinal LCR studies and L2 development
- 2.2Challenges for longitudinal learner corpus research
- 3.The present study
- 4.Method
- 4.1Study retrieval and identification
- 4.2Coding and analysis
- 5.Results
- 5.1Sampling practices and design
- 5.2Data collection and measurement
- 5.3Analysis
- 6.Discussion
- 7.Limitations
- 8.Conclusion
- Open data badge and data availability statement
- AI use disclosure statement
References
References (72)
Abu-Rabiah, E., Gafter, R. J., & Henkin, R. (2023). Where syntactic interference persists: The case of Hebrew written by native Arabic speakers. L1-Educational Studies in Language and Literature, 23(1), 1–19.
Alexopoulou, T., Michel, M., Murakami, A., & Meurers, D. (2017). Task effects on linguistic complexity and accuracy: A large-scale learner corpus analysis employing natural language processing techniques. Language Learning, 67(S1), 180–208.
Anthony, L. (2023). AntConc (Version 4.2.4) [Computer Software]. [URL]
Barkaoui, K. (2014). Quantitative approaches for analyzing longitudinal data in second language research. Annual Review of Applied Linguistics, 34, 65–101.
Barron, A. (2019). Using corpus-linguistic methods to track longitudinal development: Routine apologies in the study abroad context. Journal of Pragmatics, 146, 87–105.
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45(1), 5–35.
Bulon, A., & Meunier, F. (2023). Comparing CLIL and non-CLIL learners’ phrasicon in L2 Dutch: The (expected) winner does not take it all. International Journal of Bilingual Education and Bilingualism, 26(5), 590–613.
Callies, M., & Paquot, M. (2015). Learner corpus research: An interdisciplinary field on the move. International Journal of Learner Corpus Research, 1(1), 1–6.
Centre for English Corpus Linguistics. (2021, June 4). Learner corpus bibliography. Retrieved September 16, 2026, from [URL]
Chan, H., Verspoor, M., & Vahtrick, L. (2015). Dynamic development in speaking versus writing in identical twins. Language Learning, 65(2), 298–325.
Crossley, S. A., & Kim, M. (2022). Linguistic features of writing quality and development: A longitudinal approach. The Journal of Writing Analytics, 6(1), 59–93.
Crossley, S. A., Skalicky, S., Kyle, K., & Monteiro, K. (2019). Absolute frequency effects in second language lexical acquisition. Studies in Second Language Acquisition, 41(04), 721–744.
Crosthwaite, P., & Jiang, K. (2017). Does EAP affect written L2 academic stance? A longitudinal learner corpus study. System, 69, 92–107.
Czerwionka, L., & Olson, D. J. (2020). Pragmatic development during study abroad: L2 intensifiers in spoken Spanish. International Journal of Learner Corpus Research, 6(2), 125–162.
Du, H. (2022). Grammatical and lexical development during study abroad: Research on a corpus of spoken L2 Chinese. Foreign Language Annals, 55(4), 985–1005.
Duan, S., & Shi, Z. (2024). A longitudinal study of formulaic sequence use in second language writing: Complex dynamic systems perspective. Language Teaching Research, 28(2), 497–530.
Evans, D. R., & Larsen-Freeman, D. (2020). Bifurcations and the emergence of L2 syntactic structures in a complex dynamic system. Frontiers in Psychology, 11, Article 574603.
Geertzen, J., Alexopoulou, T., & Korhonen, A. (2014). Automatic linguistic annotation of large scale L2 databases: The EF-Cambridge Open Language Database (EFCAMDAT). In R. T. Miller, K. I. Martin, C. M. Eddington, A. Henery, N. M. Marcos Miguel, A. M. Tseng, A. Tuninetti, & D. Walter (Eds.), Selected proceedings of the 2012 Second Language Research Forum: Building bridges between disciplines (pp. 240–254). Cascadilla Proceedings Project.
Goodwin, L. D., & Goodwin, W. L. (1985). Statistical techniques in AERJ articles, 1979–1983: The preparation of graduate students to read the educational research literature. Educational Researcher, 14(2), 5–11.
Granger, S. (1996). From CA to CIA and back: An integrated approach to computerized bilingual and learner corpora. Lund Studies in English, 88, 37–52.
(2009). The contribution of learner corpora to second language acquisition and foreign language teaching: A critical evaluation. In K. Aijmer (Ed.), Corpora and language teaching (pp. 13–32). John Benjamins.
(2021). Commentary: Have learner corpus research and second language acquisition finally met? In B. Le Bruyn & M. Paquot (Eds.), Learner corpus research meets second language acquisition (pp. 243–257). Cambridge University Press.
Ishikawa, S. (2013). The ICNALE and sophisticated contrastive interlanguage analysis of Asian learners of English. Learner Corpus Studies in Asia and the World, 1, 91–118.
Khany, R., & Tazik, K. (2019). Levels of statistical use in applied linguistics research articles: From 1986 to 2015. Journal of Quantitative Linguistics, 26(1), 48–65.
Kim, M., & Lu, X. (2024). L2 English speaking syntactic complexity: Data preprocessing issues, reliability of automated analysis, and the effects of proficiency, L1 background, and topic. The Modern Language Journal, 108 (1), 270–296.
Kisselev, O., Soyan, R., Pastushenkov, D., & Merrill, J. (2022). Measuring writing development and proficiency gains using indices of lexical and syntactic complexity: Evidence from longitudinal Russian learner corpus data. The Modern Language Journal, 106(4), 798–817.
Kuiken, F., & Vedder, I. (2019). Syntactic complexity across proficiency and languages: L2 and L1 writing in Dutch, Italian and Spanish. International Journal of Applied Linguistics, 29(2), 192–210.
Kyle, K., & Crossley, S. A. (2017). Assessing syntactic sophistication in L2 writing: A usage-based approach. Language Testing, 34(4), 513–535.
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
Larsen-Freeman, D. (2006). The emergence of complexity, fluency, and accuracy in the oral and written production of five Chinese learners of English. Applied Linguistics, 27(4), 590–619.
Le Bruyn, B., & Paquot, M. (Eds.). (2021). Learner corpus research meets second language acquisition. Cambridge University Press.
Lei, L., Wen, J., & Yang, X. (2023). A large-scale longitudinal study of syntactic complexity development in EFL writing: A mixed-effects model approach. Journal of Second Language Writing, 59, 100962.
Linck, J. A., & Cunnings, I. (2015). The utility and application of mixed-effects models in second language research. Language Learning, 65(S1), 185–207.
Lu, X. (2023). Corpus linguistics and second language acquisition: Perspectives, issues, and findings. Routledge.
Lu, X., & Wang, Y. A. (2026). The corpus linguistics approach to second language acquisition. In D. Atkinson & E. Taylor (Eds.), Alternative approaches to second language acquisition (2nd ed.). Routledge.
Mazgutova, D., & Kormos, J. (2015). Syntactic and lexical development in an intensive English for academic purposes programme. Journal of Second Language Writing, 29, 3–15.
McEnery, T., Brezina, V., Gablasova, D., & Banerjee, J. (2019). Corpus linguistics, learner corpora, and SLA: Employing technology to analyze language use. Annual Review of Applied Linguistics, 39, 74–92.
McManus, K., Mitchell, R., & Tracy-Ventura, N. (2021). A longitudinal study of advanced learners’ linguistic development before, during, and after study abroad. Applied Linguistics, 42(1), 136–163.
McNamara, D. S., Graesser, A. C., McCarthy, P. M., & Cai, Z. (2014). Automated evaluation of text and discourse with Coh-Metrix. Cambridge University Press.
Mitchell, R., Domínguez, L., Arche, M. J., Myles, F., & Marsden, E. (2008). SPLLOC: A new database for Spanish second language acquisition research. EUROSLA Yearbook, 8(1), 287–304.
Mitchell, R., Tracy-Ventura, N., & McManus, K. (2017). Anglophone students abroad: Identity, social relationships and language learning. Routledge.
Morea, N., & Ghanbar, H. (2024). Q methodology in applied linguistics: A systematic research synthesis. System, 120, Article 103194.
Murakami, A. (2016). Modeling systematicity and individuality in nonlinear second language development: The case of English grammatical morphemes. Language Learning, 66(4), 834–871.
Myles, F. (2008). Investigating learner language development with electronic longitudinal corpora: Theoretical and methodological issues. In L. Ortega & H. Byrnes (Eds.), The longitudinal study of advanced L2 capacities (pp. 58–72). Routledge.
(2015). Second language acquisition theory and learner corpus research. In S. Granger, G. Gilquin, & F. Meunier (Eds.), The Cambridge handbook of learner corpus research (pp. 309–332). Cambridge University Press.
Nagle, C. L. (2021). Assessing the state of the art in longitudinal L2 pronunciation research: Trends and future directions. Journal of Second Language Pronunciation, 7(2), 154–182.
Norouzian, R. (2021). Interrater reliability in second language meta-analyses: The case of categorical moderators. Studies in Second Language Acquisition, 43(4), 896–915.
Ortega, L., & Iberri-Shea, G. (2005). Longitudinal research in second language acquisition: Recent trends and future directions. Annual Review of Applied Linguistics, 25, 26–45.
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, Article n71.
Paquot, M. (2024). Learner corpus research: A critical appraisal and roadmap for contributing (more) to SLA research agendas. Corpus Linguistics and Linguistic Theory, 20(3), 567–590.
Paquot, M., & Plonsky, L. (2017). Quantitative research methods and study quality in learner corpus research. International Journal of Learner Corpus Research, 3(1), 61–94.
Park, H. I., Solon, M., Dehghan-Chaleshtori, M., & Ghanbar, H. (2022). Proficiency reporting practices in research on second language acquisition: Have we made any progress? Language Learning, 72(1), 198–236.
Plonsky, L. (2014). Study quality in quantitative L2 research (1990–2010): A methodological synthesis and call for reform. The Modern Language Journal, 98(1), 450–470.
Plonsky, L., Hu, Y., Sudina, E., & Oswald, F. L. (2023). Advancing meta-analytic methods in L2 research. In A. Mackey & S. M. Gass (Eds.), Current approaches in second language acquisition research: A practical guide (pp. 304–333). Wiley Blackwell.
Ployhart, R. E., & MacKenzie, W. I., Jr. (2014). Two waves of measurement do not a longitudinal study make. In C. E. Lance & R. J. Vandenberg (Eds.), More statistical and methodological myths and urban legends: Doctrine, verity and fable (pp. 85–99). Routledge.
Ployhart, R. E., & Vandenberg, R. J. (2010). Longitudinal research: The theory, design, and analysis of change. Journal of Management, 36(1), 94–120.
Preacher, K. J., Wichman, A. L., MacCallum, R. C., & Briggs, N. E. (2008). Latent growth curve modeling. Sage.
Riazi, M., Shi, L., & Haggerty, J. (2018). Analysis of the empirical research in the journal of second language writing at its 25th year (1992–2016). Journal of Second Language Writing, 41, 41–54.
Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford University Press.
Skiba, R., Dittmar, N., & Bressem, J. (2009). Planning, collecting, exploring, and archiving longitudinal L2 data: Experiences from the P-Moll project. In L. Ortega & H. Byrnes (Eds.), The longitudinal study of advanced L2 capacities (pp. 89–104). Routledge.
Tracy-Ventura, N., & Huensch, A. (2018). The potential of publicly shared longitudinal learner corpora in SLA research. In A. Gudmestad & A. Edmonds (Eds.), Critical reflections on data in second language acquisition (Vol. 51, pp. 149–170). John Benjamins Publishing Company.
Tracy-Ventura, N., & Paquot, M. (Eds.). (2020). The Routledge handbook of second language acquisition and corpora. Routledge.
Vandeweerd, N., Housen, A., & Paquot, M. (2023). Comparing the longitudinal development of phraseological complexity across oral and written tasks. Studies in Second Language Acquisition, 45(4), 787–811.
Verspoor, M., Lowie, W., & Wieling, M. (2020). L2 developmental measures from a dynamic perspective. In B. Le Bruyn & M. Paquot (Eds.), Learner corpus research meets second language acquisition (1st ed., pp. 172–190). Cambridge University Press.
Vyatkina, N. (2012). The development of second language writing complexity in groups and individuals: A longitudinal learner corpus study. The Modern Language Journal, 96(4), 576–598.
Wisniewski, K. (2020). SLA developmental stages in the CEFR-related learner corpus MERLIN: Inversion and verb-end structures in German A2 and B1 learner texts. International Journal of Learner Corpus Research, 6(1), 1–37.
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. In M. Shepperd, T. Hall, & I. Myrtveit (Eds.), EASE ‘14: 18th international conference on evaluation and assessment in software engineering (pp. 1–10). Association for Computing Machinery.