The effects of frequency, duration, and intensity on L2 learning through Duolingo
A natural experiment
Instructed second language (L2) research has frequently addressed the effects of spacing, or, alternatively, the
distribution of practice effects. The present study addresses
Rogers and Cheung’s
(2021) concerns about the ecological validity of such work via a natural experiment (
Craig et al., 2017). Learners’ self-determined exposure and in-app behavior were examined in relation to
language gains over time. Duolingo learners of Spanish or French (
N = 287) completed a background questionnaire,
scales measuring L2 motivation and grit, and two tests of L2 proficiency before and after a six-month period of user-controlled
app usage. Total minutes of app exposure exhibited a correlation with written but not oral proficiency gains. More dependable
correlates of gains were frequency- and curriculum-oriented measures. Additionally, L2 grit and motivation were weakly to
moderately correlated with several in-app behaviors. We conclude with implications for how apps can best be leveraged to produce
L2 gains.
Article outline
- 1.Introduction
- 2.Literature review
- 2.1Distributed learning
- 2.2Natural experiment
- 2.3Mobile-assisted language learning
- 2.4L2 grit and motivation
- 2.5The Duolingo course structure
- 2.6The present study
- 3.Method
- 3.1Participants
- 3.2Instruments and materials
- 1.Exposure/behavioral data
- 2.Self-report data
- 3.L2 proficiency
- 3.3Procedure
- 3.4Data analysis
- 4.Results
- 4.1Preliminary analyses: Scale data
- 4.2Preliminary analyses: Proficiency data
- 4.3RQ1: To what extent do learner gains differ when tested in the written vs. oral mode?
- 4.4RQ2: To what extent are frequency, duration, and intensity of Duolingo app usage associated with gains in L2 Spanish and
French?
- 4.5RQ3: To what extent are L2 grit and motivation associated with the frequency, duration, and intensity with which learners use
Duolingo?
- 4.6RQ4: To what extent are L2 grit and motivation associated with gains in L2 Spanish and French?
- 5.Discussion
- 6.Conclusion
- Acknowledgements
- Notes
-
References
References (56)
References
Carpenter, S. K. (2020). Distributed
practice/spacing effect. In Li-fang Zhang (Ed.), Oxford
Research Encyclopedia of
Education (pp. 1–20). Oxford University Press. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cepeda, N. J., Vul, E., Rohrer, D., Wixted, J. T., & Pashler, H. (2008). Spacing
effects in learning: A temporal ridgeline of optimal retention. Psychological
Science,
19
(11), 1095–1102. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Council of Europe. (2001). Common European
Framework of Reference for languages: Learning, teaching, assessment. Retrieved
from [URL]
Counsell, C. L. (2018). The
C‑test in French: Development and validation of a language proficiency test for research
purposes. In J. M. Norris (Ed.), Developing
C‑tests for estimating proficiency in foreign language
research (pp. 203–230). Peter Lang.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Craig, P., Katikireddi, S. V., Leyland, A., & Popham, F. (2017). Natural
experiments: An overview of methods, approaches, and contributions to public health intervention
research. Annual Review of Public
Health,
38
1, 39–56. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Delaney, P. F., Verkoeijen, P. P. J. L., & Spirgel, A. (2010). Spacing
and testing effects: A deeply critical, lengthy, and at times discursive review of the
literature. In B. H. Ross (Ed.), The
psychology of learning and motivation: Advances in research and
theory (Vol. 531, pp. 63–147). Academic Press. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Duckworth, A. L., Peterson, C., Matthews, M. D., & Kelly, D. R. (2007). Grit:
Perseverance and passion for long term goals. Journal of Personality and Social
Psychology,
92
1, 1087–1101. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Ellis, R. (2005). Measuring
implicit and explicit knowledge of a second language: A Psychometric Study. Studies in Second
Language
Acquisition,
27
(2), 141–172. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gaillard, S., & Tremblay, A. (2016). Linguistic
proficiency assessment in second Language acquisition research: The elicited imitation
task. Language
Learning,
66
1, 419–447. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
García Botero, G., Questier, F., & Zhu, C. (2019). Self-directed
language learning in a mobile-assisted, out-of-class context: do students walk the
talk? Computer Assisted Language
Learning,
32
1, 71–97. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Gass, S. M., Behney, J., & Plonsky, L. (2020). Second
language acquisition: An introductory course (5th
ed.). Routledge. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Heo, Y. (2016). Heritage
and L2 learners’ acquisition of Korean in terms of implicit and explicit knowledge. PhD
dissertation, Michigan State University, East Lansing.
Jiang, X., Chen, H., Portnoff, L., Gustafson, E., Rollinson, J., Plonsky, L., & Pajak, B. (2021). Seven
units of Duolingo courses comparable to 5 university semesters in reading and
listening. Duolingo Research Report DRR-21-03.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jiang, X., Rollinson, J., Chen, H., Reuveni, B., Gustafson, E., Plonsky, L., & Pajak, B. (2021). How
well does Duolingo teach speaking skills? Duolingo Research Report
DRR-21-02.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jiang, X., Rollinson, J., Plonsky, L., & Pajak, B. (2020). Duolingo
efficacy study: Beginning-level courses equivalent to four university semesters. Duolingo
Research Report DRR-20-04.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Jiang, X., Rollinson, J., Plonsky, L., Gustafson, E., & Pajak, B. (2021). Evaluating
the reading and listening outcomes of beginning-level Duolingo courses. Foreign Language
Annals,
54
1, 974–1002. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kasprowicz, R. E., Marsden, E., & Sephton, N. (2019). Investigating
distribution of practice effects for the learning of foreign language verb morphology in the young
learner. Modern Language
Journal,
103
1, 580–606. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kim, S. K., & Webb, S. (2022). The
effects of spaced practice on second language learning: A meta-analysis. Language
Learning,
72
1, 269–319. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Kostromitina, M., & Plonsky, L. (2022). Elicited
imitation tasks as a measure of L2 proficiency: A meta-analysis. Studies in Second Language
Acquisition,
44
1, 886–911. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Li, M., & DeKeyser, R. (2019). Distribution
of practice effects in the acquisition and retention of L2 Mandarin tonal word
production. Modern Language
Journal,
103
1, 607–628. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Loewen, S. (2020). Introduction
to instructed second language acquisition (2nd
ed.). Routledge. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Loewen, S., Crowther, D., Isbell, D., Kim, K., Maloney, J., Miller, Z., & Rawal, H. (2019). Mobile-assisted
language learning: A Duolingo case
study. ReCALL,
31
(3), 293–311. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Loewen, S., Isbell, D., & Sporn, Z. (2020). The
effectiveness of app-based language instruction for developing receptive linguistic knowledge and oral communicative
ability. Foreign Language
Annals,
53
(2), 209–233. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
McKay, T. (2019). More
on the validity and reliability of C‑test scores: A meta-analysis of C‑test
studies (Unpublished doctoral dissertation). Georgetown University, Washington, DC.
Nakata, T. (2015). Effects of expanding and equal spacing on second language vocabulary learning: Does gradually increasing spacing increase vocabulary learning?. Studies in Second Language Acquisition,
37
1, 677–711. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Nakata, T., & Suzuki, Y. (2019). Effects
of massing and spacing on the learning of semantically related and unrelated words. Studies in
Second Language
Acquisition,
41
1, 287–311. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Norris, J. M., & Ortega, L. (2000). Effectiveness
of L2 instruction: A research synthesis and quantitative meta-analysis. Language
Learning,
50
1, 417–528. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Papi, M., Bondarenko, A., Mansouri, S., Feng, L., & Jiang, C. (2019). Rethinking
L2 motivation research: The 2 × 2 model of L2 self-guides. Studies in Second Language
Acquisition,
41
1, 337–361. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Park, D., Yu, A., Baelen, R. N., Tsukayama, E., & Duckworth, A. L. (2018). Fostering
grit: Perceived school goal-structure predicts growth in grit and grades. Contemporary
Educational
Psychology,
55
1, 120–128. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Pawlak, M., & Kruk, M. (2022). Individual
differences in computer assisted language learning
research. Routledge. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Plonsky, L., & Oswald, F. L. (2014). How
big is “big”? Interpreting effect sizes in L2 research. Language
Learning,
64
1, 878–912. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Plonsky, L., & Ziegler, N. (2016). The
CALL-SLA interface: Insights from a second-order synthesis. Language Learning &
Technology,
20
1, 17–37.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Reinders, H., & Stockwell, G. (2017). Computer-assisted
SLA. In S. Loewen & M. Sato (Eds.), The
Routledge handbook of instructed second language
acquisition (pp. 108–125). Routledge. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Riggs, D., & Maimone, L. L. (2018). A
computerized-administered C‑test in Spanish. In J. M. Norris (Ed.), Developing
C‑tests for estimating proficiency in foreign language
research (pp. 265–294). Peter Lang.![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rohrer, D. (2015). Student
instruction should be distributed over long time periods. Educational Psychology
Review,
27
(4), 635–643. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rogers, J. (2017). The
spacing effect and its relevance to second language acquisition. Applied
Linguistics,
38
(6), 906–911. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rogers, J. (2023). Spacing
effects in task repetition research. Language
Learning,
73
(2), 445–474. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rogers, J., & Cheung, A. (2020). Input
spacing and the learning of L2 vocabulary in a classroom context. Language Teaching
Research,
24
(5), 616–641. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Rogers, J., & Cheung, A. (2021). Does
it matter when you review? Input spacing, ecological validity, and the learning of L2
vocabulary. Studies in Second Language
Acquisition,
43
1, 1138–1156. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Saito, K., & Plonsky, L. (2019). Measuring
the effects of second language pronunciation teaching: A proposed framework and
meta-analysis. Language
Learning,
69
1, 652–708. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Schmidt, F. T., Nagy, G., Fleckenstein, J., Möller, J., & Retelsdorf, J. (2018). Same
same, but different? Relations between facets of conscientiousness and grit. European Journal
of
Personality,
32
1, 705–720. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Serrano, R. (2011). The
time factor in EFL classroom practice. Language
Learning,
61
(1), 117–145. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Serrano, R. (2022). A
state-of-the-art review of distribution-of-practice effects on L2 learning. Studies in Second
Language Learning and
Teaching,
12
(3), 355–379. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Serrano, R., & Huang, H. Y. (2018). Learning
vocabulary through assisted repeated reading: How much time should there be between repetitions of the same
text? TESOL
Quarterly,
52
(4), 971–994. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Serrano, R., & Huang, H. Y. (2023). Time
distribution and intentional vocabulary learning through repeated reading: A partial replication and
extension. Language
Awareness,
32
(1), 1–18. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Solon, M., Park, H. I., Henderson, C., & Dehghan-Chaleshtori, M. (2019). Revisiting
the Spanish elicited imitation task: A tool for assessing advanced language learners? Studies
in Second Language
Acquisition,
41
1, 1027–1053. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Sudina, E., & Plonsky, L. (2021a). Academic
perseverance in foreign language learning: An investigation of language-specific grit and its conceptual
correlates. Modern Language
Journal,
105
1, 829–857. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Suzuki, Y. (2017). The
optimal distribution of practice for the acquisition of L2 morphology: A conceptual replication and
extension. Language
Learning,
67
(3), 512–545. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Suzuki, Y., & DeKeyser, R. (2017). Effects
of distributed practice on the proceduralization of morphology. Language Teaching
Research,
21
(2), 166–188. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Teimouri, Y. (2017). L2
selves, emotions, and motivated behaviors. Studies in Second Language
Acquisition,
39
1, 681–709. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Teimouri, Y., Sudina, E., & Plonsky, L. (2021). On
domain-specific conceptualization and measurement of grit in L2 learning. Journal for the
Psychology of Language
Learning,
3
1, 156–164. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Teimouri, Y., Plonsky, L., & Tabandeh, F. (2022). L2
Grit: Passion and perseverance for second-language learning. Language Teaching
Research,
26
1, 893–918. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Uchihara, T., Webb, S., & Yanagisawa, A. (2019). The
effects of repetition on incidental vocabulary learning: A meta-analysis of correlational
studies. Language
Learning,
69
(3), 559–599. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Yamagata, S., Nakata, T., & Rogers, J. (2023). Effects of distributed practice on the acquisition of verb-noun collocations. Studies in Second Language Acquisition,
45
1, 291–317. ![DOI logo](https://benjamins.com/logos/doi-logo.svg)
![Google Scholar](https://benjamins.com/logos/google-scholar.svg)
Cited by (1)
Cited by one other publication
Hwang, Hyun-Bin, Matthew D. Coss, Shawn Loewen & Kaitlyn M. Tagarelli
2024.
Acceptance and engagement patterns of mobile-assisted language learning among non-conventional adult L2 learners: A survival analysis.
Studies in Second Language Acquisition ► pp. 1 ff.
![DOI logo](//benjamins.com/logos/doi-logo.svg)
This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.