Cover not available
Article published In:
International Journal of Learner Corpus Research
Vol. 9:2 (2023) ► pp.155–179
Research article

Oral reading tasks as proficiency indicators

Insights from a learner corpus study

ORCID logo | Charles University
ORCID logo | National Pingtung University
ORCID logo | University of Siena

This study aims to explore the potential of oral reading tasks to establish learners’ proficiency when compiling learner corpora. Informed by research on oral reading fluency, we selected a text containing a variety of linguistic features and submitted it to 68 English learners in Taiwan, who were interviewed for the construction of a large spoken corpus of L2 English across proficiency levels. Their proficiency was rated by trained Common European Framework of Reference (CEFR; Council of Europe, 2001, 2018, 2020) raters and ranged from A1 to B2. The performances in the reading passage were analyzed for reading rate and reading disfluencies. The relationship between reading measures and language scores was analyzed using spine plots, revealing a strong association between reading rate and language level. The number of disfluencies did not show a significant association with language level when all disfluencies were counted together. However, when different types of disfluencies were treated separately, false starts were found to be associated with language level (even though the relationship was less clear than the one reported between reading rate and language level). The study demonstrates that including a carefully selected reading passage among the tasks when compiling spoken learner corpora may be an efficient way of collecting data relating to learner performance in speech.

Keywords: reading fluency, L2 proficiency, reading rate, reading disfluencies, proficiency in learner corpora
Article outline
  • 1.Introduction
  • 2.Reading rate and disfluencies as potential measures of L2 proficiency
  • 3.Data and method
  • 4.Results
    • 4.1Reading rate – descriptive statistics
    • 4.2Disfluencies – descriptive statistics
      • 4.2.1Skipped words
      • 4.2.2Repeats
      • 4.2.3False starts
      • 4.2.4Self-corrections
  • 5.Discussion
  • 6.Conclusion
  • Notes
  • References
Published online: 8 February 2024
DOI logo
https://doi.org/10.1075/ijlcr.22013.gra
References
Anderson, J. R.
(2000) Learning and memory: An integrated approach. John Wiley.Google Scholar
Ashby, J.
(2016) Why does prosody accompany fluency? Re-conceptualizing the role of phonology in reading. In A. Khateb & I. Bar-Kochva (Eds.), Reading fluency (pp. 65–90). Springer.Google Scholar
Atkins, A.
(2014) Improving reading fluency: An investigation into timed reading. In T. Muller, J. Adamson, P. S. Brown, & S. Herder (Eds.), Exploring EFL fluency in Asia (pp. 244–260). Palgrave Macmillan. DOI logoGoogle Scholar
Bernhardt, E. B., & Kamil, M. L.
(1995) Interpreting relationships between L1 and L2 reading: Consolidating the linguistic threshold and the linguistic interdependence hypotheses. Applied Linguistics, 16 (1), 15–34. DOI logoGoogle Scholar
Bulté, B., & Roothooft, H.
(2020) Investigating the interrelationship between rated L2 proficiency and linguistic complexity in L2 speech. System, 91 1, 1–16. DOI logoGoogle Scholar
Callies, M.
(2013) Agentivity as a determinant of lexico-grammatical variation in L2 academic writing. International Journal of Corpus Linguistics, 18 (3), 357–390. DOI logoGoogle Scholar
Carlsen, C.
(2012) Proficiency level – A fuzzy variable in computer learner corpora. Applied Linguistics, 33 (2), 161–183. DOI logoGoogle Scholar
Carver, R. P.
(1990) Reading rate: A review of research and theory. Academic Press.Google Scholar
Chung, M., & Nation, P.
(2006) The effect of a speed reading course. English Teaching, 61 (4), 181–204.Google Scholar
Cilibrasi, L., Adani, F., & Tsimpli, I.
(2019) Reading as a predictor of complex syntax – The case of relative clauses. Frontiers in Psychology, 10 (Art. 1450), 1–12. DOI logoGoogle Scholar
Council of Europe
(2001) Common European framework of reference for languages: Learning, teaching, assessment. Cambridge University Press.Google Scholar
(2018) Common European framework of reference for languages: Learning, teaching, assessment companion volume with new descriptors. Council of Europe Publishing.Google Scholar
(2020) Common European framework of reference for languages: Learning, teaching, assessment companion volume. Council of Europe Publishing.Google Scholar
DeKeyser, R. M.
(2001) Automaticity and automatization. In P. Robinson (Ed.), Cognition and second language instruction (pp. 125–151). Cambridge University Press. DOI logoGoogle Scholar
Eguchi, M., & Kyle, K.
(2020) Continuing to explore the multidimensional nature of lexical sophistication: The case of oral proficiency interviews. The Modern Language Journal, 104 (2), 381–400. DOI logoGoogle Scholar
Favier, S., Meyer, A. S., & Huettig, F.
(2021) Literacy can enhance syntactic prediction in spoken language processing. Journal of Experimental Psychology: General, 150 (10), 2167–2174. DOI logoGoogle Scholar
Fuchs, L. S., Fuchs, D., Hosp, M. K., & Jenkins, J. R.
(2001) Oral reading fluency as an indicator of reading competence: A theoretical, empirical, and historical analysis. Scientific Studies of Reading, 5 (3), 239–256. DOI logoGoogle Scholar
Fuchs, L. S., Fuchs, D., & Maxwell, L.
(1988) The validity of informal reading comprehension measures. Remedial and Special Education, 9 (2), 20–28. DOI logoGoogle Scholar
Gass, S., Behney, J., & Plonsky, L.
(2013) Second language acquisition. Routledge. DOI logoGoogle Scholar
Gibson, S.
(2008) Reading aloud: a useful learning tool? ELT journal, 62 (1), 29–36. DOI logoGoogle Scholar
Gilquin, G.
(2015) From design to collection of learner corpora. In S. Granger, G. Gilquin, & F. Meunier, The Cambridge handbook of learner corpus research (pp. 9–34). Cambridge University Press. DOI logoGoogle Scholar
Grabe, W.
(2009) Reading in a second language: Moving from theory to practice. Cambridge University Press.Google Scholar
Gráf, T.
(2017) Repeats in advanced spoken English of learners with Czech as L1. AUC PHILOLOGICA, 2017 (3), 65–78. DOI logoGoogle Scholar
Granger, S., Dupont, M., Meunier, F., Naets, H., & Paquot, M.
(Eds.) (2020) The International Corpus of Learner English (Version 3). Presses Universitaires de Louvain.Google Scholar
Hawkins, J. A., & Buttery, P.
(2010) Criterial features in learner corpora: Theory and illustrations. English Profile Journal, 1 (1/e5), 1–23. DOI logoGoogle Scholar
Helliwell, M.
(2015) Business Plus 3. Cambridge University Press.Google Scholar
Huang, L., & Gráf, T.
(2021) Expanding LINDSEI to spoken learner English from several L1s across CEFR levels. Corpora, 16 (2), 271–285. DOI logoGoogle Scholar
Huang, L., Kubelec, S., Keng, N., & Hsu, L.
(2018) Evaluating CEFR rater performance through the analysis of spoken learner corpora. Language Testing in Asia, 8 (14), 1–17. DOI logoGoogle Scholar
Hudson, R. F., Paige, C. P., Holly, B. L., & Torgesen, J. K.
(2009) The complex nature of reading fluency: A multidimensional view. Reading & Writing Quarterly, 25 (1), 4–32. DOI logoGoogle Scholar
Huettig, F., & Pickering, M. J.
(2019) Literacy advantages beyond reading: Prediction of spoken language. Trends in Cognitive Sciences, 23 (6), 464–475. DOI logoGoogle Scholar
Ishikawa, S.
(2015) Lexical development in L2 English learners’ speeches and writings. Procedia – Social and Behavioral Sciences, 198 1, 202–210. DOI logoGoogle Scholar
Jasińska, K. K., Frost, S., Molfese, P., Landi, N., Mencl, W. E., Rueckl, J., & Pugh, K.
(2016) Neuroimaging perspectives on skilled and impaired reading and the bilingual experience. In A. Khateb & I. Bar-Kochva (Eds.), Reading fluency (pp. 25–49). Springer International Publishing.Google Scholar
Jendryczka-Wierszycka, J.
(2009) Collecting spoken learner data: Challenges and benefits. A Polish L1 perspective. In M. Mahlberg, V. González-Díaz, & C. Smith (Eds.), Proceedings of the 2009 Corpus Linguistics Conference, University of Liverpool, UK, 20–23 July 2009, Article 230.Google Scholar
Jeon, E.
(2012) Oral reading fluency in second language reading. Reading in a Foreign Language, 24 1, 186–208.Google Scholar
Jiang, X., Sawaki, Y., & Sabatini, J.
(2012) Word reading efficiency, text reading fluency, and reading comprehension among Chinese learners of English. Reading Psychology, 33 (4), 323–349. DOI logoGoogle Scholar
Kallio, H., Šimko, J., Huhta, A., Karhila, R., Vainio, M., Lindroos, E., Hildén, R., & Kurimo, M.
(2018) Towards the phonetic basis of spoken second language assessment: Temporal features as indicators of perceived proficiency level. AFinLA-Sovelt. Kielitieteen Tutkimuksia, 101, 193–213. DOI logoGoogle Scholar
Kang, O., & Yan, X.
(2018) Linguistic features distinguishing examinees’ speaking performances at different proficiency levels. Journal of Language Testing & Assessment, 1 1, 24–39. DOI logoGoogle Scholar
Kato, S., & Tanaka, K.
(2015) Reading aloud performance and listening ability in an L2: The case of college-level Japanese EFL users. Open Journal of Modern Linguistics, 5 (2), 187–206. DOI logoGoogle Scholar
Khateb, A., & Bar-Kochva, I.
(Eds.) (2016) Reading fluency. SpringerGoogle Scholar
Koda, K.
(1996) L2 word recognition research: A critical review. The Modern Language Journal, 80 (4), 450–460. DOI logoGoogle Scholar
Kuhn, M. R., & Stahl, S. A.
(2004) Fluency: A review of developmental and remedial practices. In R. B. Ruddell & N. J. Unrau (Eds.), Theoretical models and processes of reading (pp. 412–453). International Reading Association.Google Scholar
LaBerge, D., & Samuels, S. J.
(1974) Toward a theory of automatic information processing in reading. Cognitive Psychology, 6 (2), 293–323. DOI logoGoogle Scholar
Lems, K.
(2003) Adult ESL oral reading fluency and silent reading comprehension. National Louis University.Google Scholar
Mukherjee, J.
(2009) The grammar of conversation in advanced spoken learner English: Learner corpus data and language-pedagogical implications. In K. Aijmer (Ed.), Corpora and language teaching (pp. 203–230). John Benjamins. DOI logoGoogle Scholar
Osborne, J.
(2008) Adverb placement in post-intermediate learner English: A contrastive study of learner corpora. In G. Gilquin, S. Papp, & M. Díez-Bedmar (Eds.), Linking up contrastive and learner corpus research (pp. 127–146). Rodopi. DOI logoGoogle Scholar
Park, H. I., Solon, M., Dehghan-Chaleshtori, M., & Ghanbar, H.
(2022) Proficiency reporting practices in research on second language acquisition: Have we made any progress? Language Learning, 72 (1), 198–236. DOI logoGoogle Scholar
Perfetti, C. A.
(1985) Reading ability. Oxford University Press.Google Scholar
Ramig, L. A.
(1983) Effects of physiological aging on speaking and reading rates. Journal of Communication Disorders, 16 (3), 217–226. DOI logoGoogle Scholar
Segalowitz, N., & Hulstijn, J.
(2005) Automaticity in bilingualism and second language learning. In J. F. Kroll & A. M. B. de Groot (Eds.), Handbook of bilingualism: Psycholinguistic approaches (pp. 371–388). Oxford University Press.Google Scholar
Taguchi, E., Gorsuch, G., & Sasamoto, E.
(2006) Developing second and foreign language reading fluency and its effect on comprehension: A missing link. The Reading Matrix, 6 1, 1–18.Google Scholar
Waring, R.
(2014) Building fluency with extensive reading. In T. Muller, J. Adamson, P. S. Brown, & S. Herder (Eds.), Exploring EFL fluency in Asia (pp. 213–230). Palgrave Macmillan.Google Scholar
Wolf, M., & Katzir-Cohen, T.
(2001) Reading fluency and its intervention. Scientific Studies of Reading, 5 (3), 211–239. DOI logoGoogle Scholar