Cover not available
Part of
Instructed Second Language Acquisition Research Methods
Edited by Laura Gurzynski-Weiss and YouJin Kim
[Research Methods in Applied Linguistics 3] 2022
► pp. 79–102

Chapter 4
Mixed methods research in ISLA

| Universidad Andrés Bello

This chapter explores the potential of mixed methods research (MMR) for conducting robust ISLA research to understand complex second language (L2) learning phenomena in instructed settings. MMR provides researchers with a pragmatic framework to answer research questions by mixing quantitative and qualitative approaches during data collection, analysis, and integration. In this chapter, I will first discuss how MMR can counter ISLA’s unique methodological challenges by zeroing in on the importance of the relationship between research and practice. I will then examine the three core MMR designs proposed by Creswell and Plano Clark (2018): convergent, explanatory sequential, and exploratory sequential. As a key to successful MMR, I will focus on integration of quantitative and qualitative components in writing a manuscript for publication. In conclusion, I argue that a successful MMR ISLA study carefully balances internal and ecological validity to maintain its scientific rigor, while incorporating teachers’ and students’ voices and experiences into the study.

Keywords: mixed methods research, ecological validity, evidence-based practice, practice-based research
Article outline
  • 1.What is MMR and why is it important in ISLA research?
    • 1.1MMR as a research paradigm
    • 1.2How MMR can address challenges of ISLA research
    • 1.3Practice-based research (PBR)
  • 2.Typical research questions in mixed methods ISLA research
  • 3.Common options for mixed methods research design
    • 3.1Convergent design
    • 3.2Explanatory sequential design
    • 3.3Exploratory sequential design
    • 3.4Integrating results and writing up a manuscript
  • 4.Advice for future mixed methods researchers
    • 4.1Plan ahead and choose the right MMR design
    • 4.2Collaborate with other researchers
    • 4.3Collaborate with practitioners
    • 4.4Be open-minded, critical, and creative
  • 5.Conclusions
  • 6.Further reading
  • Note
  • References
Published online: 8 December 2022
DOI logo
https://doi.org/10.1075/rmal.3.04sat
References
Aloraini, N., & Cardoso, W.
(2020) Social media in language learning: A mixed-methods investigation of students’ perceptions. Computer Assisted Language Learning. Advance online publication. DOI logoGoogle Scholar
Andujar, A.
(2020) Mobile-mediated dynamic assessment: A new perspective for second language development. ReCALL, 32 (2), 178–194. DOI logoGoogle Scholar
Bakla, A.
(2018) Learner-generated materials in a flipped pronunciation class: A sequential explanatory mixed-methods study. Computers & Education, 125 , 14–38. DOI logoGoogle Scholar
Borg, S., & Liu, Y.
(2013) Chinese college English teachers’ research engagement. TESOL Quarterly, 47 (2), 270–299. DOI logoGoogle Scholar
Brutt-Griffler, J., & Jang, E.
(2019) Dual language programs: an exploration of bilingual students’ academic achievement, language proficiencies and engagement using a mixed methods approach. International Journal of Bilingual Education and Bilingualism, 1–22. DOI logoGoogle Scholar
Bryfonski, L., & Sanz, C.
(2018) Opportunities for corrective feedback during study abroad: A mixed methods approach. Annual Review of Applied Linguistics, 38 , 1–32. DOI logoGoogle Scholar
Coburn, C. E., & Penuel, W. R.
(2016) Research-practice partnerships in education: Outcomes, dynamics, and open questions. Educational Researcher, 45 (1), 48–54. DOI logoGoogle Scholar
Cukurova, M., Luckin, R., & Baines, E.
(2018) The significance of context for the emergence and implementation of research evidence: The case of collaborative problem-solving. Oxford Review of Education, 44 (3), 322–337. DOI logoGoogle Scholar
Denscombe, M.
(2008) Communities of practice: A research paradigm for the mixed methods approach. Journal of Mixed Methods Research, 2 (3), 270–283. DOI logoGoogle Scholar
Doolan, S. M.
(2021) An exploratory analysis of source integration in post-secondary L1 and L2 source-based writing. English for Specific Purposes, 62 , 128–141. DOI logoGoogle Scholar
Egeberg, H. M., McConney, A., & Price, A.
(2016) Classroom management and national professional standards for teachers: A review of the literature on theory and practice. Australian Journal of Teacher Education, 41 (7), 1–18. DOI logoGoogle Scholar
Farley-Ripple, E., May, H., Karpyn, A., Tilley, K., & McDonough, K.
(2018) Rethinking connections between research and practice in education: A conceptual framework. Educational Researcher, 47 (4), 235–245. DOI logoGoogle Scholar
Ghiara, V.
(2020) Disambiguating the role of paradigms in mixed methods research. Journal of Mixed Methods Research, 14 (1), 11–25. DOI logoGoogle Scholar
Goldstein, H., McKenna, M., Barker, R. M., & Brown, T. H.
(2019) Research-practice partnership: Application to implementation of multi-tiered system of supports in early childhood education. Perspectives of the ASHA Special Interest Groups, 4 (1), 38–50. DOI logoGoogle Scholar
Hargreaves, D.
(2000) Teaching as a research-based profession: Possibilities and prospects. In B. Moon, J. Butcher, & E. Bird (Eds.), Leading professional development in education (pp. 200–210). Routledge.Google Scholar
Hulstijn, J. H., Young, R. F., Ortega, L., Bigelow, M., DeKeyser, R., Ellis, N. C., Lantolf, J. P., Mackey, A., & Talmy, S.
(2014) Bridging the gap: Cognitive and social approaches to research in second language learning and teaching. Studies in Second Language Acquisition, 36 (3), 361–421. DOI logoGoogle Scholar
Johnson, R., & Onwuegbuzie, A.
(2004) Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33 (7), 14–26. DOI logoGoogle Scholar
Johnson, R. B., Onwuegbuzie, A. J., & Turner, L. A.
(2007) Toward a definition of mixed methods research. Journal of Mixed Methods Research, 1 (2), 112–133. DOI logoGoogle Scholar
Joyce, K. E., & Cartwright, N.
(2020) Bridging the gap between research and practice: Predicting what will work locally. American Educational Research Journal, 57 (3), 1045–1082. DOI logoGoogle Scholar
King, K. A., & Mackey, A.
(2016) Research methodology in second language studies: Trends, concerns, and new directions. Modern Language Journal, 100 (S1), 209–227. DOI logoGoogle Scholar
Kormos, J., & Préfontaine, Y.
(2017) Affective factors influencing fluent performance: French learners’ appraisals of second language speech tasks. Language Teaching Research, 21 (6), 699–716. DOI logoGoogle Scholar
Larsen-Freeman, D.
(2015) Research into practice: Grammar learning and teaching. Language Teaching, 48 (2), 263–280. DOI logoGoogle Scholar
Leite, C., Fernandes, P., & Figueiredo, C.
(2020) National curriculum vs. curricular contextualisation: Teachers’ perspectives. Educational Studies, 46 (3), 259–272. DOI logoGoogle Scholar
Levin, B.
(2013) To know is not enough: Research knowledge and its use. Review of Education, 1 (1), 2–31. DOI logoGoogle Scholar
Li, J., McLellan, R., & Forbes, K.
(2021) Investigating EFL teachers’ gender-stereotypical beliefs about learners: A mixed-methods study. Cambridge Journal of Education, 51 (1), 19–44. DOI logoGoogle Scholar
Liao, H., & Li, Y.
(2020) Intercultural teaching approaches and practices of Chinese teachers in English education: An exploratory mixed methods study. Language Teaching Research. Advance online publication. DOI logoGoogle Scholar
Loewen, S.
(2020) Introduction to instructed second language acquisition (2nd ed.). Routledge. DOI logoGoogle Scholar
Loewen, S., & Hui, B.
(2021) Small samples in instructed second language acquisition research. Modern Language Journal, 105 (1), 187–193. DOI logoGoogle Scholar
Marsden, E., & Kasprowicz, R.
(2017) Foreign language educators’ exposure to research: Reported experiences, exposure via citations, and a proposal for action. Modern Language Journal, 101 (4), 613–642. DOI logoGoogle Scholar
Maxcy, S. J.
(2003) Pragmatic threads in mixed methods research in the social sciences: The search for multiple modes of inquiry and the end of the philosophy of formalism. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 51–89). Sage.Google Scholar
Maxwell, J. A.
(2016) Expanding the history and range of mixed methods research. Journal of Mixed Methods Research, 10 (1), 12–27. DOI logoGoogle Scholar
McIntyre, D.
(2005) Bridging the gap between research and practice. Cambridge Journal of Education, 35 (3), 357–382. DOI logoGoogle Scholar
Mitchell, R., Tracy-Ventura, N., & Huensch, A.
(2020) After study abroad: The maintenance of multilingual identity among anglophone languages graduates. Modern Language Journal, 104 (2), 327–344. DOI logoGoogle Scholar
Nakatsuhara, F., Inoue, C., Berry, V., & Galaczi, E.
(2017) Exploring the use of video-conferencing technology in the assessment of spoken language: A mixed-methods study. Language Assessment Quarterly, 14 (1), 1–18. DOI logoGoogle Scholar
Onwuegbuzie, A., & Teddlie, C.
(2003) A framework for analyzing data in mixed methods research. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 351–383). Sage.Google Scholar
Ortega, L.
(2012) Epistemological diversity and moral ends of research in instructed SLA. Language Teaching Research, 16 (2), 206–226. DOI logoGoogle Scholar
Peltonen, P.
(2018) Exploring connections between first and second language fluency: A mixed methods approach. Modern Language Journal, 102 (4), 676–692. DOI logoGoogle Scholar
Plano Clark, V. L.
(2019) Meaningful integration within mixed methods studies: Identifying why, what, when, and how. Contemporary Educational Psychology, 57 , 106–111. DOI logoGoogle Scholar
Rahimi, M., & Fathi, J.
(2021) Exploring the impact of wiki-mediated collaborative writing on EFL students’ writing performance, writing self-regulation, and writing self-efficacy: A mixed methods study. Computer Assisted Language Learning. Advance online publication. DOI logoGoogle Scholar
Rahmati, T., Sadeghi, K., & Ghaderi, F.
(2019) English language teachers’ vision and motivation: Possible selves and activity theory perspectives. RELC Journal, 50 (3), 457–474. DOI logoGoogle Scholar
Resnik, P., & Dewaele, J.-M.
(2020) Trait emotional intelligence, positive and negative emotions in first and foreign language classes: A mixed-methods approach. System, 94 , 102324. DOI logoGoogle Scholar
Révész, A., Michel, M., & Lee, M.
(2019) Exploring second language writers’ pausing and revision behaviors: A mixed-methods study. Studies in Second Language Acquisition, 41 (3), 605–631. DOI logoGoogle Scholar
Riazi, A. M.
(2016) Innovative mixed-methods research: Moving beyond design technicalities to epistemological and methodological realizations. Applied Linguistics, 37 (1), 33–49. DOI logoGoogle Scholar
Salvador-García, C., Capella-Peris, C., Chiva-Bartoll, O., & Ruiz-Montero, P. J.
(2020) A mixed methods study to examine the influence of CLIL on physical education lessons: Analysis of social interactions and physical activity levels. Frontiers in Psychology, 11 (578). DOI logoGoogle Scholar
Sánchez-Hernández, A.
(2018) A mixed-methods study of the impact of sociocultural adaptation on the development of pragmatic production. System, 75 , 93–105. DOI logoGoogle Scholar
Sandoval, W.
(2014) Conjecture mapping: An approach to systematic educational design research. Journal of the Learning Sciences, 23 (1), 18–36. DOI logoGoogle Scholar
Sasaki, M., Mizumoto, A., & Murakami, A.
(2018) Developmental trajectories in L2 writing strategy use: A self-regulation perspective. Modern Language Journal, 102 (2), 292–309. DOI logoGoogle Scholar
Sato, M.
under review). Instructed second language acquisition. In B. Spolsky & F. M. Hult Eds. The handbook of educational linguistics John Wiley & Sons
Sato, M., & Csizér, K.
(2021) Introduction to combining learner psychology and ISLA research: Intersections in the classroom. Language Teaching Research, 25 (6), 839–855. DOI logoGoogle Scholar
Sato, M., Fernández Castillo, F., & Oyanedel, J. C.
(2022) Teacher motivation and burnout of EFL teachers: Do demotivators really demotivate them? Frontiers in Psychology, 27 . DOI logoGoogle Scholar
Sato, M., & Loewen, S.
(2019) Methodological strengths, challenges, and joys of classroom-based quasi-experimental research: Metacognitive instruction and corrective feedback. In R. DeKeyser & G. Prieto Botana (Eds.), Doing SLA research with implications for the classroom: Reconciling methodological demands and pedagogical applicability (pp. 31–54). John Benjamins. DOI logoGoogle Scholar
(2022) The research-practice dialogue in second language learning and teaching: Past, present, and future. Modern Language Journal, 106 (3). DOI logoGoogle Scholar
Spada, N.
(2015) SLA research and L2 pedagogy: Misapplications and questions of relevance. Language Teaching, 48 (1), 69–81. DOI logoGoogle Scholar
(2019) Balancing methodological rigor and pedagogical relevance. In R. DeKeyser & G. P. Botana (Eds.), Doing SLA research with implications for the classroom: Reconciling methodological demands and pedagogical applicability (pp. 201–215). John Benjamins. DOI logoGoogle Scholar
Tashakkori, A., & Creswell, J.
(2007) Editorial: Exploring the nature of research questions in mixed methods research. Journal of Mixed Methods Research, 1 (3), 207–211. DOI logoGoogle Scholar
Teng, L. S., Yuan, R. E., & Sun, P. P.
(2020) A mixed-methods approach to investigating motivational regulation strategies and writing proficiency in English as a foreign language contexts. System, 88 , 102182. DOI logoGoogle Scholar
Tsang, A.
(2020) Why English accents and pronunciation ‘still’ matter for teachers nowadays: A mixed-methods study on learners’ perceptions. Journal of Multilingual and Multicultural Development, 41 (2), 140–156. DOI logoGoogle Scholar
Uprichard, E., & Dawney, L.
(2019) Data diffraction: Challenging data integration in mixed methods research. Journal of Mixed Methods Research, 13 (1), 19–32. DOI logoGoogle Scholar