Cover not available
Article published In:
Journal of Second Language Pronunciation
Vol. 9:1 (2023) ► pp.103–129

Is seeing believing?

The role of ultrasound tongue imaging and oral corrective feedback in L2 pronunciation development

ORCID logo | Georgetown University
This study compares the effects of visual and oral corrective feedback (CF) on L2 pronunciation development. While many studies have investigated the effects of oral CF for various types of L2 learner productions (Li, 2010; Mackey & Goo, 2007), research in visual biofeedback is still developing (Antolík et al., 2019; Gick, et al., 2008). In this study, 21 Japanese learners of English were divided into two groups: an oral CF group and a visual (ultrasound) CF group where participants received either oral or visual feedback on task-essential pronunciations of English /l/ and /r/ after induced communication breakdowns in task-based interactions. Development, determined by accuracy ratings of /l/ and /r/ productions and comprehensibly ratings of phrases from reading passages by naïve raters, was examined pre and post participation in task-based interactions. Introspective reports in the form of stimulated recall interviews assessed learners’ noticing of visual and oral CF and provided qualitative evaluations of the utility of ultrasound imaging for improving pronunciation. Findings uncovered gains for the group who received biofeedback using ultrasound on a story reading task, but not a word list task, when compared with learners who only received oral CF. The training was positively received by participants with those in the ultrasound group finding use of the ultrasound motivating and useful for their production of /r/ and /l/.
Keywords: corrective feedback, ultrasound, biofeedback, pronunciation, interaction
Article outline
  • 1.Introduction
  • 2.Literature review
    • 2.1Oral CF and task-based interaction
    • 2.2Japanese learners’ acquisition of English /l/ and /r/
    • 2.3Ultrasound tongue imaging for L2 research
  • 3.Research questions
  • 4.Methods
    • 4.1Participants
    • 4.2Procedure
    • 4.3Materials
      • 4.3.1Development tests
      • 4.3.2Interactive tasks
      • 4.3.3Stimulated recall and semi-structured interviews
    • 4.4Data processing and analysis
  • 5.Results
    • 5.1Research question 1
    • 5.2Research question 2
  • 6.Discussion
    • 6.1Potential for ultrasound as an instrument for biofeedback
    • 6.2Learners’ qualitative experiences
    • 6.3Limitations and future directions
  • 7.Conclusion
  • Notes
  • References
Published online: 25 September 2023
DOI logo
https://doi.org/10.1075/jslp.22051.bry
References (79)
References
Adler-Bock, M., Bernhardt, B. M., Gick, B., & Bacsfalvi, P. (2007). The use of ultrasound in remediation of North American English /r/in 2 adolescents. American Journal of Speech-Language Pathology, 16 (2), 128–139. DOI logoGoogle Scholar
Antolík, T. K., Pillot-Loiseau, C., & Kamiyama, T. (2019). The effectiveness of real-time ultrasound visual feedback on tongue movements in L2 pronunciation training: Japanese learners’ progress on the French vowel contrast /y/-/u/. Journal of Second Language Pronunciation, 5(1), 72–97. DOI logoGoogle Scholar
Bernhardt, B., Gick, B., Bacsfalvi, P., & Ashdown, J. (2003). Speech habilitation of hard of hearing adolescents using electropalatography and ultrasound as evaluated by trained listeners. Clinical Linguistics & Phonetics, 17 (3), 199–216. DOI logoGoogle Scholar
Bernhardt, B., Bacsfalvi, P., Gick, B., & Radanov, B. & Williams, R. (2005). Exploring electropalatography and ultrasound in speech habilitation. Journal of Speech Language Pathology and Audiology, 29 (4), 169–182.Google Scholar
Best, C. T. (1995). A direct realist view of cross-language speech perception. In W. Strange. (Ed.), Speech perception and linguistic experience: Issues in cross-language research. (pp. 171–206). York Press.Google Scholar
Best, C. T., & Tyler, M. D. (2007). Nonnative and second-language speech perception: Commonalities and complementaries. In O. S. Bohn & M. J. Munro. (Eds.), Language experience in second language speech learning: In honor of James Emil Flege (pp. 13–34). John Benjamins. DOI logoGoogle Scholar
Bliss, H., Bird, S., Cooper, A. P., Burton, S. & Gick, B. (2018). Seeing speech: Ultrasound-based multimedia resources for pronunciation learning in Indigenous languages. Language Documentation & Conservation, 121, 315–338.Google Scholar
Bradlow, A. R., Pisoni, D. B., Akahane-Yamada, R., & Tohkura, Y. I. (1997). Training Japanese listeners to identify English /r/and /l/: IV. Some effects of perceptual learning on speech production. The Journal of the Acoustical Society of America, 101 (4), 2299–2310. DOI logoGoogle Scholar
Bryfonski, L. & Ma, X. (2020). Effects of Implicit versus Explicit Feedback on Mandarin Tone Acquisition in a SCMC Learning Environment. Studies in Second Language Acquisition, 42 (1), 61–88. DOI logoGoogle Scholar
Carpenter, H., Jeon, K. S., MacGregor, D., & Mackey, A. (2006). Learners’ interpretations of recasts. Studies in Second Language Acquisition 28 (2), 209–236. DOI logoGoogle Scholar
De Decker, P. M., & Nycz, J. R. (2012). Are tense [æ] s really tense? The mapping between articulation and acoustics. Lingua, 122 (7), 810–821. DOI logoGoogle Scholar
Derwing, T. M., & Munro, M. J. (2005). Second language accent and pronunciation teaching: A research-based approach. TESOL Quarterly, 39 (3), 379–397. DOI logoGoogle Scholar
Dlaska, A., & Krekeler, C. (2013). The short-term effects of individual CF on L2 pronunciation. System, 41 (1), 25–37. DOI logoGoogle Scholar
Ellis, R., Basturkmen, H., & Loewen, S. (2001). Learner uptake in communicative ESL lessons. Language Learning, 51 (2), 281–318. DOI logoGoogle Scholar
Erlam, R., & Loewen, S. (2010). Implicit and explicit recasts in L2 oral French interaction. Canadian Modern Language Review, 66 (6), 877–905. DOI logoGoogle Scholar
Flege, J. E. (1987). The production of “new” and “similar” phones in a foreign language: Evidence for the effect of equivalence classification. Journal of Phonetics, 15 (1), 47–65. DOI logoGoogle Scholar
(1995). Second language speech learning: Theory, findings, and problems. In W. Strange. (Ed.), Speech perception and linguistic experience: Issues in cross-language research, (pp. 233–277). York Press.Google Scholar
Flege, J. E., Bohn, O., & Jang, S. (1997). Effects of experience on non-native speakers’ production and perception of English vowels. Journal of Phonetics, 25 (4), 437–470. DOI logoGoogle Scholar
Gass, S. M. (1997). Input, interaction, and the second language learner. Lawrence Erlbaum Associates.Google Scholar
Gass, S. M., & Mackey, A. (2006). Input, interaction and output in SLA. In J. Williams and B. VanPatten. (Eds.), Theories in second language acquisition: An introduction (pp. 175–199). Lawrence Erlbaum Associates.Google Scholar
Gass, S., & Mackey, A. (2017). Stimulated recall methodology in applied linguistics and L2 research. Routledge.Google Scholar
Gass, S., Mackey, A., & Ross-Feldman, L. (2005). Task-based interactions in classroom and laboratory settings. Language Learning, 55 (4), 575–611. DOI logoGoogle Scholar
Gick, B. (2002). The use of ultrasound for linguistic phonetic fieldwork. Journal of the International Phonetic Association, 32 (2), 113–121. DOI logoGoogle Scholar
Gick, B., Bernhardt, B., Bacsfalvi, P., & Wilson, I. (2008). Ultrasound imaging applications in second language acquisition. In J. G. H. Edwards & M. L. Zampini. (Eds.), Phonology and second language acquisition (pp. 309–322). John Benjamins. DOI logoGoogle Scholar
Goto, H. (1971). Auditory perception by normal Japanese adults of the sounds “L” and “R.”. Neuropsychologia, 9 (3), 317–323. DOI logoGoogle Scholar
Guion, S., Flege, J. E., Akahane-Yamada, R., & Pruitt, J. (2000). An investigation of current models of second language speech perception: The case of Japanese adults’ perception of English consonants. The Journal of the Acoustical Society of America, 107 (5), 2711–2724. DOI logoGoogle Scholar
Gut, U. (2009). Non-native speech: A corpus-based analysis of phonological and phonetic properties of L2 English and German. Peter Lang. DOI logoGoogle Scholar
Hardison, D. (2003). Acquisition of second-language speech: Effects of visual cues, context, and talker variability. Applied Psycholinguistics, 24 (4), 495–522. DOI logoGoogle Scholar
Hattori, K. (2010). Perception and production of English /r/-/l/ by adult Japanese speakers [Doctoral dissertation, University College London].
Heyne, M., Derrick, D., & Al-Tamimi, J. (2019). Native language influence on brass instrument performance: An application of generalized additive mixed models (GAMMs) to midsagittal ultrasound images of the tongue. Frontiers in Psychology, 10 1, 2597. DOI logoGoogle Scholar
Isaacs, T., & Trofimovich, P. (Eds.). (2016). Second language pronunciation assessment: Interdisciplinary perspectives. Multilingual Matters. DOI logoGoogle Scholar
Kang, O. (2012). Impact of rater characteristics and prosodic features of speaker accentedness on ratings of international teaching assistants’ oral performance. Language Assessment Quarterly, 9 (3), 249–269. DOI logoGoogle Scholar
Kissling, E. M. (2013). Teaching pronunciation: Is explicit phonetics instruction beneficial for FL learners? The Modern Language Journal, 97(3), 720–744. DOI logoGoogle Scholar
(2014). What predicts the effectiveness of foreign-language pronunciation instruction? Investigating the role of perception and other individual differences. Canadian Modern Language Review, 70 (4), 532–558. DOI logoGoogle Scholar
Komaki, R. & Choi, Y. (1999). Effects of native language on the perception of American English /r/ and /l/: Cross-language comparison between Korean and Japanese. Proceedings of the 14th International Congress of Phonetic Sciences (ICPhS-14), 1429–1432.Google Scholar
Labov, W. (1972). Sociolinguistic patterns. Philadelphia: University of Pennsylvania Press.Google Scholar
Lambacher, S. (1999). A CALL tool for improving second language acquisition of English consonants by Japanese learners. Computer Assisted Language Learning, 12 (2), 137–156. DOI logoGoogle Scholar
Larson-Hall, J. (2006). What does more time buy you? Another look at the effects of long-term residence on production accuracy of English /inverted r/and /l/ by Japanese speakers. Language and Speech, 49 (4), 521–548. DOI logoGoogle Scholar
Lee, J., Jang, J. & Plonsky, L. (2015). The effectiveness of second language pronunciation instruction: a meta-analysis. Applied Linguistics, 36 (3), 345–366. DOI logoGoogle Scholar
Lee, A., & Lyster, R. (2016). Effects of different types of CF on receptive skills in a second language: A speech perception training study. Language Learning, 66 (4), 809–833. DOI logoGoogle Scholar
Li, S. (2010). The effectiveness of CF in SLA: A meta-analysis. Language learning, 60 (2), 309–365. DOI logoGoogle Scholar
Lindemann, S., & Subtirelu, N. (2013). Reliably biased: The role of listener expectation in the perception of second language speech. Language Learning, 63 (3), 567–594. DOI logoGoogle Scholar
Logan, J., Lively, S., & Pisoni, D. (1991). Training Japanese listeners to identify English /r/and/l/: A first report. The Journal of the Acoustical Society of America, 89 (2), 874–886. DOI logoGoogle Scholar
Long, M. H. (1980). Input, interaction, and second language acquisition. [Unpublished doctoral dissertation]. UCLA.
(1983). Native speaker/non-native speaker conversation and the negotiation of comprehensible input. Applied Linguistics, 4 (2), 126–141. DOI logoGoogle Scholar
Long, M. (1996). The role of the linguistic environment in second language acquisition. In W. C. Ritchie & T. K. Bhatia. (Eds.), Handbook of second language acquisition. (pp. 413–468). Academic Press.Google Scholar
(2015). Second language acquisition and task-based language teaching. Wiley.Google Scholar
Loschky, L., & Bley-Vroman, R. (1993). Grammar and task-based methodology. In G. Crookes & S. Gass (Eds.), Tasks and language learning: Integrating theory and practice (pp. 123–167). Multilingual Matters.Google Scholar
Lyster, R. (1998). Recasts, repetition, and ambiguity in L2 classroom discourse. Studies in Second Language Acquisition, 20 (1), 51–81. DOI logoGoogle Scholar
Lyster, R., & Ranta, L. (1997). CF and learner uptake: Negotiation of form in communicative classrooms. Studies in Second Language Acquisition, 19 (1), 37–66. DOI logoGoogle Scholar
Lyster, R., & Saito, K. (2010). Oral feedback in classroom SLA: A meta-analysis. Studies In Second Language Acquisition, 32 (2), 265–302. DOI logoGoogle Scholar
Mackey, A., Abbuhl, R., & Gass, S. M. (2012). Interactionist approach. In S. Gass & A. Mackey. (Eds.) The Routledge handbook of second language acquisition (pp. 7–24). Routledge.Google Scholar
Mackey, A., Gass, S., & McDonough, K. (2000). How do learners perceive interactional feedback?. Studies in Second Language Acquisition, 22 (4), 471–497. DOI logoGoogle Scholar
Mackey, A., & Goo, J. (2007). Interaction research in SLA: A meta-analysis and research synthesis. In A. Mackey. (Ed.), Conversational interaction in second language acquisition: A collection of empirical studies (pp. 407–451). Oxford University Press.Google Scholar
Mackey, A., & Philp, J. (1998). Conversational interaction and second language development: Recasts, responses, and red herrings? The Modern Language Journal, 82 (3), 338–356. DOI logoGoogle Scholar
Munro, M. J., & Derwing, T. M. (1995). Foreign accent, comprehensibility, and intelligibility in the speech of second language learners. Language Learning, 45 (1), 73–97. DOI logoGoogle Scholar
Parlak, Ö., & Ziegler, N. (2017). The impact of recasts on the development of primary stress in a synchronous computer-mediated environment. Studies in Second Language Acquisition, 39 (2), 257–285. DOI logoGoogle Scholar
Pica, T., & Doughty, C. (1985). The role of group work in classroom second language acquisition. Studies in Second Language Acquisition, 7 (2), 233–248. DOI logoGoogle Scholar
Pica, T., Kanagy, R., & Falodun, J. (1993). Choosing and using communication tasks for second language instruction. In K. Van den Branden, M. Bygate, & J. M. Norris. (Eds.), Task-based language teaching: A reader (pp. 171–192). John Benjamins.Google Scholar
Plonsky, L., & Oswald, F. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64 (4), 878–912. DOI logoGoogle Scholar
Preston, J. L., Byun, T., Boyce, S., Hamilton, S., Tiede, M., Phillips, E., Rivera-Campos, A. & Whalen, D. (2017). Ultrasound images of the tongue: A tutorial for assessment and remediation of speech sound errors. Journal of Visualized Experiments: JoVE, (1191).Google Scholar
Price, P. (1981). A cross-linguistic study of flaps in Japanese and in American English. [Unpublished dissertation]. University of Pennsylvania.
Saito, K. (2013). The acquisitional value of recasts in instructed second language speech learning: Teaching the perception and production of English /ɹ/ to adult Japanese learners. Language Learning, 63 (3), 499–529. DOI logoGoogle Scholar
(2015). Variables affecting the effects of recasts on L2 pronunciation development. Language Teaching Research, 19 (3), 276–300. DOI logoGoogle Scholar
Saito, K., & Lyster, R. (2012). Effects of form-focused instruction and CF on L2 pronunciation development of /ɹ/ by Japanese learners of English. Language Learning, 62 (2), 595–633. DOI logoGoogle Scholar
Schmidt, R., & Frota, S. (1986). Developing basic conversational ability in a second language: A case study of an adult learner of Portuguese. In R. R. Day. (Ed.), Talking to learn: Conversation in second language acquisition (pp. 237–326). Harper Collins.Google Scholar
Sheen, Y. (2006). Exploring the relationship between characteristics of recasts and learner uptake. Language Teaching Research, 10 (4), 361–392. DOI logoGoogle Scholar
Solon, M., Long, A. Y., & Gurzynski-Weiss, L. (2017). Task complexity, language-related-episodes, and production of L2 Spanish vowels. Studies in Second Language Acquisition, 39 (2), 347–380. DOI logoGoogle Scholar
Stone, M. (2005). A guide to analyzing tongue motion from ultrasound images, Clinical Linguistics & Phonetics, 19(6/7), 455–501. DOI logoGoogle Scholar
Swain, M. (1995). Three functions of output in second language learning. In G. Cook, & B. Seidlhofer. (Eds.), Principles and practice in applied linguistics: Studies in honour of HG Widdowson (pp. 125–144). OUP.Google Scholar
(2005). The output hypothesis: Theory and research. In E. Hinkel. (Ed.), Handbook of research in second language teaching and learning (pp. 495–508). Routledge.Google Scholar
Takagi, N. (2002). The limits of training Japanese listeners to identify English /r/ and /l/: Eight case studies. The Journal of the Acoustical Society of America, 111(6), 2887–2896. DOI logoGoogle Scholar
Takagi, N., & Mann, V. (1995). The limits of extended naturalistic exposure on the perceptual mastery of English /r/ and /l/ by adult Japanese learners of English. Applied Psycholinguistics, 16(4), 380–406. DOI logoGoogle Scholar
Tateishi, M., & Winters, S. (2013). Does ultrasound training lead to improved perception of a non-native sound contrast? Evidence from Japanese learners of English. In Proceedings of the 2013 Annual Conference of the Canadian Linguistic Association (pp. 1–15),Google Scholar
Trofimovich, P., & Baker, W. (2006). Learning second language suprasegmentals: Effect of L2 experience on prosody and fluency characteristics of L2 speech. Studies in Second Language Acquisition, 28 (1), 1–30. DOI logoGoogle Scholar
Tsui, H. M. L. (2012). Ultrasound speech training for Japanese adults learning ESL [Unpublished doctoral dissertation]. University of British Columbia.
Vance, T. J. (1987). An Introduction to Japanese phonology. State University of New York Press.Google Scholar
Wieling, M., & Tiede, M. (2017). Quantitative identification of dialect-specific articulatory settings. The Journal of the Acoustical Society of America, 142 (1), 389–394. DOI logoGoogle Scholar
Wilson, I., & Gick, B. (2014). Bilinguals use language-specific articulatory settings. Journal of Speech, Language, and Hearing Research, 57(2), 361–373. DOI logoGoogle Scholar
Cited by (1)

Cited by one other publication

Mahmood, Rizgar Qasim
2024. The Impact of Visual Corrective Feedback on Pronunciation Accuracy in L2 Sound Production. In Exploring Contemporary English Language Education Practices [Advances in Educational Technologies and Instructional Design, ], ► pp. 158 ff. DOI logo

This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.