Article published in:25 years of Intelligibility, Comprehensibility and Accentedness
Edited by John M. Levis, Tracey M. Derwing and Murray J. Munro
[Journal of Second Language Pronunciation 6:3] 2020
► pp. 402–429
Reactions to second language speech
Influences of discrete speech characteristics, rater experience, and speaker first language background
This study investigates how Mandarin and Slavic language speakers’ comprehensibility, accentedness, and fluency ratings, as assigned by experienced teacher-raters and novice raters, align with discrete linguistic measures, and raters’ accounts of influences on their scoring. In addition to examining mean ratings in relation to rater experience and speaker first language background, we correlated ratings with segmental, prosodic, and temporal measures. Introspective reports were segmented, coded, enumerated, and submitted to loglinear analysis to elucidate influences on ratings. Results showed that ratings were strongly correlated with prosodic goodness and moderately correlated with segmental errors, implying the importance of both segmentals and prosody in L2 speech ratings. Experienced teacher-raters provided lengthier reports than novice raters, producing more comments for all coded categories where an error was identified except for pausing (a dysfluency marker). This may be because novice raters observed little else about the speech or struggled to pinpoint or articulate other features.
Keywords: accent, comprehensibility, English as a second language, fluency, pronunciation assessment, raters, rating scales, speech perception
- 2.The current study
- 3.1Research design
- 3.2L2 speakers
- 3.3Speech elicitation and data preparation
- 3.5Rating sessions
- 3.6Rating scale normalization
- 3.7Deriving discrete linguistic measures from the L2 speech samples
- 3.8Analysis of introspective reports
- 4.1Preliminary analyses
- 4.2Rater experience and speaker L1 in relation to global ratings and discrete measures
- 4.3Analysis of the factors that raters reportedly take notice of when rating L2 speech
- 5.1Rater experience
- 5.2Speaker L1 background
- 5.3Concluding remarks
Published online: 01 September 2020
Bannigan, K., & Watson, R.
Bongaerts, T., Mennen, S., & van der Slik, F.
Bongaerts, T., van Summeren, C., Planken, B., & Schils, E.
Bradlow, A., Clopper, C., Smiljanic, R., & Walter, M. A.
Browne, K., & Fulcher, G.
Creswell, J. W., & Plano Clark, V. L.
Crowther, D., Trofimovich, P., Saito, K., & Isaacs, T.
de Boer, M., & Heeren, W.
Derwing, T. M., & Munro, M. J.
Derwing, T. M., Rossiter, M. J., Munro, M. J., & Thomson, R. I.
Derwing, T. M., Thomson, R. I., & Munro, M. J.
Ericsson, K. A., & Simon, H. A.
Foote, J. A., Isaacs, T., & Trofimovich, P.
(2013, June 3–5). Developing a teacher-friendly assessment tool for L2 comprehensibility. Canadian Association of Applied Linguistics (ACLA/CAAL) conference, Calgary, AB.
Foote, J. A., & Trofimovich, P.
Gass, S. M., & Mackey, A.
Hahn, L. D.
Isaacs, T., & Harding, L.
Isaacs, T., & Thomson, R. I.
Isaacs, T., & Trofimovich, P.
Isaacs, T., Trofimovich, P., Yu, G., & Chereau, B. M.
Kang, O., & Moran, M.
McAndrews, M. M., & Thomson, R. I.
Munro, M. J.
Munro, M. J., & Derwing, T. M.
O’Brien, M. G.
Rose, H., & Galloway, N.
Rossiter, M. J.
Saito, K., Trofimovich, P., & Isaacs, T.
Saito, K., Trofimovich, P., Isaacs, T., & Webb, S.
Saito, K., Webb, S., Trofimovich, P., & Isaacs, T.
Stevens, J. P.
Suzukida, Y., & Saito, K.
Thomson, R. I., & Isaacs, T.
Upshur, J. A., & Turner, C. E.
Winke, P., Gass, S., & Myford, C.