Article published In:
Journal of Second Language PronunciationVol. 9:2 (2023) ► pp.234–262
Listener perceptions of customer service agents’ performance
Do comprehensibility, accentedness, and fluency matter?
This study investigated listener-based assessment of the job performance of second language (L2) speakers employed as customer service agents in outsourced foreign-based call centers, focusing on agents’ job performance as a function of the comprehensibility, fluency, and accentedness of their speech. Using Amazon’s Mechanical Turk crowdsourcing platform, 116 native English-speaking listeners evaluated two-minute recordings of actual customer service conversations featuring 18 Filipino agents, assessing them for three global speech dimensions (comprehensibility, accentedness, and fluency) and three performance indicators, including agents’ confidence, competence, and listeners’ interest in future communication with agents (a measure capturing customer patronage). Comprehensibility and fluency consistently predicted how the listeners assessed the agents on all job performance scales, and accentedness was additionally associated with how strongly the listeners wished to communicate with the agents. Findings generally highlight the importance of fluent and comprehensible L2 speech in workplace settings.
Keywords: comprehensibility, accentedness, fluency, perception, customer service, foreign-based call center
Article outline
- 1.Introduction
- 2.Background literature
- 3.The present study
- 4.Method
- 4.1Audio recordings
- 4.2Listeners
- 4.3Materials and procedure
- 5.Data analysis
- 5.1Rating reliability
- 5.2Statistical modeling
- 6.Results
- 7.Discussion
- 8.Implications, limitations, and future work
- 9.Conclusion
- Acknowledgments
- Notes
-
References
References
Almeida, S., Fernando, M., Hannif, Z., & Dharmage, S. C.
(2015) Fitting
the mould: The role of employer perceptions in immigrant recruitment decision-making. The
International Journal of Human Resource
Management,
26
1, 2811–2832. 
Archer, D., & Jagodziński, P.
(2015) Call
centre interaction: A case of sanctioned face attack? Journal of
Pragmatics,
76
1, 46–66.
Bartoń, K.
Bates, D., Mäechler, M., Bolker, B., & Walker, S.
(2015) Fitting
linear mixed-effects models using lme4. Journal of Statistical
Software,
67
1, 1–48.
Bestelmeyer, P. E. G., Belin, P., & Ladd, D. R.
(2015) A
neural marker for social bias toward in- group accents. Cerebral
Cortex,
25
1, 3953–3961.
Blankenship, K. L., & Holtgraves, T.
(2005) The
role of different markers of linguistic powerlessness in persuasion. Journal of Language and
Social
Psychology,
24
1, 3–24.
Bosker, H. R., Pinget, A. F., Quené, H., Sanders, T., & de Jong, N. H.
(2013) What
makes speech sound fluent? The contribution of pauses, speed and repairs. Language
Testing,
30
1, 159–175.
Brennan, E., & Brennan, J.
(1981) Accent
scaling and language attitudes: Reactions to Mexican American English speech. Language and
Speech,
24
1, 207–221.
Brennan, S. E., & Williams, M.
(1995) The
feeling of another’s knowing: Prosody and filled pauses as cues to listeners about the metacognitive states of
speakers. Journal of Memory and
Language,
34
1, 383–398.
Camilleri, M. A.
(2021) E-commerce
websites, consumer order fulfillment and after-sales service satisfaction: The customer is always right, even after the
shopping cart check-out. Journal of Strategy and
Management. Advance online publication.
Campbell-Kibler, K.
(2007) Accent,
(ING), and the social logic of listener perceptions. American
Speech,
82
1, 32–64.
CFI Group
Chicu, D., Pàmies, M., Ryan, G., & Cross, C.
(2019) Exploring
the influence of the human factor on customer satisfaction in call centres. Business Research
Quarterly,
22
1, 83–95.
Cocchiara, F. K., Bell, M. P., & Casper, W. J.
(2016) Sounding
“different”: The role of sociolinguistic cues in evaluating job candidates. Human Resource
Management,
55
1, 463–477.
Cowie, C., & Murty, L.
(2010) Researching
and understanding accent shifts in Indian call centre
agents. In G. Forey & J. Lockwood (Eds.), Globalization,
communication and the workplace: Talking across the
world (pp. 125–144). Continuum.
D’Ausilio, R.
(1998) Wake
up your call center: How to be a better call center agent. Purdue University Press.
Darian, J. C., Tucci, L. A., & Wiman, A. R.
(2001) Perceived
salesperson service attributes and retail patronage intentions. International Journal of Retail
Distribution
Management,
29
1, 205–213.
Davila, A., Bohara, A., & Saenz, R.
(1993) Accent
penalties and the earnings of Mexican Americans. Social Science
Quarterly,
74
1, 902–916. [URL]
Derwing, T. M., & Munro, M. J.
(1997) Accent,
intelligibility, and comprehensibility: Evidence from four L1s. Studies in Second Language
Acquisition,
19
1, 1–16.
(2009) Comprehensibility
as a factor in listener interaction preferences: Implications for the workplace. Canadian
Modern Language
Review,
66
1, 181–202.
Derwing, T., Fraser, H., Kang, O., & Thomson, R.
(2014) L2
accent and ethics: Issues that merit attention. In A. Mahboob & L. Barratt (Eds.), Englishes
in multilingual
contexts (pp. 63–80). Springer.
Difallah, D., Filatova, E., & Ipeirotis, P.
(2018) Demographics
and dynamics of Mechanical Turk workers. Proceedings of the Eleventh ACM International
Conference on Web Search and Data Mining, 135–143.
Downing, J. R.
(2011) Linking
communication competence with call center agents’ sales effectiveness. Journal of Business
Communication,
48
1, 409–425.
Dragojevic, M., Giles, H., Beck, A.-C., & Tatum, N. T.
(2017) The
fluency principle: Why foreign accent strength negatively biases language
attitudes. Communication
Monographs,
84
1, 385–405.
Erickson, B., Lind, A. E., Johnson, B. C., & O’Barr, W. M.
(1978) Speech
style and impression formation in a court setting: The effects of “powerful” and “powerless”
speech. Journal of Experimental Social
Psychology,
14
1, 266–279.
Forey, G., & Lockwood, J.
(2007) “I’d
love to put someone in jail for this”: An initial investigation of English in the business processing outsourcing (BPO)
industry. English for Specific
Purposes,
26
1, 308–326.
(Eds.) (2010) Globalization,
communication, and the workplace: Talking across the
world. Continuum.
Friginal, E.
(2007) Outsourced
call centers and English in the Philippines. World
Englishes,
26
1, 331–345.
(2009) The
language of outsourced call centers: A corpus-based study of cross-cultural interaction. John Benjamins.
Friginal, E., & Cullom, M.
(2014) Saying
‘No’ in Philippine-based outsourced call center interactions. Asian
Englishes,
16
1, 2–18.
Gaffney, C., & Côté, S.
(2020) Does
personality influence ratings of foreign accents? Journal of Second Language
Pronunciation,
6
1, 68–95.
Gatbonton, E., Trofimovich, P., & Magid, M.
(2005) Learners’
ethnic group affiliation and L2 pronunciation accuracy: A sociolinguistic investigation. TESOL
Quarterly,
39
1, 489–511.
Gluszek, A., Newheiser, A.-K., & Dovidio, J. F.
(2011) Social
psychological manipulations and accent strength. Journal of Language and Social
Psychology,
30
1, 28–45.
Goldberg, L. R.
(1993) The
structure of phenotypic personality traits. American
Psychologist,
48
1, 26–34.
Grandey, A. A., Dickter, D. N., & Sin, H.-P.
(2004) The
customer is not always right: Customer aggression and emotion regulation of service
employees. Journal of Organizational
Behavior,
25
1, 397–418.
Graziano, W. G., & Tobin, R. M.
(2017) Agreeableness
and the Five Factor Model. In T. A. Widiger (Ed.), The
Oxford handbook of the Five Factor
Model (pp. 105–132). Oxford University Press.
Hallgren, K. A.
(2012) Computing
inter-rater reliability for observational data: An overview and tutorial. Tutorials in
Quantitative Methods for
Psychology,
8
1, 23–34.
Hamp-Lyons, L., & Lockwood, J.
(2009) The
workplace, the society and the wider world: The offshoring and outsourcing industry. Annual
Review of Applied
Linguistics,
29
1, 145–167.
Hayes-Harb, R., & Hacking, J. F.
(2015) Beyond
rating data: What do listeners believe underlies their accentedness judgments? Journal of
Second Language
Pronunciation,
1
1, 43–64.
Hood, S., & Forey, G.
(2008) The
interpersonal dynamics of call-centre interactions: Co-constructing the rise and fall of
emotion. Discourse &
Communication,
2
1, 389–409.
Hosman, L.
(2015) Powerful
and powerless speech styles and their relationship to perceived dominance and
control. In R. Schulze, & H. Pishwa (Eds.), The
exercise of power in
communication (pp. 221–232). Palgrave Macmillan.
Hosman, L. A., & Siltanen, S. A.
(2011) Hedges,
tag questions, message processing, and persuasion. Journal of Language and Social
Psychology,
30
1, 341–349.
Hosoda, M., Stone-Romero, E. F., & Walter, J. N.
(2007) Listeners’
cognitive and affective reactions to English speakers with standard American English and Asian
accents. Perceptual and Motor
Skills,
104
1, 307–326.
Hox, J. J., Moerbeek, M., & Van de Schoot, R.
(2017) Multilevel
analysis: Techniques and applications. Routledge.
Hultgren, A. K.
(2011) “Building
rapport” with customers across the world: The global diffusion of a call centre speech
style. Journal of
Sociolinguistics,
15
1, 36–64.
Isaacs, T., & Trofimovich, P.
(2012) Deconstructing
comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility
ratings. Studies in Second Language
Acquisition,
34
1, 475–505.
Iwashita, N., Brown, A., McNamara, T., & O’Hagan, S.
(2008) Assessed
levels of second language speaking proficiency: How distinct? Applied
Linguistics,
29
1, 24–49.
Kahng, J.
(2018) The
effect of pause location on perceived fluency. Applied
Psycholinguistics,
39
1, 569–591.
Krahn, H., Derwing, T., Mulder, M., & Wilkinson, L.
(2000) Educated
and underemployed: Refugee integration into the Canadian labour market. Journal of
International Migration and
Integration,
1
1, 59–84.
Krishnamurthy, M.
(2018) 1-800-Worlds:
The making of Indian call centre economy. Oxford University Press.
Levis, J. M.
(2018) Intelligibility,
oral communication, and the teaching of pronunciation. Cambridge University Press.
Linck, J. A., & Cunnings, I.
(2015) The
utility and application of mixed-effects models in second language research. Language
Learning,
65
1, 185–207.
Lippi-Green, R.
(2012) English
with an accent: Language, ideology, and discrimination in the United
States. Routledge.
Lockwood, J.
(2012) Are
we getting the right people for the job? A study of English language recruitment assessment practices in the business
processing outsourcing sector: India and the Philippines. The Journal of Business
Communication,
49
1, 107–127.
Lockwood, J. E.
(2015) Language
for Specific Purpose (LSP) performance assessment in Asian call centres: Strong and weak
definitions. Language Testing in
Asia,
5
1, 1–11.
(2018) Theorising
communications coaching in Asian contact centres: What is the approach? Industrial and
Commercial
Training,
50
1, 312–325.
Marbach, J., Lages, C. R., & Nunan, D.
(2016) Who
are you and what do you value? Investigating the role of personality traits and customer-perceived value in online customer
engagement. Journal of Marketing
Management,
32
1, 502–525.
Munro, M. J., & Derwing, T. M.
(1995) Foreign
accent, comprehensibility, and intelligibility in the speech of second language
learners. Language
Learning,
45
1, 73–97.
Nagle, C.
(2019) Developing
and validating a methodology for crowdsourcing L2 speech ratings in Amazon Mechanical
Turk. Journal of Second Language
Pronunciation,
5
1, 294–323.
Nagle, C., & Rehman, I.
(2021) Doing
L2 speech research online: Why and how to collect online ratings data. Studies in Second
Language
Acquisition,
43
1, 916–939.
Nelson, C. L.
(2012) Intelligibility
in World Englishes: Theory and application. Routledge.
O’Brien, M. G.
(2016) Methodological
choices in rating speech samples. Studies in Second Language
Acquisition,
38
1, 587–605.
Orth, U. R., & Wirtz, J.
(2014) Consumer
processing of interior service environments: The interplay among visual complexity, processing fluency, and
attractiveness. Journal of Service
Research,
17
1, 296–309.
Parton, S. R., Siltanen, S. A., Hosman, L. A., & Langenderfer, J.
(2002) Employment
interview outcomes and speech style effects. Journal of Language and Social
Psychology,
21
1, 144–161.
Plonsky, L., & Oswald, F. L.
(2014) How
big is “big”? Interpreting effect sizes in L2 research. Language
Learning,
64
1, 878–912.
Presbitero, A.
(2017) It’s
not all about language ability: Motivational cultural intelligence matters in call center
performance. The International Journal of Human Resource
Management,
28
1, 1547–1562.
R Core Team
(2020) R: A language and
environment for statistical computing [Computer software]. R Foundation for Statistical Computing. [URL]
Ramjattan, V. A.
(2019) Racializing
the problem of and solution to foreign accent in business. Applied Linguistics
Review. Advanced online publication.
Reber, R., & Greifeneder, R.
(2017) Processing
fluency in education: How metacognitive feelings shape learning, belief formation, and
affect. Educational
Psychologist,
52
1, 84–103.
Revelle, W.
(2021) psych:
Procedures for psychological, psychometric, and personality research. Northwestern University, Evanston, Illinois. R package version 2.1.3. [URL]
Rossiter, M. J.
(2009) Perceptions
of L2 fluency by native and non-native speakers of English. The Canadian Modern Language
Review,
65
1, 395–412.
Saito, K., Trofimovich, P., & Isaacs, T.
(2017) Using
listener judgments to investigate linguistic influences on L2 comprehensibility and accentedness: A validation and
generalization study. Applied
Linguistics,
38
1, 439–462.
Sanchez, C. A., & Khan, S.
(2016) Instructor
accents in online education and their effect on learning and attitudes. Journal of Computer
Assisted
Learning,
32
1, 494–502.
Schwarz, N.
(2004) Metacognitive
experiences in consumer judgment and decision making. Journal of Consumer
Psychology,
14
1, 332–348.
Segalowitz, N.
(2010) Cognitive
bases of second language fluency. Routledge.
Soto, C. J., & John, O. P.
(2017) Short
and extra-short forms of the Big Five Inventory-2: The BFI-2-S and BFI-2-XS. Journal of
Research in
Personality,
68
1, 69–81.
Tavakoli, P., & Hunter, A.-M.
(2017) Is
fluency being “neglected” in the classroom? Teacher understanding of fluency and related classroom
practices. Language Teaching
Research,
22
1, 330–349.
Tavakoli, P., Nakatsuhara, F., & Hunter, A.-M.
(2020) Aspects
of fluency across assessed levels of speaking proficiency. The Modern Language
Journal,
104
1, 169–191.
Timming, A. R.
(2017) The
effect of foreign accent on employability: A study of the aural dimensions of aesthetic labour in customer-facing and
non-customer-facing jobs. Work, Employment and
Society,
31
1, 409–428.
Whitaker, J., Krishnan, M. S., Fornell, C., & Morgeson, F.
(2020) How
does customer service offshoring impact customer satisfaction? Journal of Computer Information
Systems,
60
1, 569–582:
Wilt, J., & Revelle, W.
(2017) Extraversion. In T. A. Widiger (Ed.), The
Oxford handbook of the Five Factor
Model (pp. 57–81). Oxford University Press.