Cover not available
Article In:
Thematic Issue: Trends in Second Language Pragmatics Research Part 2
[Applied Pragmatics 6:2] 2024
► pp. 117–131

Assessment and L2 pragmatics

ORCID logo | The University of Melbourne
Pragmatic and interactional abilities are represented in major models of second language (L2) communicative competence (Bachman & Palmer, 2010; Canale & Swain, 1980), which provide the framework for L2 assessment. However, pragmatics and interaction are only rarely tested in major operational tests. This is despite a significant amount of work in the testing of L2 pragmatics and interaction since the mid-1990s. This paper outlines current work on testing of L2 pragmatics, which broadly follows two traditions, one informed by speech act theory, politeness theory and philosophical pragmatics, and the other by conversation analysis and sociology. It also discusses reasons for the limited uptake of pragmatics assessment by large-scale tests, including low practicality, limited stakeholder test literacy, and broader challenges in testing pragmatics. It concludes by suggesting ways of overcoming these obstacles and thereby achieving better construct representation in L2 tests.
Keywords: speech acts, implicature, routine formulae, interactional competence, conversation analysis, L2 assessment, validity
Article outline
  • 1.Introduction
  • 2.Survey of current literature
    • 2.1Justification for testing of L2 pragmatics
    • 2.2L2 pragmatics constructs and associated tests
  • 3.Critical insights and future directions
  • Author queries
  • References
This content is being prepared for publication; it may be subject to changes.
References (67)
References
Austin, J. L. (1962). How to do things with words. Oxford University Press.Google Scholar
Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language tests and justifying their use in the real world. Oxford University Press.Google Scholar
Bardovi-Harlig, K. (2009). Conventional expressions as a pragmalinguistic resource: Recognition and production of conventional expressions in L2 pragmatics. Language Learning, 59 1, 755–795. DOI logoGoogle Scholar
Bouton, L. F. (1999). Developing non-native speaker skills in interpreting conversational Implicatures in English: Explicit teaching can ease the process. In E. Hinkel (Ed.), Culture in second language teaching and learning (pp. 47–70). Cambridge University Press.Google Scholar
Brown, J. D., & Ahn, R. C. (2011). Variables that affect the dependability of L2 pragmatics tests. Journal of Pragmatics, 43 (1), 198–217. DOI logoGoogle Scholar
Brown, P., & Levinson, S. C. (1987). Politeness: Some universals in language usage. Cambridge University Press. DOI logoGoogle Scholar
Canale, M., & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1 1, 1–47. DOI logoGoogle Scholar
Chinese Testing International. (2018). About test. [URL]
Cogo, A., & House, J. (2017). The pragmatics of ELF. In J. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp. 210–223). Routledge. DOI logoGoogle Scholar
Cook, H. M. (2001). Why can’t learners of Japanese as a foreign language distinguish polite from impolite speech styles? In K. Rose & G. Kasper (Eds.), Pragmatics in language teaching (pp. 80–102). Cambridge University Press. DOI logoGoogle Scholar
Coulmas, F. (1981). Conventional routine: Exploration in standardized communication situations and prepatterned speech. Mouton.Google Scholar
Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment. Companion volume with new descriptors. Council of Europe. [URL]
Dai, D. W. (2022). Design and validation of an L2-Chinese interactional competence test [Unpublished doctoral thesis]. The University of Melbourne.
Educational Testing Service. (2020). TOEFL iBT speaking section. [URL]
. (2021). The TOEIC tests. [URL]
Ellis, R., & Roever, C. (2021). The measurement of implicit and explicit knowledge. The Language Learning Journal, 49 (2), 160–175. DOI logoGoogle Scholar
Ellis, R., Zhu, Y., Shintani, N., & Roever, C. (2021). A study of Chinese learners’ ability to comprehend irony. Journal of Pragmatics, 172 1, 7–20. DOI logoGoogle Scholar
Félix-Brasdefer, J. C. (2019). Speech acts in interaction: Negotiating joint action in a second language. In N. Taguchi (Ed.), The Routledge handbook of second language acquisition and pragmatics (pp. 17–30). Routledge.Google Scholar
Galaczi, E. D. (2014). Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests? Applied Linguistics, 35 (5), 553–574. DOI logoGoogle Scholar
Galaczi, E., & Taylor, L. (2018). Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15 (3), 219–236. DOI logoGoogle Scholar
Golato, A. (2003). Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24 (1), 90–121. DOI logoGoogle Scholar
Grabowski, K. (2009). Investigating the construct validity of a test designed to measure grammatical and pragmatic knowledge in the context of speaking [Unpublished doctoral dissertation]. Teachers College, Columbia University.
(2013). Investigating the construct validity of a role-play test designed to measure grammatical and pragmatic knowledge at multiple proficiency levels. In S. Ross & G. Kasper (Eds.), Assessing second language pragmatics (pp. 149–171). Palgrave Macmillan. DOI logoGoogle Scholar
Grice, H. P. (1975). Logic and conversation. In P. Cole & J. L. Morgan (Eds.), Syntax and semantics 3: Speech acts (pp. 41–58). Academic Press. DOI logoGoogle Scholar
Hall, J. K., & Pekarek Doehler, S. (2011). L2 interactional competence and development. In J. K. Hall, J. Hellermann, & S. Pekarek Doehler (Eds.), L2 interactional competence and development (pp. 1–15). Multilingual Matters. DOI logoGoogle Scholar
Harding, L. W., & McNamara, T. (2018). Language assessment: The challenge of ELF. In J. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp. 570–582). Routledge.Google Scholar
Hepburn, A., & Potter, J. (2021). Essentials of conversation analysis. American Psychological Association. DOI logoGoogle Scholar
Hudson, T., Detmer, E., & Brown, J. D. (1995). Developing prototypic measures of cross-cultural pragmatics (Technical report #7). University of Hawai’i, Second Language Teaching and Curriculum Center.Google Scholar
Hymes, D. (1972). On communicative competence. In J. Pride & J. Holmes (Eds.), Sociolinguistics: Selected readings (pp. 269–293). Penguin.Google Scholar
Ikeda, N. (2017). Measuring L2 oral pragmatic abilities for use in social contexts: Development and validation of an assessment instrument for L2 pragmatics performance in university settings [Unpublished doctoral dissertation]. The University of Melbourne.
Itomitsu, M. (2009). Developing a test of pragmatics of Japanese as a foreign language (Publication No. osu1250512327) [Doctoral dissertation, Ohio State University]. OhioLINK ETD Center. [URL]
Jacoby, S., & McNamara, T. (1999). Locating competence. English for Specific Purposes, 18 (3), 213–241. DOI logoGoogle Scholar
Kasper, G. (2006). Speech acts in interaction: Towards discursive pragmatics. In K. Bardovi-Harlig, J. C. Félix-Brasdefer, & A. S. Omar (Eds.), Pragmatics & language learning (Vol. 111, pp. 281–314). National Foreign Language Resource Center.Google Scholar
Lam, D. M. K. (2018). What counts as “responding”? Contingency on previous speaker contribution as a feature of interactional competence. Language Testing, 35 (3), 377–401. DOI logoGoogle Scholar
Liu, J. (2006). Measuring interlanguage pragmatic knowledge of EFL learners. Peter Lang.Google Scholar
Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). American Council on Education/Macmillan.Google Scholar
Ockey, G. J., & Chukharev-Hudilainen, E. (2021). Human versus computer partner in the paired oral discussion test. Applied Linguistics, 1–21. DOI logoGoogle Scholar
OET (2018). Speaking assessment criteria and level descriptors. [URL]
Pekarek Doehler, S. (2019). On the nature and the development of L2 interactional competence: State of the art and implications for praxis. In M. R. Salaberry & S. Kunitz (Eds.), Teaching and testing L2 interactional competence: Bridging theory and practice (pp. 25–59). Routledge. DOI logoGoogle Scholar
Pill, J. (2016). Drawing on indigenous criteria for more authentic assessment in a specific-purpose language test: Health professionals interacting with patients. Language Testing, 33 (2), 175–193. DOI logoGoogle Scholar
Purpura, J. E. (2004). Assessing grammar. Cambridge University Press. DOI logoGoogle Scholar
Roever, C. (2005). Testing ESL pragmatics. Peter Lang. DOI logoGoogle Scholar
(2013). Testing implicature under operational conditions. In G. Kasper & S. Ross (Eds.), Assessing second language pragmatics (pp. 43–64). Palgrave Macmillan. DOI logoGoogle Scholar
Roever, C., & Dai, W. (2021). Interactional competence and language testing. In M. R. Salaberry & R. Burch (Eds.), Assessing speaking (pp. 23–49). Palgrave Macmillan. DOI logoGoogle Scholar
Roever, C., & Ellis, R. (2021). Testing implicit pragmatic knowledge. In C. Félix-Brasdefer, R. Shively, & J. Sykes (Eds.), New directions in researching, teaching, and assessing L2 pragmatics (pp. 142–155). Mouton de Gruyter.Google Scholar
Roever, C., Fraser, C., & Elder, C. (2014). Testing ESL sociopragmatics: Development and validation of a web-based test battery. Peter Lang. DOI logoGoogle Scholar
Roever, C., Higuchi, Y., Sasaki, M., Yashima, T., & Nakamuro, M. (2023). Validating a test of L2 routine formulae to detect pragmatics learning in stays abroad. Applied Pragmatics, 5 (1), 41–63. DOI logoGoogle Scholar
Roever, C., & Ikeda, N. (2022). What scores from monologic speaking tests can (not) tell us about interactional competence. Language Testing, 39 (1), 7–29. DOI logoGoogle Scholar
Ross, S., & Zheng, Q. (2021). Strategic competence and pragmatic proficiency in L2 role plays. In J. C. Félix-Brasdefer & R. L. Shively (Eds.), New directions in second language pragmatics (pp. 179–194). De Gruyter. DOI logoGoogle Scholar
Saito, J. (2018). “Sarariiman” and the performance of masculinities at work: An analysis of interactions at business meetings at a multinational corporation in Japan. In H. Cook & J. Shibamoto-Smith (Eds.), Japanese at work (pp. 97–121). Springer. DOI logoGoogle Scholar
Sato, T., & McNamara, T. (2019). What counts in second language oral communication ability? The perspective of linguistic laypersons. Applied Linguistics, 40 (6), 894–916. DOI logoGoogle Scholar
Searle, J. R. (1969). Speech acts: An essay in the philosophy of language. Cambridge University Press. DOI logoGoogle Scholar
Tada, M. (2005). Assessment of ESL pragmatic production and perception using video prompts [Unpublished doctoral dissertation]. Temple University.
Tajeddin, Z., Alemi, M., & Khanlarzadeh, N. (2021). Rating criteria and norms for pragmatic assessment in the context of EIL. In Z. Tajeddin & M. Alemi (Eds.), Pragmatics pedagogy in English as an international language (pp. 212–231). Routledge.Google Scholar
Timpe-Laughlin, V., & Choi, I. (2017). Exploring the validity of a second intercultural pragmatics assessment tool. Language Assessment Quarterly, 14 (1), 19–35. DOI logoGoogle Scholar
Timpe-Laughlin, V., & Dombi, J. (2020). Exploring L2 learners’ request behavior in a multi-turn conversation with a fully automated agent. Intercultural Pragmatics, 17 (2), 221–257. DOI logoGoogle Scholar
Trinity College (2021). Our qualifications: English language. [URL]
UCLES (2011). Assessing speaking performance — level C1. [URL]
(2021). Cambridge English qualifications. [URL]
Walters, F. S. (2007). A conversation-analytic hermeneutic rating protocol to assess L2 oral pragmatic competence. Language Testing, 27 (2), 155–183. DOI logoGoogle Scholar
(2009). A Conversation Analysis-informed test of L2 aural pragmatic comprehension. TESOL Quarterly, 43 (1), 29–54. DOI logoGoogle Scholar
Yamashita, S. O. (1996). Six measures of JSL pragmatics (Technical Report #14). University of Hawai’i, Second Language Teaching and Curriculum Center.Google Scholar
Yoshitake, S. (1997). Interlanguage competence of Japanese students of English: A multi-test framework evaluation [Unpublished doctoral dissertation]. Columbia Pacific University.
Youn, S. J. (2013). Validating task-based assessment of L2 pragmatics in interaction using mixed methods [Unpublished doctoral dissertation]. University of Hawai’i at Manoa.
(2015). Validity argument for assessing L2 pragmatics in interaction using mixed methods. Language Testing, 32 (2), 199–225. DOI logoGoogle Scholar
Young, R. F. (2011). Interactional competence in language learning, teaching, and testing. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (Vol. 21, pp. 426–443). Routledge.Google Scholar