Chapter published in:
Critical Reflections on Data in Second Language Acquisition
Edited by Aarnes Gudmestad and Amanda Edmonds
[Language Learning & Language Teaching 51] 2018
► pp. 7–32

Chapter 1
Data collection and analysis in developmental L2 pragmatics research

Discourse completion test, role play, and naturalistic recording

| Carnegie Mellon University
This chapter compares common data collection and analysis methods used in longitudinal studies in second language pragmatics. Specifically, three data collection methods used to document speech act development are compared: discourse completion tasks (written and spoken), role plays, and naturalistic recordings. I critically discuss benefits and shortcomings of these data collection methods, in response to three questions: (1) What is the nature of speech act data collected in each method?; (2) What kind of analysis is performed on the data collected?; and (3) What conclusions are drawn as evidence for speech act development? The chapter concludes with critical reflections and directions for future investigation into pragmatic development.
Keywords: research methods, L2 pragmatics, DCT, role play, naturalistic recording
Article outline
  • Introduction
  • Pragmatic competence: Evolving definitions
  • Definitions of pragmatic competence and methods of examination
    • Knowledge of form-function-context relationships
    • Adaptability in interaction
    • Learner agency
  • Literature review: Methods
  • Written DCT data
  • Spoken DCT data
  • Role play data
  • Naturally and semi-naturally occurring data
  • Critical reflections and conclusions
  • Note
  • References
Published online: 10 September 2018
https://doi.org/10.1075/lllt.51.02tag
References
Alcon-Soler, E.
(2002) Practice opportunities and pragmatic change in a second language context: The case of requests. Estudios de Linguistica Ingleasa Aplicada, 3, 123–138.Google Scholar
Al-Gahtani, S., & Roever, C.
(2014) Insert and post-expansion in L2 Arabic requests. System, 42, 189–206.CrossrefGoogle Scholar
(2015) The development of requests by L2 Learners of Modern Standard Arabic: A longitudinal and cross-sectional study. Foreign Language Annals, 48(4), 570–583.CrossrefGoogle Scholar
Bachman, L. F., & Palmer, A. S.
(2010) Language assessment in practice: developing language tests and justifying their use the real world. Oxford: Oxford University Press.Google Scholar
Bardovi-Harlig, K., & Hartford, B.
(1993) Learning the rules of academic talk: A longitudinal study of pragmatic development. Studies in Second Language Acquisition, 15, 279–304.CrossrefGoogle Scholar
Barron, A.
(2007) ‘Ah no honestly we’re okay’: Learning to upgrade in a study abroad context. Intercultural Pragmatics, 4, 129–166.CrossrefGoogle Scholar
Bataller, R.
(2010) Making a request for a service in Spanish: Pragmatic development in the study abroad setting. Foreign Language Annals, 43, 160–175.CrossrefGoogle Scholar
Blum-Kulka, S.
(1982) Learning to say what you mean in a second language. Applied Linguistics, 3, 29–59.CrossrefGoogle Scholar
Blum-Kulka, S., House, J., & Kasper, G.
(1989) Cross-cultural pragmatics: Requests and apologies. Norwood, NJ: Ablex.Google Scholar
Brown, G., & Yule, G.
(1983) Discourse analysis. Cambridge: Cambridge University Press.CrossrefGoogle Scholar
Canale, M., & Swain, M.
(1980) Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 1, 1–47.CrossrefGoogle Scholar
Code, S., & Anderson, A.
(2001) Requests by young Japanese: A longitudinal study. The Language Teacher, 25(8), 7–11.Google Scholar
Cohen, L., & Manion, L.
(1994) Research methods in education (4th ed.). New York, NY: Routledge.Google Scholar
Culpeper, J., Mackey, A., & Taguchi, N.
in preparation). Research methods in L2 pragmatics. New York, NY: Routledge.
Félix-Brasdefer, J. C.
(2010) Data collection methods in speech act performance: DCTs, role plays, and verbal reports. In E. Usó Juán & A. Martínez-Flor (Eds.), Speech act performance: Theoretical, empirical, and methodological Issues (pp.41–56). Amsterdam: John Benjamins.CrossrefGoogle Scholar
Félix-Brasdefer, J. C., & Hasler Barker, M.
(2015) Complimenting in Spanish in a short-term study abroad context. System, 48, 75–85.CrossrefGoogle Scholar
Fukasawa, E.
(2012) Development of the speech act “compliment response” and is relation to outside classroom English use during study abroad. Sophia Linguistica, 60, 123–146.Google Scholar
Gonzales, A.
(2013) Development of politeness strategies in participatory online environments: A case study. In N. Taguchi & J. Sykes (Eds.), Technology in interlanguage pragmatics research and teaching (pp.101–120). Amsterdam: John Benjamins.CrossrefGoogle Scholar
Hall, J. K.
(1995) Aw, man, where you goin? Classroom interaction and the development of L2 interactional competence. Issues in Applied Linguistics, 6(2), 37–62.Google Scholar
Hassall, T.
(2006) Learning to take leave in social conversations: A diary study. In M. DuFon & E. Churchill (Eds.), Language learners in study abroad contexts (pp.31–58). Clevedon: Multilingual Matters.CrossrefGoogle Scholar
Hymes, D. H.
(1972) On communicative competence. In J. B. Pride & J. Holmes (Eds.), Sociolinguistics (pp.269–293). Baltimore, MA: Penguin Books.Google Scholar
Ishihara, N., & Tarone, E.
(2009) Subjectivity and pragmatic choice in L2 Japanese: Emulating and resisting pragmatic norms. In N. Taguchi (Ed.), Pragmatic competence in Japanese as a second language (pp.101–128). Berlin: Mouton de Gruyter.Google Scholar
Kasper, G.
(2000) Data collection in pragmatics research. In H. Spencer-Oatey (Ed.), Culturally speaking: Managing rapport through talk across cultures (pp.316–341). London: Continuum.Google Scholar
(2001) Four perspectives on L2 pragmatic development. Applied Linguistics, 22, 502–530.CrossrefGoogle Scholar
(2006) Politeness in interaction. Introduction. Special Issue.Multilingua, 25, 243–248.CrossrefGoogle Scholar
Kasper, G., & Dahl, M.
(1991) Research methods in interlanguage pragmatics. Studies in Second Language Acquisition, 13, 215–247.CrossrefGoogle Scholar
Kasper, G., & Rose, K.
(2002) Pragmatic development in a second language. Oxford: Blackwell.Google Scholar
Kim, H. Y.
(2014) Learner investment, identity, and resistance to second language pragmatic norms. System, 45, 92–102.CrossrefGoogle Scholar
Kim, E. -Y., & Brown, L.
(2014) Negotiating pragmatic competence in computer mediated communication: The case of Korean address terms. CALICO, 31, 264–284.CrossrefGoogle Scholar
Khorshidi, H. R.
(2013) Study abroad and interlanguage pragmatic development in request and apology speech acts among Iranian learners. English Language Learning, 6, 62–70.Google Scholar
Li, S.
(2014) The effects of different levels of linguistic proficiency on the development of L2 Chinese request production during study abroad. System, 45, 103–116.CrossrefGoogle Scholar
LoCastro, V.
(2003) An introduction to pragmatics: Social action for language teachers. Ann Arbor, MI: The University of Michigan Press.Google Scholar
Ren, W.
(2012) Pragmatic development in Chinese speakers’ L2 English refusals. EUROSLA Yearbook, 12, 63–87.CrossrefGoogle Scholar
Sacks, H., Schegloff, E., & Jefferson, G.
(1974) A simplest systematics for the organization of turn-taking for conversation. Language, 50, 696–735.CrossrefGoogle Scholar
Salsbury, T., & Bardovi-Harlig, K.
(2001) I know your mean, but I don’t think so: Disagreements in L2 English. In L. Bouton (Ed.), Pragmatics and language learning monograph series (Vol. 10, pp.131–151). Urbana-Champaign, IL: Division of English as an International Language, University of Illinois.Google Scholar
Schauer, G. A.
(2004) May you speak louder maybe? EUROSLA Yearbook, 4, 253–273.CrossrefGoogle Scholar
Shively, R. L.
(2011) L2 pragmatic development in study abroad: A longitudinal study of Spanish service encounters. Journal of Pragmatics, 43(6), 1818–1835.CrossrefGoogle Scholar
Shively, R., & Cohen, A.
(2008) Development of Spanish requests and apologies during study abroad. Íkala: Revista de Lenguaje y Cultura, 13(20), 57–118.Google Scholar
Siegal, M.
(1996) The role of learner subjectivity in second language sociolinguistic competency: Western women learning Japanese. Applied Linguistics, 17, 356–382.CrossrefGoogle Scholar
Taguchi, N.
(2007) Task difficulty in oral speech act production. Applied Linguistics, 28, 113–135.CrossrefGoogle Scholar
(2010) Longitudinal studies in interlanguage pragmatics. In A. Trosborg (Ed.), Handbook of pragmatics (Vol.7, pp.333–361). Berlin: Mouton de Gruyter.Google Scholar
(2012) Context, individual differences, and pragmatic competence. Clevedon: Multilingual Matters.Google Scholar
(2013) Refusals in L2 English: Proficiency effects on appropriateness and fluency. In P. Salazar & O. A. Marti (Eds.), Refusals in instructional contexts and beyond. Spain: Rodopi.Google Scholar
(2015) “Contextually” speaking: A survey of pragmatics learning abroad, in class and online. System, 48, 3–20.CrossrefGoogle Scholar
Taguchi, N., & Roever, C.
(2017) Second language pragmatics. Oxford: Oxford University Press.Google Scholar
Taguchi, N., Xiao, F., & Li, S.
(2016) Development of pragmatic knowledge in L2 Chinese: Effects of intercultural competence and social contact on speech act production in a study abroad context. Modern Language Journal, 100, 775–796.CrossrefGoogle Scholar
Thomas, J.
(1983) Cross-cultural pragmatic failure. Applied Linguistics, 4, 91–111.CrossrefGoogle Scholar
Turnbull, W.
(2001) An appraisal of pragmatic elicitation techniques for the social psychological study of talk: The case of request refusals. Pragmatics, 11, 31–61.CrossrefGoogle Scholar
Warga, M., & Schölmberger, U.
(2007) The acquisition of French apologetic behavior in a study abroad context. Intercultural Pragmatics, 4, 221–251.CrossrefGoogle Scholar
Woodfield, H.
(2012) Pragmatic variation in learner perception: The role of retrospective verbal report in L2 speech act research. In J. C. Félix-Brasdefer & D. A. Koike (Eds.), Pragmatic variation in first and second language contexts: Methodological issues (pp.209–223). Amsterdam: John Benjamins.CrossrefGoogle Scholar
Young, R.
(2002) Discourse approaches to oral language assessment. Annual Review of Applied Linguistics, 19, 105–132.Google Scholar
(2008) Discursive practices in language learning and teaching. Oxford: Wiley-Blackwell.Google Scholar
(2011) Interactional competence in language learning, teaching, and testing. In E. Hinkel (Ed.), Handbook of research in language learning and teaching (pp.426–443). New York, NY: Routledge.Google Scholar
Yuan, Y.
(2001) An inquiry into empirical pragmatics data-gathering methods: Written DCTs, oral DCTs, field notes, and natural conversations. Journal of Pragmatics, 33(2), 271–292.CrossrefGoogle Scholar
Cited by

Cited by 5 other publications

Cohen, Andrew D.
2020. Considerations in assessing pragmatic appropriateness in spoken language. Language Teaching 53:2 ► pp. 183 ff. Crossref logo
Cohen, Andrew D.
2020. Issues in the assessment of L2 pragmatics. Lodz Papers in Pragmatics 16:1 ► pp. 15 ff. Crossref logo
Cohen, Andrew D.
2021.  In Research Questions in Language Education and Applied Linguistics [Springer Texts in Education, ], ► pp. 311 ff. Crossref logo
Mohammad Hosseinpur, Rasoul, Reza Bagheri Nevisi & Abdolreza Lowni
2021. A Tale of four measures of pragmatic knowledge in an EFL institutional context. Pragmatics. Quarterly Publication of the International Pragmatics Association (IPrA) 31:1 ► pp. 114 ff. Crossref logo
Siddiqa, Aisha & Shona Whyte
2021. Classroom learning of English L2 requests: Input and interactional opportunities in French secondary schools. Language Teaching Research ► pp. 136216882110649 ff. Crossref logo

This list is based on CrossRef data as of 31 march 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.