Chapter published in:Task-Based Approaches to Teaching and Assessing Pragmatics
Edited by Naoko Taguchi and YouJin Kim
[Task-Based Language Teaching 10] 2018
► pp. 160–190
Chapter 7Independently measuring cognitive complexity in task design for interlanguage pragmatics development
This study examines the effects of task design on interlanguage pragmatics, bringing together task complexity and L2 pragmatic outcomes measured holistically. Fifteen expert judges were asked independently to assess task complexity and to evaluate the pragmatic performance of 60 EFL learners who had written a response to four email messages at 4 different levels of complexity. On the basis of needs analysis, complexity had been manipulated by along the following parameters: +/−frequency of input, +/−familiarity with interlocutor, +/−intentional, +/−causal reasoning, +/−dependency of steps, +/−number of elements, and +/−dual task. In order to validate complexity independently, two techniques were applied. On the one hand, a subjective perception questionnaire evaluating mental effort and difficulty was answered by 15 experienced teachers. On the other hand, subjective judgments on a pragmatic scale by the same teachers followed by retrospective protocol analysis were used in the classification of tasks from simple to complex. Pragmatic outcomes were assessed on a holistic rating scale of pragmatic performance. While descriptive statistical results pointed in the direction of predictions, inferential statistics only confirm a difference between the first level of complexity and the other three. As for the effect of sequence, expert judges did not find the outcomes of the two sequences to differ. Results are discussed in light of task performance, task sequencing, and interlanguage pragmatics development.
- TBLT and pragmatics
- The independent measurement of task complexity
- Task grading and sequencing
- Measuring pragmatic competence
- Research questions
- Expert judgments via online questionnaires
- Operationalization of task complexity and task sequencing
- Input frequency
- Causal reasoning
- Intentional reasoning
- Number of elements
- Operationalization of task sequencing
- Specific data collection procedures
- Statistical tools and procedures
- Research Question 1
- Research Question 2
Published online: 15 August 2018
Alcón, E., & Martínez-Flor, A.
Baralt, M., Gilabert, R., Robinson, P.
Baralt, M., Gilabert, R., & Robinson, P.
Bardovi-Harlig, K., & Hartford, B. S.
Chen, C-F. E.
(2001) Making e-mail requests to professors: Taiwanese vs. American students. Paper presented at the Annual Meeting of the American Association for Applied Linguistics in St. Louis, February 2001. (ERIC Document Reproduction Service No. ED 461 299).
Council of Europe
Færch, C., & Kasper, G.
Félix-Brasdefer, J. C.
Firth, A., & Wagner, J.
Gilabert, R., & Barón, J.
Gilabert, R., & Levkina, M.
Gilabert, R., Barón, J., & Levkina, M.
Hudson, T., Detmer, E., & Brown, J. D.
Jackson, D., & Suethanapornkul, S.
Kasper, G., & Schmidt, R.
Kasper, G., & Blum-Kulka, S.
Kim, Y., & Taguchi, N.
Kim, Y., & Tracy-Ventura, N.
Koike, D. A., & Pearson, L.
Levkina, M. & Gilabert, R.
Malika, A., & Levkina, M.
Martínez-Flor, A., & Usó-Juan, E.
Michel, M. C.
Michel, M., Gilabert, R., & Révész, A.
Norris, J. M.
Norris, J. M., & Ortega, L.
Plonsky, L., & Kim, Y.
Révesz, A., Michel, M. & Gilabert, R.
Révész, A., & Gurzynski-Weiss, L.
Révész, A., Michel, M. C., & Gilabert, R.
Révész, A., Sachs, R., & Hama, M.
Robinson, P., & Gilabert, R.
Sasayama, S., Malicka, A., & Norris, J.
(2015) Primary challenges in cognitive task complexity research: Results of a comprehensive research synthesis. Paper presented at the 2015 Task-Based Language Teaching Conference in Leuven, Belgium.
(2013) Is a “complex” task really complex? Measuring task complexity independently from linguistic production. Paper presented at the 5th Biennial International Conference on Task-Based Language Teaching, Banff, Alberta, Canada.
Sweller, J., Van Merriënboer, J. J. G., & Paas, F.
Walters, F. S.
Cited by 3 other publications
Barón, Júlia, M. Luz Celaya & Mayya Levkina
González-Lloret, Marta & Lourdes Ortega
Hayes, Heather, Marylee Demeter, John G. Morris & Goran Trajkovski
This list is based on CrossRef data as of 31 march 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.