Vol. 2:2 (2022) ► pp.184–217
Designing speaking tasks for different assessment goals
The complex relationship between cognitive task complexity, language performance, and task accomplishment
This study explored the role of cognitive task complexity in designing speaking assessment tasks. A sample of 120 English learners at different proficiency levels engaged in four narrative tasks with distinct levels/types of cognitive complexity. Performances were assessed using linguistic measures and a task accomplishment rubric. Findings revealed that one of the middle-complexity tasks with moderate intrinsic, moderate germane, and low extraneous complexity elicited the best linguistic performances overall, while the lowest complexity task elicited the highest task accomplishment ratings. Focusing on distinguishing among learner abilities, however, the highest complexity task demonstrated the best discrimination. Cognitive task complexity was also found to moderate the relationship between task accomplishment ratings and linguistic measures. Implications for research into task design, learner performance, and assessment purpose are considered.
Article outline
- Introduction
- Task-Based Language Assessment, task design, and cognitive task complexity
- Task performance: Linguistic indices or task accomplishment?
- Task design for different purposes
- The current study
- Methods
- Participants
- Materials
- Narrative tasks
- Cloze test
- Procedures
- Data scoring, coding, and analysis
- Task accomplishment ratings
- Linguistic indices
- Syntactic complexity
- Accuracy
- Lexis
- Fluency
- Inter-coder reliability
- Cloze test
- Statistical analysis
- Results
- Proficiency test scores
- Learner task performance
- Correlations among performance measures and task accomplishment
- Discrimination
- Discussion
- Role of task design in maximizing task performance
- Role of task design in discriminating among proficiency levels
- Role of task design in understanding the relationship among performance measures
- Limitations
- Conclusion
- Acknowledgements
- Note
-
References
https://doi.org/10.1075/task.21020.sas