Cover not available
Part of
L2 Collaborative Writing in Diverse Learning Contexts
Edited by Mimi Li and Meixiu Zhang
[Language Learning & Language Teaching 59] 2023
► pp. 229–247

Chapter 10
Assessing collaborative writing

Current challenges and future possibilities

| University of Melbourne
| University of Melbourne

Over the past two decades, we have witnessed the widespread use of collaborative writing tasks in second language classes driven in part by advances in technology. These advances have led to noticeable changes in the design and implementation of these tasks as well as their inclusion in assessed classwork. However, assessing collaborative writing is challenging because it requires assessors to consider what aspects of the construct of collaborative writing (product, process, nature of collaboration) should be included in the assessment criteria, and how these aspects can be reliably assessed. In this chapter we discuss these challenges, consider some suggestions on how to assess collaborative writing, and the pedagogical implications of assessing collaborative writing. We conclude by outlining future research directions.

Keywords: collaborative writing, patterns of interaction, group projects, scoring rubrics
Article outline
  • Introduction
  • Methodological considerations that impact assessment options
  • Assessing collaborative writing: Current challenges
    • Assessing the jointly written text (product)
    • Assessing the writing process and collaboration
  • Assessing collaborative writing: Future possibilities
    • Possibilities for classroom-based assessment
    • Possibilities for high-stakes assessment
  • Conclusion
  • References
Published online: 17 August 2023
DOI logo
https://doi.org/10.1075/lllt.59.10sto
References
Abrams, Z.
(2016) Exploring collaboratively written L2 texts among first-year learners of German in Google Docs. Computer Assisted Language Learning, 29(8), 1259–1270. DOI logoGoogle Scholar
(2019) Collaborative writing and text quality in Google Docs. Language Learning & Technology, 23(2), 22–42.Google Scholar
Alderson, C.
(2005) Diagnosing foreign language proficiency. The interface between learning and assessment. Continuum.Google Scholar
Arnold, N., Ducate, L., & Kost, C.
(2012) Collaboration or cooperation? Analyzing group dynamics and revision processes in wikis. CALICO Journal, 29(3), 431–448. DOI logoGoogle Scholar
Aufa, F., & Storch, N.
(2021) Learner interaction in blended collaborative L2 writing activities. In M. P. García Mayo (Ed.) Working collaboratively in second/foreign language learning (pp. 151–176). De Gruyter Mouton. DOI logoGoogle Scholar
Aydun, Z., & Yildiz, S.
(2014) Using wikis to promote collaborative EFL writing. Language Learning & Technology, 18(1), 160–180.Google Scholar
Bailey, K.
(1996) Working for washback: A review of the washback concept in language testing. Language Testing, 13, 257–279. DOI logoGoogle Scholar
Basturkmen, H.
(2010) Developing courses in English for Specific Purposes. Palgrave McMillan. DOI logoGoogle Scholar
Bernadin, H. M., Cooke, D. K. & Villanova, P.
(2000) Conscientiousness and agreeableness as predictors of rating leniency. Journal of Applied Psychology, 85(2), 232–236. DOI logoGoogle Scholar
Bradley, L., Lindström, B., & Rystedt, H.
(2010) Rationalities of collaboration for language learning in a wiki. ReCALL, 22(2), 247–265. DOI logoGoogle Scholar
Brown, J. D.
(2016) Introducing needs analysis and English for Specific Purposes. Routledge. DOI logoGoogle Scholar
Bruffee, K. A.
(1984) Collaborative learning and the ‘conversation of mankind’. College English, 46(7), 635–652. DOI logoGoogle Scholar
Butler, Y. G., & Lee, J.
(2010) The effects of self-assessment among young learners of English. Language Testing, 27(1), 5–31. DOI logoGoogle Scholar
Chen, Y.
(2008) Learning to self-assess oral performance in English: A longitudinal case study. Language Teaching Research, 12(2), 235–262. DOI logoGoogle Scholar
Cheng, W. N., & Warren, M.
(1997) Having second thoughts: Student perceptions before and after a peer assessment exercise. Studies in Higher Education, 22, 233–239. DOI logoGoogle Scholar
Cho, H.
(2017) Synchronous web-based collaborative writing: Factors mediating interaction among second-language writers. Journal of Second Language Writing, 36, 37–51. DOI logoGoogle Scholar
Davis, L.
(2009) The influence of interlocutor proficiency in a paired oral assessment. Language Testing, 26(3), 367–396. DOI logoGoogle Scholar
De Vita, G.
(2001) The use of group work in large and diverse business management classes. Some critical issues. International Journal of Management Education, 1(3), 26–34. DOI logoGoogle Scholar
Deane, P.
(2013) On the relation between automated essay scoring and modern views of the writing construct. Assessing Writing, 18(1), 7–24. DOI logoGoogle Scholar
Dikli, S., & Bleyle, S.
(2014) Automated essay scoring feedback for second language writers: how does it compare to instructor feedback? Assessing Writing 22(1), 1–17. DOI logoGoogle Scholar
Ede, L., & Lunsford, A.
(1990) Singular texts/plural authors. Southern Illinois University Press.Google Scholar
Fellenz, M. R.
(2006) Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions. Journal of Management Education, 30(4), 570–591. DOI logoGoogle Scholar
Harding, L., Alderson, C., & Brunfaut, T.
(2015) Diagnostic assessment of reading and listening in a second or foreign language: Elaborating on diagnostic principles. Language Testing, 32(3), 317–336. DOI logoGoogle Scholar
Judd, T., Kennedy, G., & Cropper, S.
(2010) Using wikis for collaborative learning: Assessing collaboration through contribution. Australasian Journal of Educational Technology, 26(3), 341–354. DOI logoGoogle Scholar
Kessler, G., & Bikowski, D.
(2010) Developing collaborative autonomous learning abilities in computer mediated language learning: Attention to meaning among students in wiki space. Computer Assisted Language Learning, 23(1), 41–58. DOI logoGoogle Scholar
Kim, Y.-H.
(2010) An argument-based validity inquiry into the empirically-derived descriptor-based diagnostic (EDD) assessment in ESL academic writing (Unpublished doctoral dissertation). University of Toronto.
Knoch, U.
(2021) Assessing writing. In G. Fulcher & L. Harding (Eds.), The Routledge handbook of language testing. (pp. 236–253). London: Routledge. DOI logoGoogle Scholar
Knoch, U., & Macqueen, S.
(2020) Assessing English for professional purposes: Language and the workplace. Routledge.Google Scholar
Knoch, U., May, L., Macqueen, S., Pill, J., & Storch, N.
(2016) Transitioning from university to the workplace: Stakeholder perceptions of academic and professional writing demands. IELTS Research Report 2016/1.
Lam, R.
(2017) Taking stock of portfolio assessment scholarship: From research to practice. Assessing Writing, 31, 84–97. DOI logoGoogle Scholar
(2018) Portfolio assessment for the teaching and learning of writing. Springer. DOI logoGoogle Scholar
Li, M.
(2018) Computer-mediated collaborative writing in L2 contexts: An analysis of empirical research. Computer Assisted Language Learning, 31(8), 882–904. DOI logoGoogle Scholar
Li, M., & Kim, D.
(2016) One wiki, two groups: Dynamic interactions across ESL collaborative writing tasks. Journal of Second Language Writing, 31, 25–42. DOI logoGoogle Scholar
Li, M., & Zhu, W.
(2017) Good or bad collaborative wiki writing: Exploring links between group interactions and writing products. Journal of Second Language Writing, 35, 38–53. DOI logoGoogle Scholar
Liu, M., Liu, L., & Liu, L.
(2018) Group awareness increases student engagement in online collaborative writing. The Internet and Higher Education, 38, 1–8. DOI logoGoogle Scholar
Long, M.
(2005) Methodological issues in learner needs analysis. In M. Long (Ed.), Second language needs analysis. (pp. 19–76). Cambridge University Press. DOI logoGoogle Scholar
Ma, J., & Cheng, L.
(2018) Preparing students to take tests. In J. I. Liontas (Ed.), The TESOL encyclopedia of English language teaching. (pp. 1–7). Wiley-Blackwell. DOI logoGoogle Scholar
Macdonald, J.
(2003) Assessing online collaborative learning: Process and product. Computers and Education, 40(4), 377–391. DOI logoGoogle Scholar
Manchón, R.
(2011) Situating the learning-to-write and writing-to-learn dimensions of L2 writing. In R. Manchón (Ed.), Learning-to-write and writing-to-learn in an additional language (pp. 3–16). John Benjamins. DOI logoGoogle Scholar
Messick, S.
(1996) Validity and washback in language testing. Language Testing, 13, 241–256. DOI logoGoogle Scholar
Min, H.-T.
(2005) Training students to become successful peer reviewers. System, 33(2), 293–308. DOI logoGoogle Scholar
Moss, P. A.
(2016) Shifting the focus of validity for test use. Assessment in Education: Principles, Policy & Practice, 23(2), 236–251. DOI logoGoogle Scholar
O’Donnell, A. M., & Hoy, A. W.
(2002) Promoting thinking through peer learning. Theory into Practice, 41(1), 2–4.Google Scholar
Olson, J. S., Wang, D., Olson, G. M., Zhang, J.
(2017) How people write together now: Beginning the investigation with advanced undergraduates in a project course. ACM Transactions on Computer-Human Interaction, 24(1), 1–40. DOI logoGoogle Scholar
Rahimi, M.
(2013) Is training student reviewers worth its while? A study of how training influences the quality of students’ feedback and writing. Language Teaching Research, 17(1), 67–89. DOI logoGoogle Scholar
Rouhshad, A., & Storch, N.
(2016) A focus on mode: Patterns of interaction in face-to-face and computer-mediated modes. In M. Sato & S. Ballinger (Eds.), Peer interaction and second language learning (pp. 267–290). John Benjamins. DOI logoGoogle Scholar
Shermis, M. D.
(2014) State-of-the-art automated essay scoring: Competition, results, and future directions from a United States demonstration. Assessing Writing, 20, 53–76. DOI logoGoogle Scholar
Storch, N.
(2002) Patterns of interaction in ESL pair work. Language Learning, 52(1), 119–158. DOI logoGoogle Scholar
(2013) Collaborative writing in L2 classrooms. Multilingual Matters. DOI logoGoogle Scholar
(2017) Implementing and assessing collaborative writing activities in EAP classes. In J. Bitchener, N. Storch, & R. Wette (Eds.), Teaching writing for academic purposes to multilingual students: Instructional approaches (pp. 130–144). Routledge. DOI logoGoogle Scholar
(2021) Collaborative writing: Promoting languaging among language learners. In M. P. García Mayo (Ed.) Working collaboratively in second/foreign language learning (pp. 13–34). De Gruyter Mouton. DOI logoGoogle Scholar
(2022) Theoretical perspectives on L2 writing and language learning in collaborative writing and the collaborative processing of written corrective feedback. In R. Manchón & C. Polio (Eds.), The Routledge handbook of second language acquisition and writing (pp. 22–34). Routledge.Google Scholar
Storch, N., & Aldosari, A.
(2013) Pairing learners in pair-work activity. Language Teaching Research, 17(1), 31–48. DOI logoGoogle Scholar
Storch, N., Zhao, H., & Morton, J.
forthcoming). Multiple perspectives on group work in a multicultural context. Australian Review of Applied Linguistics. DOI logo
Such, B.
(2019) Scaffolding English language learners for online collaborative activities. Interactive Learning Environments, 29(3), 473–481. DOI logoGoogle Scholar
Turner, C. E.
(2012) Classroom assessment. In G. Fulcher & F. Davidson (Eds.), The Routledge handbook of language testing. (pp. 65–78). Routledge.Google Scholar
Turner, C. E., & Purpura, J.
(2016) Learning-oriented assessment in the classroom. In D. Tsagari & J. Banerjee (Eds.), Handbook of second language assessment. (pp. 255–274). De Gruyter Mouton. DOI logoGoogle Scholar
Wagner, M.
(2015) The centrality of cognitive diagnostic assessment for advancing secondary school ESL students’ writing: A mixed methods study (Unpublished doctoral dissertation). University of Toronto.
Walker, A.
(2002) British psychology students’ perceptions of group-work and peer assessment. Psychology Learning and Teaching, 1(1), 28–36. DOI logoGoogle Scholar
Wall, D.
(2012) Washback. In G. Fulcher & F. Davidson (Eds.), The Routledge handbook of language testing (pp. 79–72). Routledge.Google Scholar
Wang, D., Olson, J. S., Zhang, J., Nguyen, T., & Olson, G. M.
(2015) DocuViz: Visualizing collaborative writing. In Proceedings of the 33rd Annual ACM conference on human factors in computing systems (pp. 1865–1874). Association for Computing Machinery. DOI logo
Wang, L.
(2019) The impact of computer-mediated contexts on interaction pattern of ESL learners in collaborative writing. Technology, Pedagogy and Education, 28(5), 547–562. DOI logoGoogle Scholar
Weigle, S.
(2002) Assessing writing. Cambridge University Press. DOI logoGoogle Scholar
Yeh, W.-C.
(2014) Exploring how collaborative dialogues facilitate synchronous collaborative writing. Language Learning & Technology, 18(1), 23–37.Google Scholar
Zhang, M., Akoto, M., & Li, M.
(2021) Digital multimodal composing in post-secondary settings: a review of the empirical landscape. Computer Assisted Language Learning, 1–28. DOI logoGoogle Scholar
Zhang, M., & Chen, W.
(2022) Assessing collaborative writing in the digital age: An exploratory study. Journal of Second Language Writing. 57, 100868. DOI logoGoogle Scholar
Zhang, M., Gibbons, J., & Li, M.
(2021) Computer-mediated collaborative writing in L2 classrooms: A systematic review. Journal of Second Language Writing, 54, 100854. DOI logoGoogle Scholar
Zhang, M., & Plonsky, L.
(2020) Collaborative writing in face-to-face settings: A substantive and methodological review. Journal of Second Language Writing, 49, 100753. DOI logoGoogle Scholar