Article In: AILA Review: Online-First Articles
Challenges and affordances in the assessment of digital multimodal composing
A systematic review
This content is being prepared for publication; it may be subject to changes.
Abstract
Digital multimodal composing (DMC), a key practice in multiliteracies learning, involves students creating multimodal texts through digital tools. As literacy education broadens to include the engagement with digital multimodal texts, DMC has emerged as an innovative pedagogical approach in literacy learning. While research has established its learning benefits, comparatively less attention has been devoted to how DMC is assessed. This gap is critical because effective assessment is essential to understanding how students engage with and learn through DMC. This systematic review synthesizes current research on DMC assessment to examine the learning outcomes assessed and the approaches employed. Guided by the PRISMA protocol, 17 studies published between 2010 and 2025 were analyzed, encompassing 20 distinct DMC assessment cases. The findings reveal that DMC assessments commonly target language skills, multimodal competencies, and transversal outcomes. Self-developed or theory-informed rubrics are the predominant tools used, with over half of the assessments adopting product-oriented approaches that focus solely on final outputs. Two major challenges were then identified. First, while rubrics offer structure and practicality, their rigid and prescriptive nature limits their ability to capture the multifaceted and emergent learning outcomes of DMC. Second, applying rubrics to assess students’ DMC artefacts provides limited insight into students’ non-linear, fine-grained, and contextualized learning processes. These constraints restrict DMC assessment’s potential to meaningfully scaffold learning and provide formative feedback to students in the composing process. The paper concludes by discussing how the challenges of DMC assessment in language classrooms can be addressed through innovative approaches that harness the affordances of digital tools and spaces.
Article outline
- 1.Introduction
- 2.Prior reviews, research gaps, and significance
- 3.Method
- 3.1Databases search
- 3.2Search strings
- 3.3Inclusion and exclusion criteria
- 3.4Coding scheme
- 4.Results
- 4.1General information
- 4.2What learning outcomes are assessed in DMC practices?
- 4.3What approaches are adopted to assess these learning outcomes in extant DMC practices?
- 5.Discussion and implications
- 5.1Toward a holistic understanding of DMC learning outcomes
- 5.2From fixed rubrics to adaptive, process-aware and technology-supported assessment
- 5.3Toward co-designed and participatory assessment ecologies
- 6.Conclusion
- Author queries
References
References (70)
Aagaard, T., & Lund, A. (2013). Mind the gap: Divergent objects of assessment in technology-rich learning environments. Nordic Journal of Digital Literacy, 2013, 225–243.
Adsanatham, C. (2012). Integrating assessment and instruction: Using student-generated grading criteria to evaluate multimodal digital projects. Computers and Composition, 29(2), 152–174.
Akoto, M. (2021). Collaborative multimodal writing via Google Docs: Perceptions of French FL learners. Languages (Basel), 6(3), 140.
Anderson, K. T. (2013). Contrasting systemic functional linguistic and situated literacies approaches to multimodality in literacy and writing studies. Written communication, 30(3), 276–299.
Arms, V. M. (2012). Hybrids, multi-modalities and engaged learners: A composition program for the Twenty-First Century. Rocky Mountain review (Rocky Mountain Modern Language Association), 66(2), 219–236.
Bengochea, A., Sembiante, S. F., & Gort, M. (2020). Attracting and responding to an audience: Preschoolers’ multimodal composing in show-and-tell activity. Language Arts, 97(3), 135–145.
Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment Evaluation and Accountability, 21, 5–31.
Bowen, T. (2017). Assessing visual literacy: a case study of developing a rubric for identifying and applying criteria to undergraduate student learning. Teaching in Higher Education, 22(6), 705–719.
Burnett, R. E., Frazee, A., Hanggi, K., & Madden, A. (2014). A programmatic ecology of assessment: Using a common rubric to evaluate multimodal processes and artifacts. Computers and Composition, 31(1), 53–66.
New London Group. (1996). A pedagogy of multiliteracies: designing social futures. Harvard educational review, 66(1), 60–92.
Cheung, A. (2023). Developing and evaluating a set of process and product-oriented classroom assessment rubrics for assessing digital multimodal collaborative writing in L2 classes. Assessing writing, 56, 100723.
Cumming, J., Kimber, K., & Wyatt-Smith, C. (2012). Enacting policy, curriculum and teacher conceptualisations of multimodal literacy and English in assessment and accountability. English in Australia; v.47 n.1 p.9–18; 2012, 47(1), 9–18.
Curwood, J. S. (2012). Cultural shifts, multimodal representations, and assessment practices: A case study. E-Learning and Digital Media, 9(2), 232–244.
Davis, H., & Reed, Y. (2003). Assessing multimodal texts in multilingual classrooms. Perspectives in Education, 21, 101–118.
Dawson, S., & Siemens, G. (2014). Analytics to literacies: The development of a learning analytics framework for multiliteracies assessment. International review of research in open and distance learning, 15(4), 284–305.
Deng, Y., Liu, D., & Feng, D. (2023). Students’ perceptions of peer review for assessing digital multimodal composing: the case of a discipline-specific English course. Assessment and evaluation in higher education, ahead-of-print(ahead-of-print), 1–14.
Fjørtoft, H. (2020). Multimodal digital classroom assessments. Computers and education, 152, 103892.
Gašević, D., Dawson, S. & Siemens, G. Let’s not forget: Learning analytics are about learning. TechTrends 59, 64–71 (2015).
Hafner, C., & Ho, J. (2020). Assessing digital multimodal composing in second language writing: Towards a process-based model. Journal of Second Language Writing, 47, 100710.
Hafner, C., & Miller, L. (2011). Fostering learner autonomy in English for science: A collaborative digital video project in a technological learning environment. Language, Learning and Technology, 15, 68–86.
Hafner, C. (2014). Embedding digital literacies in English language teaching: Students’ digital video projects as multimodal ensembles. TESOL Quarterly, 48(4), 655–685.
Hung, H.-T., Chiu, Y.-C. J., & Yeh, H.-C. (2013). Multimodal assessment of and for learning: A theory-driven design rubric. British Journal of Educational Technology, 44(3), 400–409.
Jewitt, C. (2003). Re-thinking assessment: Multimodality, literacy and computer-mediated learning. Assessment in Education: Principles, Policy & Practice, 10(1), 83–102.
Jiang, L., & Gu, M. (2025). Enabling critical digital literacies through GenAI-assisted multimodal composing: A longitudinal inquiry of an ethnic minority English teacher. System, 135, 103870.
Jiang, L., & Hafner, C. (2024). Digital multimodal composing in L2 classrooms: A research agenda. Language Teaching, 58(4), 528–546.
Jiang, L., & Luk, J. (2016). Multimodal composing as a learning activity in English classrooms: Inquiring into the sources of its motivational capacity. System (Linköping), 59, 1–11.
Jiang, L., & Ren, W. (2020). Digital Multimodal Composing in L2 Learning: Ideologies and Impact. Journal of Language, Identity & Education, 20, 1–16.
Jiang, L., Yang, M., & Yu, S. (2020). Chinese Ethnic Minority Students’ Investment in English Learning Empowered by Digital Multimodal Composing. TESOL Quarterly, 54(4), 954–979.
Jiang, L., Yu, S., & Lee, I. (2022). Developing a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with practice. Journal of Second Language Writing.
Kim, D., & Li, M. (2020). Digital storytelling: facilitating learning and identity development. Journal of Computers in Education, 8.
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022). Peer interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and unguided planning. System (Linköping), 106, 102722.
Kress, G., & Selander, S. (2012). Multimodal design, learning and cultures of recognition. The Internet and higher education, 15(4), 265–268.
Lam, K. Y., & Putri, E. W. (2024). A study on the affordances of digital fairy-tale rewriting: A critical literacy approach to digital multimodal composing. System, 127, 103536.
Li, J., & Li, M. (2022). Assessing L2 writing in the digital age: Opportunities and challenges. Journal of Second Language Writing, 57, 100913.
Li, M. (2020). Multimodal pedagogy in TESOL teacher education: Students’ perspectives. System (Linköping), 94, 102337.
Liang, W. J., & Lim, F. V. (2021). A pedagogical framework for digital multimodal composing in the English Language classroom. Innovation in Language Learning and Teaching, 15(4), 306–320.
Lim, F. V., & Nguyen, T. T. H. (2023). ‘If you have the freedom, you don’t need to even think hard’ — considerations in designing for student agency through digital multimodal composing in the language classroom. Language and education, 37(4), 409–427.
Lim, F. V., Weninger, C., and Nguyen, T. T. H. (2021) “I expect boredom”: Students’ experiences and expectations of multiliteracies learning. Literacy, 55: 102–112.
Lim, F. V., Toh, W., & Ong, M. (2024). Assessing multiliteracies: a systematic review and a perspective from Singapore. Asia Pacific Journal of Education, 44(3), 597–610.
Lim, F. V., & Toh, W. (2026). Designing learning with digital play: A multimodal perspective. Routledge.
Liu, M., Zhang, L. J., & Neufeld, T. J. (2025). Chinese EFL learners’ GenAI literacy in digital multimodal composing and self-regulated writing: chain mediation effects of needs satisfaction and creative selfconcept. Innovation in Language Learning and Teaching, 1–26.
Liu, Y., & Lim, F. V. (2025). Designing for multimodal literacy and socio-emotional learning through digital multimodal composing. In Querol-Julián, M. & Fortanet-Gómez, I. (Eds.). Multimodal Literacy in English as an Additional Language in Higher Education. (pp. 43–66). Routledge, London & New York.
Loerts, T., & Heydon, R. (2017). Multimodal literacy learning opportunities within a grade six classroom literacy curriculum: constraints and enablers. Education 3–13, 45(4), 490–503.
Long, P., & Siemens, G. (2011). What is learning analytics. In Proceedings of the 1st International Conference Learning Analytics and Knowledge, LAK (Vol. 11).
Matthewman, S., Blight, A., & Davies, C. (2004). What does multimodality mean for English? Creative tensions in teaching new texts and new literacies. Education, Communication & Information, 4(1), 153–176.
McGrail, E., & Behizadeh, N. (2017). K–12 multimodal assessment and interactive audiences: An exploratory analysis of existing frameworks. Assessing writing, 31, 24–38.
McHugh, M. L. (2012). Interrater reliability: the kappa statistic. Biochemia medica, 22(3), 276–282.
Mills, K. A., & Exley, B. (2014). Time, space, and text in the elementary school digital writing classroom. Written Communication, 31(4), 434–469.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Physical Therapy, 89(9), 873–880.
Nash, B. (2018). Exploring multimodal writing in secondary English classrooms: a literature review. English Teaching: Practice and Critique, 17(4), 342–356.
Nelson, M. E., Hull, G. A., & Roche-Smith, J. (2008). Challenges of multimedia self-presentation: Taking, and mistaking, the show on the road. Written Communication, 25(4), 415–440.
Pirbhai-Illich, F., Turner, K. C. N., & Austin, T. Y. (2009). Using digital technologies to address Aboriginal adolescents’ education: An alternative school intervention. Multicultural Education & Technology Journal, 3(2), 144–162.
Ryu, J., Kim, Y. A., Eum, S., Park, S., Chun, S., & Yang, S. (2022). The assessment of memes as digital multimodal composition in L2 classrooms. Journal of Second Language Writing, 57, 100914.
Silseth, K., & Gilje, Ø. (2019). Multimodal composition and assessment: a sociocultural perspective. Assessment in Education: Principles, Policy & Practice, 26(1), 26–42.
Smith, B. E. (2017). Composing across modes: a comparative analysis of adolescents’ multimodal composing processes. Learning, Media and Technology, 42(3), 259–278.
Smith, B. E., Pacheco, M. B., & Khorosheva, M. (2021). Emergent bilingual students and digital multimodal composition: A systematic review of research in secondary classrooms. Reading Research Quarterly, 56(1), 33–52.
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of Literacy Research, 45(4), 327–355.
Unsworth, L. (2006). Towards a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image interaction. English Teaching: Practice and Critique, 5(1), 55–76.
VanKooten, C., & Berkley, A. (2016). Messy problem-exploring through video in first-year writing: Assessing what counts. Computers and Composition, 40, 151–163.
Vincent, J. (2006). Children writing: Multimodality and assessment in the writing classroom. Literacy, 40(1), 51–57.
Webster, J., & Watson, R. T. (2002). Analyzing the past to prepare for the future: Writing a literature review. MIS Quarterly, 26(2), xiii–xxiii. [URL].
Wyatt-Smith, C., & Kimber, K. (2009). Working multimodally: Challenges for assessment. English Teaching: Practice and Critique, 8(3), 70. [URL]
Yi, Y., King, N., & Safriani, A. (2017). Reconceptualizing assessment for digital multimodal Literacy. TESOL Journal, 8(4), 878–885.
Yi, Y., Shin, D. S., & Cimasko, T. (2020). Multimodal literacies in teaching and learning English in and outside of school. The Handbook of TESOL in K-12, 163–177.
Yu, S., Zhang, E. D., & Liu, C. (2024). Research into practice: Digital multimodal composition in second language writing. Language Teaching, 59(2), 119–213.
Zammit, K. (2018). “We’re all real serious filmmakers”: Learning about and creating multimodal mini-documentaries. English Teaching: Practice & Critique, 17.
Zhang, M., & Chen, W. (2022). Assessing collaborative writing in the digital age: An exploratory study. Journal of Second Language Writing, 57, 100868.