Digital multimodal composing (DMC) is often framed in terms of the use of digital tools to make meaning through
multiple modes such as language, image, sound, and gesture. Yet such a focus can make DMC appear to be a neutral process of
assembling semiotic resources, rather than a social practice shaped by unequal relations of power. Composing has long been
understood as a process of identity construction, and research on DMC has shown that embedded within its practices are
inequalities and ideologies that must be examined if DMC is to give rise to possibilities for agency and transformative practice. To cast a light on these
issues, this conceptual article offers a redefinition of DMC and draws on Darvin and Norton’s
(2015) model of investment to propose a critical model of DMC. Centering the
interconnected dimensions of identity, capital and ideology, this proposed model highlights how
learners are positioned and position themselves in DMC processes, how access to material, linguistic, semiotic, cultural, and
social resources is unevenly distributed and differentially valued, and how norms, policies, and patterns of control shape the
conditions of participation. It asserts DMC as dynamic, recursive, and nonlinear practices that unfold across five interrelated
processes: gathering, imagining, integrating, reflecting, and sharing. Mapping identity,
capital, and ideology across these processes, the article shows how attention to power can help explain both the constraints that
circumscribe DMC and its potential to challenge exclusionary conditions, particularly in language learning contexts. The paper
concludes by outlining implications, for educators and researchers, of viewing DMC as a situated, ideological, and power-laden practice.
Digital multimodal composing (DMC), typically defined as the use of digital tools to make meaning with multiple modes (e.g.,
Hafner, 2015; L. Jiang, 2017), has been
shown to afford numerous possibilities for meaningful language and literacy learning in and beyond school settings due to its multiple
and diverse entry points to composition. These affordances have ranged from enhancing learners’ engagement with language and literacy
practices, self-expression, self-representation, and identity development, to expanding learners’ semiotic awareness, communicative
repertoires, and opportunities to advocate for social justice (see Michalovich, 2021a;
Smith, 2014; Smith et al., 2020). Some DMC
research has conceptualized it as a cognitive process that entails the development and deployment of a range of functional skills
(e.g., cognitive operations and behaviors relating to composing; see Tan, 2023). Other DMC
research has been conducted with a sociocultural lens that sees literacy as a social practice (L.
Jiang & Hafner, 2024), whereby composing processes are understood not strictly as cognitive processes that are
identical across contexts (or autonomous; Street, 1984), but as embedded in, shaping, and
shaped by social, cultural, political, and economic contexts and relationships.
References
Barton, D., & Hamilton, M.
(2000) Literacy
practices. In D. Barton, M. Hamilton, & R. Ivanič (Eds.), Situated
literacies: Reading and writing in
context (pp. 7–15). Psychology
Press.
Burnett, C., & Merchant, G.
(2020) Undoing the digital: Sociomaterialism and literacy education. London: Routledge.
Dahlström, H.
(2022) Students
as digital multimodal text designers: A study of resources, affordances, and
experiences. British Journal of Educational
Technology, 53(2), 391–407.
Darvin, R.
(2023) Sociotechnical structures, materialist semiotics, and online language learning. Language Learning & Technology, 27(2), 28–45. https://hdl.handle.net/10125/73502.
Darvin, R.
(2025a) Platformization,
social media, and investing in unequal digital literacy practices. Applied Linguistics
Review.
Darvin, R.
(2025b) Identity
and investment in the age of generative AI. Annual Review of Applied
Linguistics, 45, 10–27.
Darvin, R., & Norton, B.
(2015) Identity
and a model of investment in applied linguistics. Annual Review of Applied
Linguistics, 35, 36–56.
(2023) Investment
and motivation in language learning: What’s the difference?Language
Teaching, 56, 29–40.
de los
Ríos, C. V.
(2022) Translingual
youth podcasts as acoustic allies: Writing and negotiating identities at the intersection of literacies, language and
racialization. Journal of Language, Identity &
Education, 21(6), 378–392.
Fenwick, T.
(2015) Sociomateriality
and learning: A critical approach. In D. Scott & E. Hargreaves (Eds.), The
SAGE handbook of
learning (pp. 83–93). Sage.
Golden, N. A., & Pandya, J. Z.
(2019) Understanding
identity and positioning for responsive critical literacies. Language and
Education, 33(3), 211–225.
Gourlay, L.
(2024) Generative
AIs, more-than-human authorship, and Husserl’s phenomenological
‘horizons.’ In M. Cutajar, C. Borg, M.
De Laat, N. B. Dohn, & T. Ryberg (Eds.), Proceedings
of the 14th International Conference on Networked
Learning (Vol. 14, Number 1, pp. 1–8).
Hafner, C. A.
(2015) Remix
culture and English language teaching: The expression of learner voice in digital multimodal
compositions. TESOL
Quarterly, 49(3), 486–509.
Hafner, C. A., & Ho, W. Y. J.
(2020) Assessing
digital multimodal composing in second language writing: Towards a process-based model. Journal
of Second Language Writing, Special Issue on Multimodal Composing in Multilingual Learning and Teaching
Contexts, 47, 100710.
Heilker, P., & Vandenberg, P.
(1996) Keywords
in composition studies. Boynton/Cook Publishers.
Hull, G. A., & Katz, M.-L.
(2006) Crafting
an agentive self: Case studies of digital storytelling. Research in the Teaching of
English, 41(1), 43–81.
Hull, G. A., & Nelson, M. E.
(2005) Locating
the semiotic power of multimodality. Written
Communication, 22(2), 224–261.
Hyland, K.
(2011) Disciplines
and discourses: Social interactions in the construction of
knowledge. In D. Starke-Meyerring, A. Paré, N. Artemeva, M. Horne, & L. Yousoubova (Eds.), Writing
in the knowledge
society (pp. 193–214). Parlor
Press and The WAC Clearinghouse.
Jiang, J.
(2025) Reimagining
anti-racist translingual pedagogy through multilingual international students’ digital counter-storytelling
practices. International Journal of Bilingual Education and
Bilingualism, 28(2), 150–166.
Jiang, L.
(2017) The
affordances of digital multimodal composing for EFL learning. ELT
Journal, 71(4), 413–422.
Jiang, L.
(2018) Digital
multimodal composing and investment change in learners’ writing in English as a foreign
language. Journal of Second Language
Writing, 40, 60–72.
Jiang, L.
(2022) Facilitating
EFL students’ civic participation through digital multimodal composing. Language, Culture and
Curriculum, 35(1), 102–117.
Jiang, L., & Gu, M.
(2025a) Enabling
critical digital literacies through GenAI-assisted multimodal composing: A longitudinal inquiry of an ethnic minority English
teacher. System, 135, 103870.
Jiang, L., & Gu, M. M.
(2025b) Advocating
linguistic justice through digital multimodal composing against GenAI biases: A case study of multilingual youths in an EMI
university. Journal of Multilingual and Multicultural
Development, 1–17.
Jiang, L., & Hafner, C.
(2024) Digital
multimodal composing in L2 classrooms: A research agenda. Language
Teaching, 1–19.
Jiang, L., & Ren, W.
(2021) Digital
multimodal composing in L2 learning: Ideologies and impact. Journal of Language, Identity &
Education, 20(3), 167–182.
Jiang, L., Yang, M., & Yu, S.
(2020) Chinese
Ethnic Minority Students’ Investment in English Learning Empowered by Digital Multimodal
Composing. TESOL
Quarterly, 54(4), 954–979.
Jiang, L., Yu, S., & Lee, I.
(2022) Developing
a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with
practice. Journal of Second Language Writing, L2 Writing Assessment in the Digital
Age, 57, 100869.
Kalantzis, M., & Cope, B.
(2025) Multiliteracies
since social media and artificial intelligence. Harvard Educational
Review, 95(1), 135–151.
Kanno, Y., & Norton, B.
(2003) Imagined
communities and educational possibilities: Introduction. Journal of Language, Identity, and
Education, 2(4), 241–249.
Kendrick, M., Early, M., Michalovich, A., & Mangat, M.
(2022) Digital
storytelling with youth from refugee backgrounds: Possibilities for language and digital literacy
learning. TESOL
Quarterly, 56(3), 961–984.
Kress, G.
(1997) Before
writing: Rethinking the paths to literacy. Routledge.
Lai, C., Pi, R., Xiong, Y., Gu, M., & Jiang, L.
(George)
(2025) Digital
composing and publishing of multimodal cultural artefacts and investment in ethnocultural
maintenance. Language, Culture and
Curriculum, 1–22.
Lam, K. Y., & Putri, E. W.
(2024) A
study on the affordances of digital fairy-tale rewriting: A critical literacy approach to digital multimodal
composing. System, 127, 103536.
Michalovich, A.
(2021a) Digital
media production of refugee-background youth: A scoping review. Journalism and
Media, 2(1), 30–50.
Michalovich, A.
(2021b) “You’re
the boss, yo!”: Role-play in digital multimodal composition of newcomer youth. Language and
Literacy, 23(1), 25–49.
Michalovich, A.
(2023) The
social drama of digital multimodal composing: A case study with emergent bi/multilingual newcomer
students. Journal of Adolescent & Adult
Literacy, 66(6), 334–343.
Michalovich, A.
(2024) Affordances
of in-school video production for a plurilingual adolescent with interrupted formal education and refugee experiences: A
(hopeful) case study. The Canadian Modern Language
Review, 80(3), 209–223.
Michalovich, A., Kendrick, M., & Early, M.
(2022) Youth
from refugee backgrounds positioning their identities through reaction videos. Journal of
Language, Identity &
Education, 24(1), 163–178.
Moll, L. C., Amanti, C., & Gonzalez, N.
(2005) Funds
of knowledge: Theorizing practices in households, communities, and
classrooms. Routledge.
Nichols, T. P., & Garcia, A.
(2022) Platform
studies in education. Harvard Educational
Review, 92(2), 209–230.
Nichols, T. P., & Johnston, K.
(2020) Rethinking
availability in multimodal composing: Frictions in digital design. Journal of Adolescent &
Adult
Literacy, 64(3), 259–270.
Norton, B.
(2013) Identity
and language learning: Extending the conversation. Multilingual
Matters.
Smith, B. E.
(2014) Beyond
words: A review of research on adolescents and multimodal
composition. In R. E. Ferdig & K. E. Pytash (Eds.), Exploring
multimodal composition and digital
writing (pp. 1–19). IGI
Global.
Smith, B. E.
(2019) Collaborative
multimodal composing: Tracing the unique partnerships of three pairs of adolescents composing across three digital
projects. Literacy, 53(1), 14–21.
Smith, B. E., Amgott, N., & Malova, I.
(2022) “It
made me think in a different way”: Bilingual students’ perspectives on multimodal composing in the English Language Arts
classroom. TESOL
Quarterly, 56(2), 525–551.
Smith, B. E., Pacheco, M. B., & Khorosheva, M.
(2020) Emergent
bilingual students and digital multimodal composition: A systematic review of research in secondary
classrooms. Reading Research
Quarterly, 56(1).
Street, B.
(1984) Literacy
in theory and practice (Vol. 9). Cambridge
University Press.
Svendsen, S. H. B., Ask, K., Øygardslia, K., Skotnes, C. E., Ringrose, P., Grut, G., & Røkenes, F.
(2022) Migration
narratives in educational digital storytelling: Which stories can be told?Learning, Media and
Technology, 47(2), 201–215.
Tan, X.
(2023) Stories
behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional
writing. Journal of Second Language
Writing, 59, 100958.
Thorne, S. L.
(2003) Artifacts
and cultures-of-use in intercultural communication. Language Learning &
Technology, 7(2), 38–67.
Vasudevan, L., Schultz, K., & Bateman, J.
(2010) Rethinking
composing in a digital age: Authoring literate identities through multimodal
storytelling. Written
Communication, 27(4), 442–468.
Warschauer, M.
(2009) Digital
Literacy Studies: Progress and Prospects. In M. Baynham & M. Prinsloo (Eds.), The
Future of Literacy
Studies (pp. 123–140). Palgrave
Macmillan UK.
Yi, Y., Shin, D., & Cimasko, T.
(2019) Multimodal
Literacies in Teaching and Learning English In and Outside of
School. In The Handbook of TESOL in
K-12 (pp. 163–177). John
Wiley & Sons, Ltd.