Cover not available
Article published In:
AILA Review
Vol. 34:2 (2021) ► pp.300–324

The potential of sound picturebooks as multimodal narratives

Developing students’ multiliteracies in primary education

 | University of Valencia
 | University of Valencia
 | University of Valencia
In this article, we study how Sound Picturebooks constitute a multimodal narrative that enables students to develop their literacy, not only in terms of basic reading and writing skills, but also as a multidimensional interaction with other forms of representation such as images, sounds and actions. In line with the aims of the Pedagogy of Multiliteracies (New London Group 1996), we select and analyze fifteen Sound Picturebooks whose features allows us to implement the Learning by Design tenets and the four pedagogical components of the Knowledge Processes Framework: experiencing, conceptualizing, analyzing and applying. The goal is to foster basic multimodal literacies – literary, linguistic, visual and musical – and provide learners with the opportunity to construct meaning as a dynamic process of transformation and creative inquiry. Specifically, we explore the auditory features that these Sound Picturebooks contain and the extent to which the themes conveyed in the stories can be connected with the United Nations Sustainable Development Goals for the further discussion of social concerns. Our analyzes show that such multimodal narratives integrate crucial features to cultivate and broaden students’ multiliteracies in the classroom.
Keywords: sound picturebook, multiliteracies, multimodal narrative, creative inquiry, sustainable development goals
Article outline
  • Introduction
  • 2.Theoretical and conceptual framework
    • 2.1The concept of literacy in the 21st Century as a dynamic and multidimensional process
    • 2.2The pedagogy of multiliteracies and the concept of Learning by Design
    • 2.3Picturebooks as multimodal narratives to guide learners in the active process of constructing knowledge
    • 2.4The potential of sound picturebooks: The musicality of learning
    • 2.5The social function of music: Sustainable development goals
  • 3.Analytical procedure
    • 3.1Selection criteria
    • 3.2List of picturebooks
  • 4.Results
  • Conclusion
  • Note
  • References
Published online: 31 January 2022
DOI logo
https://doi.org/10.1075/aila.21006.rey
References (63)
References
Arizpe, E., & Styles, M. (2015). Children reading pictures. Interpreting visual texts. Routledge. DOI logoGoogle Scholar
Bader, B. (1976). American picture books. From Noah’s Ark to The Beast Within. Macmillan.Google Scholar
Baker, A., & Anderson-Kunert, T. (2019). Journeys in and through sound. Qualitative Research Journal, 19 (1), 2–8. DOI logoGoogle Scholar
Bradley, J. (2018). Translation and translanguaging in production and performance in community arts (Unpublished doctoral dissertation). University of Leeds.
Bradley, J., & Moore, E. (2018). Resemiotisation and creative production: Extending the translanguaging lens. In A. Sherris & E. Adami (Eds.), Making signs. Translanguaging ethnographies: Exploring urban, rural and educational spaces (pp. 81–101). Multilingual Matters. DOI logoGoogle Scholar
Bradley, J., & Harvey, L. (2019). Creative inquiry in Applied Linguistics: Language, communication and the arts. In C. Wright, L. Harvey, & J. Simpson. (Eds.), Voices and practices in Applied Linguistics: Diversifying a discipline (pp. 91–107). White Rose University Press. DOI logoGoogle Scholar
Byram, M., & Wagner, M. (2017). Making a difference: Language teaching for intercultural and international dialogue. Foreign Language Annals, 51 1,140–151. DOI logoGoogle Scholar
Cassany, D., & Castellà, J. M. (2010). Aproximación a la literacidad crítica. Perspectiva, Florianópolis, 28 (2), 353–374.Google Scholar
Cope, B., & Kalantzis, M. (2000). Multiliteracies: Literacy learning and the design of social futures. Routledge.Google Scholar
(2009). Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 4 (3), 164–195. DOI logoGoogle Scholar
(2015). A pedagogy of multiliteracies. Learning by design. Palgrave Macmillan.Google Scholar
Dewey, J. (2005). Art as experience. Tarcher Perigee.Google Scholar
Ellis, G., & Brewster, J. (2014). Tell it again!: the storytelling handbook for primary English language teachers. British Council.Google Scholar
Feld, S., & Brenneis, D. (2004). Doing anthropology in sound. American Ethnologist, 31 (4), 461–474. DOI logoGoogle Scholar
Fitzgerald, M., & Green, I. (2015). Dreams are made for children. Secret Mountain PR.Google Scholar
(2016). Under the moon. Secret Mountain PR.Google Scholar
Gershon, W. S. (2013). Vibrational affect: Sound theory and practice in qualitative research. Cultural Studies Critical Methodologies, 13 (4), 257–262. DOI logoGoogle Scholar
Goldstone, B. P. (2002). Whaz up with our books? Changing picture book codes and teaching implications. Reading Teacher, 55 1, 362–350.Google Scholar
Gregori-Signes, C. (2014). Digital storytelling and multimodal literacy in education. Publications de la Universitat de València. DOI logoGoogle Scholar
Hopgood, T., Freed, A., & Herb, N. (2017). Singing in the rain. Oxford University Press.Google Scholar
Kern, R. (2000). Literacy and language teaching. Oxford University Press.Google Scholar
Khoza, V., & Ottley, M. (2019). Dumazi and the big yellow lion. Scholastic Australia.Google Scholar
Kiefer, B. K. (1995). The potential of picturebooks. From visual literacy to aesthetic understanding. Prentice-Hall.Google Scholar
Koffka, K. (1935). Principles of Gestalt psychology. Harcourt-Brace.Google Scholar
Kress, G. R. (2010). Multimodality. A social semiotic approach to contemporary communication. Routledge.Google Scholar
Kucer, S. (2014). Dimensions of literacy: A conceptual base for teaching, reading and writing in school settings. Routledge. DOI logoGoogle Scholar
LaBelle, B. (2015). Background noise: Perspectives on sound art. Bloomsbury. DOI logoGoogle Scholar
Lacorte, M., & Reyes-Torres, A. (2021). Didáctica del Español como 2/L en el siglo XXI. Editorial Arco/Libros.Google Scholar
Lennon, J., & Jean, J. (2017). Imagine. HMH Books.Google Scholar
Lennon, J., McCartney, P., & Cole, H. (2019). With a little help of my friends. Simon and Schuster.Google Scholar
Lennon, J., McCartney, P. & Rosenthal, M. (2019). All you need is love. New York: Simon and Schuster.Google Scholar
Levitin, D. (2008). The world in six songs: How the musical brain created musical nature. Penguin Random House.Google Scholar
Lewis, D. (2001). Reading contemporary picturebooks. Picturing text. Routledge.Google Scholar
Lisa, F. (2011). Lireavecsesoreilles: Les contesmusicaux, un genre à part en Littératurepour la jeunesse (Unpublished MA thesis). Université du Maine.
López-Sánchez, A. (2014). Hacia una pedagogía para la multialfabetización. El diseño de una unidad didáctica inspirada en las propuestas del New London Group . Hispania, 97 (2), 281–297. DOI logoGoogle Scholar
Marantz, K. (1977). The picture book as art object. A call for balanced reviewing. Wilson Library Bulletin, 52 (2), 148–51.Google Scholar
Marley, C. (2014). One love. Chronicle Books.Google Scholar
Marley, C., Brantley-Newton, V., & Marley, B. (2015). Every little thing. Chronicle Books.Google Scholar
Marley, C., Marley, B., & Jay, J. (2019). Get up, stand up. Chronicle Books.Google Scholar
Martin, C. A. (2004). Breaking narrative bounds: The use of multiple visual narratives in Caldecott medal award books (Unpublished MA thesis). University of Florida.
Menke, M. R., & Paesani, K. (2019). Analysing foreign language instructional materials through the lens of multiliteracies framework. Language, Culture and Curriculum, 32 (1), 34–49. DOI logoGoogle Scholar
Moore, E., Bradley, J., & Simpson, J. (Eds.). (2020). Translanguaging as transformation: The collaborative construction of multilingual realities. Multilingual Matters.Google Scholar
New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66 (1), 60–93. DOI logoGoogle Scholar
Nikolajeva, M., & Scott, C. (2006). How picturebooks work. Garland.Google Scholar
Nodelman, P. (2018). Touching art. The art museum as a picture book, and the picture book as art. Journal of Literary Education, 17 (1), 6–25. DOI logoGoogle Scholar
Paesani, K., Allen, H. W. & Dupuy, B. (2016). Multiliteracies framework for collegiate foreign language teaching: Pearson Education.Google Scholar
Pantaleo, S. (2005). Reading’ young children’s visual texts. Early Childhood Research and Practice, 7 (1), 4–7.Google Scholar
Parker, D., & Ottley, M. (2014). Tree. Little Hare.Google Scholar
(2016). Parachute. William B. Eerdmans CO.Google Scholar
Reyes-Torres, A. (2014). Literacy education: The first step towards literary competence. In A. Reyes-Torres, L. Villacañas, & B. Soler (Eds.), Thinking through children’s literature in the classroom (pp. 42–52). Cambridge Scholars.Google Scholar
Reyes-Torres, A., & Bird, A. (2015). Reshaping curriculum to enhance the relevance of literary competence in children’s education. Childhood Education, 91 (1), 9–15. DOI logoGoogle Scholar
Reyes-Torres, A. (2019). Literatura. In J. Muñoz-Basols, E. Gironzetti & M. Lacorte (Eds.), The Routledge handbook of Spanish language teaching: Metodología, contextos y recursos para la enseñanza del español L2 (pp. 628–640). Routledge.Google Scholar
Reyes-Torres, A., & Portalés-Raga, M. (2020). A Multimodal Approach to Foster the Multiliteracies Pedagogy in the Teaching of EFL through Picturebooks: The Snow Lion. Atlantis . Journal of the Spanish Association of Anglo-AmericanStudies, 42.1, 1–26. DOI logoGoogle Scholar
Reyes-Torres, A., Portalés-Raga, M., & Bonilla-Tramoyeres, P. (2020). Multimodalidad e innovación metodológica en la enseñanza del inglés. El álbum ilustrado como recurso literario y visual para el desarrollo del conocimiento. Revista Nebrija de Lingüística Aplicada a la Enseñanza de Lenguas, 14 (28), 54–77.Google Scholar
Romanyshyn, R., & Lesiv, A. (2017). Loudly, softly, in a whisper. Wonder House.Google Scholar
Rosenblatt, L. (1986). The aesthetic transaction. Journal of Aesthetic Education, 20 (4), 122–128. DOI logoGoogle Scholar
Rowsell, J., & Walsh, M. (2015). Repensar la letroescritura para nuevos tiempos.Multimodalidad, multiliteracidades y nuevas alfabetizaciones. Enunciación, 20 (1), 141–150. DOI logoGoogle Scholar
Serafini, F. (2014). Reading the visual. An introduction to teaching multimodal literacy. Teachers College Press.Google Scholar
Sterne, J. (2012). The sound studies reader.: Routledge. DOI logoGoogle Scholar
Thiele, B., & Hopgood, T. (2015). What a wonderful world. Macmillan.Google Scholar
Warner, C., & Dupuy, B. (2018). Moving toward multiliteracies in foreign language teaching. Past and present perspectives … and beyond. Foreign Language Annals, 51 1, 116–128. DOI logoGoogle Scholar
Winner, E., Goldstein, T., & Vincent-Lancrin, S. (2013). Art for art’s sake? The impact of arts education. OECD Publishing. DOI logoGoogle Scholar
Young, R., & Ottley, M. (2016). Teacup. Dial Books.Google Scholar
Cited by (5)

Cited by five other publications

Li, Yuan
2024. How does the music that students listen to affect their level of musical literacy? Comparative analysis of Chinese students’ musical literacy formed with modern online technologies in the context of music and non-music academic majors. Interactive Learning Environments 32:8 ► pp. 4688 ff. DOI logo
Reyes-Torres, Agustin & Margarida Castellano-Sanz
2023. Learning by Design Through Born-Digital Texts in EFL. In Challenges of the Educational System in Contemporary Society [Advances in Educational Marketing, Administration, and Leadership, ], ► pp. 63 ff. DOI logo
Bataller, Alexandre, Irene Ferrando & Agustín Reyes-Torres
2022. Visual Poetry and Real Context Situations in Mathematical Problem Posing and Solving: A Study of the Affective Impact. Mathematics 10:10 ► pp. 1647 ff. DOI logo
Castellano Sanz, Margarida
2022. Challenging Picturebooks and Domestic Geographies. In Managing Pandemic Isolation With Literature as Therapy [Advances in Psychology, Mental Health, and Behavioral Studies, ], ► pp. 213 ff. DOI logo
Meng, Jie & Gengxin Sun
2022. English Translation Ability for Cultivation Mode Based on Multimodal Auxiliary Scaffolding Teaching Method. Computational Intelligence and Neuroscience 2022 ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 9 november 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.