Article published in:
AILA Review
Vol. 34:2 (2021) ► pp. 300–324

The potential of sound picturebooks as multimodal narratives

Developing students’ multiliteracies in primary education

| University of Valencia
| University of Valencia
| University of Valencia
In this article, we study how Sound Picturebooks constitute a multimodal narrative that enables students to develop their literacy, not only in terms of basic reading and writing skills, but also as a multidimensional interaction with other forms of representation such as images, sounds and actions. In line with the aims of the Pedagogy of Multiliteracies (New London Group 1996), we select and analyze fifteen Sound Picturebooks whose features allows us to implement the Learning by Design tenets and the four pedagogical components of the Knowledge Processes Framework: experiencing, conceptualizing, analyzing and applying. The goal is to foster basic multimodal literacies – literary, linguistic, visual and musical – and provide learners with the opportunity to construct meaning as a dynamic process of transformation and creative inquiry. Specifically, we explore the auditory features that these Sound Picturebooks contain and the extent to which the themes conveyed in the stories can be connected with the United Nations Sustainable Development Goals for the further discussion of social concerns. Our analyzes show that such multimodal narratives integrate crucial features to cultivate and broaden students’ multiliteracies in the classroom.
Keywords: sound picturebook, multiliteracies, multimodal narrative, creative inquiry, sustainable development goals
Article outline
  • Introduction
  • 2.Theoretical and conceptual framework
    • 2.1The concept of literacy in the 21st Century as a dynamic and multidimensional process
    • 2.2The pedagogy of multiliteracies and the concept of Learning by Design
    • 2.3Picturebooks as multimodal narratives to guide learners in the active process of constructing knowledge
    • 2.4The potential of sound picturebooks: The musicality of learning
    • 2.5The social function of music: Sustainable development goals
  • 3.Analytical procedure
    • 3.1Selection criteria
    • 3.2List of picturebooks
  • 4.Results
  • Conclusion
  • Note
  • References
Published online: 31 January 2022
https://doi.org/10.1075/aila.21006.rey
References
Arizpe, E., & Styles, M.
(2015) Children reading pictures. Interpreting visual texts. Routledge. CrossrefGoogle Scholar
Bader, B.
(1976) American picture books. From Noah’s Ark to The Beast Within. Macmillan.Google Scholar
Baker, A., & Anderson-Kunert, T.
(2019) Journeys in and through sound. Qualitative Research Journal, 19 (1), 2–8. CrossrefGoogle Scholar
Bradley, J.
(2018) Translation and translanguaging in production and performance in community arts (Unpublished doctoral dissertation). University of Leeds.
Bradley, J., & Moore, E.
(2018) Resemiotisation and creative production: Extending the translanguaging lens. In A. Sherris & E. Adami (Eds.), Making signs. Translanguaging ethnographies: Exploring urban, rural and educational spaces (pp. 81–101). Multilingual Matters. CrossrefGoogle Scholar
Bradley, J., & Harvey, L.
(2019) Creative inquiry in Applied Linguistics: Language, communication and the arts. In C. Wright, L. Harvey, & J. Simpson. (Eds.), Voices and practices in Applied Linguistics: Diversifying a discipline (pp. 91–107). White Rose University Press. CrossrefGoogle Scholar
Byram, M., & Wagner, M.
(2017) Making a difference: Language teaching for intercultural and international dialogue. Foreign Language Annals, 51 1,140–151. CrossrefGoogle Scholar
Cassany, D., & Castellà, J. M.
(2010) Aproximación a la literacidad crítica. Perspectiva, Florianópolis, 28 (2), 353–374.Google Scholar
Cope, B., & Kalantzis, M.
(2000) Multiliteracies: Literacy learning and the design of social futures. Routledge.Google Scholar
(2009) Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 4 (3), 164–195. CrossrefGoogle Scholar
(2015) A pedagogy of multiliteracies. Learning by design. Palgrave Macmillan.Google Scholar
Dewey, J.
(2005) Art as experience. Tarcher Perigee.Google Scholar
Ellis, G., & Brewster, J.
(2014) Tell it again!: the storytelling handbook for primary English language teachers. British Council.Google Scholar
Feld, S., & Brenneis, D.
(2004) Doing anthropology in sound. American Ethnologist, 31 (4), 461–474. CrossrefGoogle Scholar
Fitzgerald, M., & Green, I.
(2015) Dreams are made for children. Secret Mountain PR.Google Scholar
(2016) Under the moon. Secret Mountain PR.Google Scholar
Gershon, W. S.
(2013) Vibrational affect: Sound theory and practice in qualitative research. Cultural Studies Critical Methodologies, 13 (4), 257–262. CrossrefGoogle Scholar
Goldstone, B. P.
(2002) Whaz up with our books? Changing picture book codes and teaching implications. Reading Teacher, 55 1, 362–350.Google Scholar
Gregori-Signes, C.
(2014) Digital storytelling and multimodal literacy in education. Publications de la Universitat de València. CrossrefGoogle Scholar
Hopgood, T., Freed, A., & Herb, N.
(2017) Singing in the rain. Oxford University Press.Google Scholar
Kern, R.
(2000) Literacy and language teaching. Oxford University Press.Google Scholar
Khoza, V., & Ottley, M.
(2019) Dumazi and the big yellow lion. Scholastic Australia.Google Scholar
Kiefer, B. K.
(1995) The potential of picturebooks. From visual literacy to aesthetic understanding. Prentice-Hall.Google Scholar
Koffka, K.
(1935) Principles of Gestalt psychology. Harcourt-Brace.Google Scholar
Kress, G. R.
(2010) Multimodality. A social semiotic approach to contemporary communication. Routledge.Google Scholar
Kucer, S.
(2014) Dimensions of literacy: A conceptual base for teaching, reading and writing in school settings. Routledge. CrossrefGoogle Scholar
LaBelle, B.
(2015) Background noise: Perspectives on sound art. Bloomsbury. CrossrefGoogle Scholar
Lacorte, M., & Reyes-Torres, A.
(2021) Didáctica del Español como 2/L en el siglo XXI. Editorial Arco/Libros.Google Scholar
Lennon, J., & Jean, J.
(2017) Imagine. HMH Books.Google Scholar
Lennon, J., McCartney, P., & Cole, H.
(2019) With a little help of my friends. Simon and Schuster.Google Scholar
Lennon, J., McCartney, P. & Rosenthal, M.
(2019) All you need is love. New York: Simon and Schuster.Google Scholar
Levitin, D.
(2008) The world in six songs: How the musical brain created musical nature. Penguin Random House.Google Scholar
Lewis, D.
(2001) Reading contemporary picturebooks. Picturing text. Routledge.Google Scholar
Lisa, F.
(2011) Lireavecsesoreilles: Les contesmusicaux, un genre à part en Littératurepour la jeunesse (Unpublished MA thesis). Université du Maine.
López-Sánchez, A.
(2014) Hacia una pedagogía para la multialfabetización. El diseño de una unidad didáctica inspirada en las propuestas del New London Group . Hispania, 97 (2), 281–297. CrossrefGoogle Scholar
Marantz, K.
(1977) The picture book as art object. A call for balanced reviewing. Wilson Library Bulletin, 52 (2), 148–51.Google Scholar
Marley, C.
(2014) One love. Chronicle Books.Google Scholar
Marley, C., Brantley-Newton, V., & Marley, B.
(2015) Every little thing. Chronicle Books.Google Scholar
Marley, C., Marley, B., & Jay, J.
(2019) Get up, stand up. Chronicle Books.Google Scholar
Martin, C. A.
(2004) Breaking narrative bounds: The use of multiple visual narratives in Caldecott medal award books (Unpublished MA thesis). University of Florida.
Menke, M. R., & Paesani, K.
(2019) Analysing foreign language instructional materials through the lens of multiliteracies framework. Language, Culture and Curriculum, 32 (1), 34–49. CrossrefGoogle Scholar
Moore, E., Bradley, J., & Simpson, J.
(Eds.) (2020) Translanguaging as transformation: The collaborative construction of multilingual realities. Multilingual Matters.Google Scholar
New London Group
(1996) A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66 (1), 60–93. CrossrefGoogle Scholar
Nikolajeva, M., & Scott, C.
(2006) How picturebooks work. Garland.Google Scholar
Nodelman, P.
(2018) Touching art. The art museum as a picture book, and the picture book as art. Journal of Literary Education, 17 (1), 6–25. CrossrefGoogle Scholar
Paesani, K., Allen, H. W. & Dupuy, B.
(2016) Multiliteracies framework for collegiate foreign language teaching: Pearson Education.Google Scholar
Pantaleo, S.
(2005) Reading’ young children’s visual texts. Early Childhood Research and Practice, 7 (1), 4–7.Google Scholar
Parker, D., & Ottley, M.
(2014) Tree. Little Hare.Google Scholar
(2016) Parachute. William B. Eerdmans CO.Google Scholar
Reyes-Torres, A.
(2014) Literacy education: The first step towards literary competence. In A. Reyes-Torres, L. Villacañas, & B. Soler (Eds.), Thinking through children’s literature in the classroom (pp. 42–52). Cambridge Scholars.Google Scholar
Reyes-Torres, A., & Bird, A.
(2015) Reshaping curriculum to enhance the relevance of literary competence in children’s education. Childhood Education, 91 (1), 9–15. CrossrefGoogle Scholar
Reyes-Torres, A.
(2019) Literatura. In J. Muñoz-Basols, E. Gironzetti & M. Lacorte (Eds.), The Routledge handbook of Spanish language teaching: Metodología, contextos y recursos para la enseñanza del español L2 (pp. 628–640). Routledge.Google Scholar
Reyes-Torres, A., & Portalés-Raga, M.
(2020) A Multimodal Approach to Foster the Multiliteracies Pedagogy in the Teaching of EFL through Picturebooks: The Snow Lion. Atlantis . Journal of the Spanish Association of Anglo-AmericanStudies, 42.1, 1–26. CrossrefGoogle Scholar
Reyes-Torres, A., Portalés-Raga, M., & Bonilla-Tramoyeres, P.
(2020) Multimodalidad e innovación metodológica en la enseñanza del inglés. El álbum ilustrado como recurso literario y visual para el desarrollo del conocimiento. Revista Nebrija de Lingüística Aplicada a la Enseñanza de Lenguas, 14 (28), 54–77.Google Scholar
Romanyshyn, R., & Lesiv, A.
(2017) Loudly, softly, in a whisper. Wonder House.Google Scholar
Rosenblatt, L.
(1986) The aesthetic transaction. Journal of Aesthetic Education, 20 (4), 122–128. CrossrefGoogle Scholar
Rowsell, J., & Walsh, M.
(2015) Repensar la letroescritura para nuevos tiempos.Multimodalidad, multiliteracidades y nuevas alfabetizaciones. Enunciación, 20 (1), 141–150. CrossrefGoogle Scholar
Serafini, F.
(2014) Reading the visual. An introduction to teaching multimodal literacy. Teachers College Press.Google Scholar
Sterne, J.
(2012) The sound studies reader.: Routledge. CrossrefGoogle Scholar
Thiele, B., & Hopgood, T.
(2015) What a wonderful world. Macmillan.Google Scholar
Warner, C., & Dupuy, B.
(2018) Moving toward multiliteracies in foreign language teaching. Past and present perspectives … and beyond. Foreign Language Annals, 51 1, 116–128. CrossrefGoogle Scholar
Winner, E., Goldstein, T., & Vincent-Lancrin, S.
(2013) Art for art’s sake? The impact of arts education. OECD Publishing. CrossrefGoogle Scholar
Young, R., & Ottley, M.
(2016) Teacup. Dial Books.Google Scholar