The potential of sound picturebooks as multimodal narratives: Developing students’ multiliteracies in primary education

Agustín Reyes-Torres, Matilde Portalés-Raga & Clara Torres-Mañá
University of Valencia

In this article, we study how Sound Picturebooks constitute a multimodal narrative that enables students to develop their literacy, not only in terms of basic reading and writing skills, but also as a multidimensional interaction with other forms of representation such as images, sounds and actions. In line with the aims of the Pedagogy of Multiliteracies (New London Group 1996), we select and analyze fifteen Sound Picturebooks whose features allows us to implement the Learning by Design tenets and the four pedagogical components of the Knowledge Processes Framework: experiencing, conceptualizing, analyzing and applying. The goal is to foster basic multimodal literacies – literary, linguistic, visual and musical – and provide learners with the opportunity to construct meaning as a dynamic process of transformation and creative inquiry. Specifically, we explore the auditory features that these Sound Picturebooks contain and the extent to which the themes conveyed in the stories can be connected with the United Nations Sustainable Development Goals for the further discussion of social concerns. Our analyzes show that such multimodal narratives integrate crucial features to cultivate and broaden students’ multiliteracies in the classroom.

Publication history
Table of contents

With the advent of technology, the continuous influx of diverse sociocultural perspectives and the increase of multimodal ensembles in our daily lives, creativity and the exploration of arts as the objects of communication are becoming increasingly integrated in applied linguistics (Bradley & Moore, 2018; Moore, Bradley & Simpson, 2020). Taking as a starting point the role of creative inquiry and the relevance of multidisciplinary learning in generating new ways of thinking about the relationship between language, knowledge and the world (Bradley, 2018; Cope & Kalantzis, 2015; Kern, 2000; Serafini, 2014), this article focuses on the use of Sound Picturebooks to guide students to expand their literacy and become code breakers, meaning makers and text users of different modes of expression (Kucer, 2014). Connecting literature with visual art, music and language, we present the potential of multimodal narratives to aim not just at educating students in arts but educating students with, into and through arts (Bradley & Harvey, 2019; Winner, Goldstein, & Vincent-Lancrin, 2013). To this end, our research focuses on the selection and analysis of fifteen Sound Picturebooks (SPB) that can be implemented in the First-grade classroom to foster basic multimodal literacies – literary, linguistic, visual and musical – as well as aesthetic experiences. As will be shown, we consider the auditory features that these SPB contain and how we can connect the themes conveyed in the stories with the United Nations Sustainable Development Goals (SDG) to develop learners’ knowledge regarding current social matters. The research question we aim to respond is: What are the most effective features of SPB to foster multiliteracies and raise students’ awareness towards SDG?

Full-text access is restricted to subscribers. Log in to obtain additional credentials. For subscription information see Subscription & Price. Direct PDF access to this article can be purchased through our e-platform.

References

Arizpe, E., & Styles, M.
(2015) Children reading pictures. Interpreting visual texts. Routledge. Google Scholar logo with link to Google Scholar
Bader, B.
(1976) American picture books. From Noah’s Ark to The Beast Within. Macmillan.Google Scholar logo with link to Google Scholar
Baker, A., & Anderson-Kunert, T.
(2019) Journeys in and through sound. Qualitative Research Journal, 19 (1), 2–8. Google Scholar logo with link to Google Scholar
Bradley, J.
(2018) Translation and translanguaging in production and performance in community arts (Unpublished doctoral dissertation). University of Leeds.
Bradley, J., & Moore, E.
(2018) Resemiotisation and creative production: Extending the translanguaging lens. In A. Sherris & E. Adami (Eds.), Making signs. Translanguaging ethnographies: Exploring urban, rural and educational spaces (pp. 81–101). Multilingual Matters. Google Scholar logo with link to Google Scholar
Bradley, J., & Harvey, L.
(2019) Creative inquiry in Applied Linguistics: Language, communication and the arts. In C. Wright, L. Harvey, & J. Simpson. (Eds.), Voices and practices in Applied Linguistics: Diversifying a discipline (pp. 91–107). White Rose University Press. Google Scholar logo with link to Google Scholar
Byram, M., & Wagner, M.
(2017) Making a difference: Language teaching for intercultural and international dialogue. Foreign Language Annals, 51 ,140–151. Google Scholar logo with link to Google Scholar
Cassany, D., & Castellà, J. M.
(2010) Aproximación a la literacidad crítica. Perspectiva, Florianópolis, 28 (2), 353–374.Google Scholar logo with link to Google Scholar
Cope, B., & Kalantzis, M.
(2000) Multiliteracies: Literacy learning and the design of social futures. Routledge.Google Scholar logo with link to Google Scholar
(2009) Multiliteracies: New literacies, new learning. Pedagogies: An International Journal, 4 (3), 164–195. Google Scholar logo with link to Google Scholar
(2015) A pedagogy of multiliteracies. Learning by design. Palgrave Macmillan.Google Scholar logo with link to Google Scholar
Dewey, J.
(2005) Art as experience. Tarcher Perigee.Google Scholar logo with link to Google Scholar
Ellis, G., & Brewster, J.
(2014) Tell it again!: the storytelling handbook for primary English language teachers. British Council.Google Scholar logo with link to Google Scholar
Feld, S., & Brenneis, D.
(2004) Doing anthropology in sound. American Ethnologist, 31 (4), 461–474. Google Scholar logo with link to Google Scholar
Fitzgerald, M., & Green, I.
(2015) Dreams are made for children. Secret Mountain PR.Google Scholar logo with link to Google Scholar
(2016) Under the moon. Secret Mountain PR.Google Scholar logo with link to Google Scholar
Gershon, W. S.
(2013) Vibrational affect: Sound theory and practice in qualitative research. Cultural Studies Critical Methodologies, 13 (4), 257–262. Google Scholar logo with link to Google Scholar
Goldstone, B. P.
(2002) Whaz up with our books? Changing picture book codes and teaching implications. Reading Teacher, 55 , 362–350.Google Scholar logo with link to Google Scholar
Gregori-Signes, C.
(2014) Digital storytelling and multimodal literacy in education. Publications de la Universitat de València. Google Scholar logo with link to Google Scholar
Hopgood, T., Freed, A., & Herb, N.
(2017) Singing in the rain. Oxford University Press.Google Scholar logo with link to Google Scholar
Kern, R.
(2000) Literacy and language teaching. Oxford University Press.Google Scholar logo with link to Google Scholar
Khoza, V., & Ottley, M.
(2019) Dumazi and the big yellow lion. Scholastic Australia.Google Scholar logo with link to Google Scholar
Kiefer, B. K.
(1995) The potential of picturebooks. From visual literacy to aesthetic understanding. Prentice-Hall.Google Scholar logo with link to Google Scholar
Koffka, K.
(1935) Principles of Gestalt psychology. Harcourt-Brace.Google Scholar logo with link to Google Scholar
Kress, G. R.
(2010) Multimodality. A social semiotic approach to contemporary communication. Routledge.Google Scholar logo with link to Google Scholar
Kucer, S.
(2014) Dimensions of literacy: A conceptual base for teaching, reading and writing in school settings. Routledge. Google Scholar logo with link to Google Scholar
LaBelle, B.
(2015) Background noise: Perspectives on sound art. Bloomsbury. Google Scholar logo with link to Google Scholar
Lacorte, M., & Reyes-Torres, A.
(2021) Didáctica del Español como 2/L en el siglo XXI. Editorial Arco/Libros.Google Scholar logo with link to Google Scholar
Lennon, J., & Jean, J.
Lennon, J., McCartney, P., & Cole, H.
(2019) With a little help of my friends. Simon and Schuster.Google Scholar logo with link to Google Scholar
Lennon, J., McCartney, P. & Rosenthal, M.
(2019) All you need is love. New York: Simon and Schuster.Google Scholar logo with link to Google Scholar
Levitin, D.
(2008) The world in six songs: How the musical brain created musical nature. Penguin Random House.Google Scholar logo with link to Google Scholar
Lewis, D.
(2001) Reading contemporary picturebooks. Picturing text. Routledge.Google Scholar logo with link to Google Scholar
Lisa, F.
(2011) Lireavecsesoreilles: Les contesmusicaux, un genre à part en Littératurepour la jeunesse (Unpublished MA thesis). Université du Maine.
López-Sánchez, A.
(2014) Hacia una pedagogía para la multialfabetización. El diseño de una unidad didáctica inspirada en las propuestas del New London Group . Hispania, 97 (2), 281–297. Google Scholar logo with link to Google Scholar
Marantz, K.
(1977) The picture book as art object. A call for balanced reviewing. Wilson Library Bulletin, 52 (2), 148–51.Google Scholar logo with link to Google Scholar
Marley, C.
(2014) One love. Chronicle Books.Google Scholar logo with link to Google Scholar
Marley, C., Brantley-Newton, V., & Marley, B.
(2015) Every little thing. Chronicle Books.Google Scholar logo with link to Google Scholar
Marley, C., Marley, B., & Jay, J.
(2019) Get up, stand up. Chronicle Books.Google Scholar logo with link to Google Scholar
Martin, C. A.
(2004) Breaking narrative bounds: The use of multiple visual narratives in Caldecott medal award books (Unpublished MA thesis). University of Florida.
Menke, M. R., & Paesani, K.
(2019) Analysing foreign language instructional materials through the lens of multiliteracies framework. Language, Culture and Curriculum, 32 (1), 34–49. Google Scholar logo with link to Google Scholar
Moore, E., Bradley, J., & Simpson, J.
(Eds.) (2020) Translanguaging as transformation: The collaborative construction of multilingual realities. Multilingual Matters.Google Scholar logo with link to Google Scholar
New London Group
(1996) A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66 (1), 60–93. Google Scholar logo with link to Google Scholar
Nikolajeva, M., & Scott, C.
(2006) How picturebooks work. Garland.Google Scholar logo with link to Google Scholar
Nodelman, P.
(2018) Touching art. The art museum as a picture book, and the picture book as art. Journal of Literary Education, 17 (1), 6–25. Google Scholar logo with link to Google Scholar
Paesani, K., Allen, H. W. & Dupuy, B.
(2016) Multiliteracies framework for collegiate foreign language teaching: Pearson Education.Google Scholar logo with link to Google Scholar
Pantaleo, S.
(2005) Reading’ young children’s visual texts. Early Childhood Research and Practice, 7 (1), 4–7.Google Scholar logo with link to Google Scholar
Parker, D., & Ottley, M.
(2016) Parachute. William B. Eerdmans CO.Google Scholar logo with link to Google Scholar
Reyes-Torres, A.
(2014) Literacy education: The first step towards literary competence. In A. Reyes-Torres, L. Villacañas, & B. Soler (Eds.), Thinking through children’s literature in the classroom (pp. 42–52). Cambridge Scholars.Google Scholar logo with link to Google Scholar
Reyes-Torres, A., & Bird, A.
(2015) Reshaping curriculum to enhance the relevance of literary competence in children’s education. Childhood Education, 91 (1), 9–15. Google Scholar logo with link to Google Scholar
Reyes-Torres, A.
(2019) Literatura. In J. Muñoz-Basols, E. Gironzetti & M. Lacorte (Eds.), The Routledge handbook of Spanish language teaching: Metodología, contextos y recursos para la enseñanza del español L2 (pp. 628–640). Routledge.Google Scholar logo with link to Google Scholar
Reyes-Torres, A., & Portalés-Raga, M.
(2020) A Multimodal Approach to Foster the Multiliteracies Pedagogy in the Teaching of EFL through Picturebooks: The Snow Lion. Atlantis . Journal of the Spanish Association of Anglo-AmericanStudies, 42.1, 1–26. Google Scholar logo with link to Google Scholar
Reyes-Torres, A., Portalés-Raga, M., & Bonilla-Tramoyeres, P.
(2020) Multimodalidad e innovación metodológica en la enseñanza del inglés. El álbum ilustrado como recurso literario y visual para el desarrollo del conocimiento. Revista Nebrija de Lingüística Aplicada a la Enseñanza de Lenguas, 14 (28), 54–77.Google Scholar logo with link to Google Scholar
Romanyshyn, R., & Lesiv, A.
(2017) Loudly, softly, in a whisper. Wonder House.Google Scholar logo with link to Google Scholar
Rosenblatt, L.
(1986) The aesthetic transaction. Journal of Aesthetic Education, 20 (4), 122–128. Google Scholar logo with link to Google Scholar
Rowsell, J., & Walsh, M.
(2015) Repensar la letroescritura para nuevos tiempos.Multimodalidad, multiliteracidades y nuevas alfabetizaciones. Enunciación, 20 (1), 141–150. Google Scholar logo with link to Google Scholar
Serafini, F.
(2014) Reading the visual. An introduction to teaching multimodal literacy. Teachers College Press.Google Scholar logo with link to Google Scholar
Sterne, J.
(2012) The sound studies reader.: Routledge. Google Scholar logo with link to Google Scholar
Thiele, B., & Hopgood, T.
(2015) What a wonderful world. Macmillan.Google Scholar logo with link to Google Scholar
Warner, C., & Dupuy, B.
(2018) Moving toward multiliteracies in foreign language teaching. Past and present perspectives … and beyond. Foreign Language Annals, 51 , 116–128. Google Scholar logo with link to Google Scholar
Winner, E., Goldstein, T., & Vincent-Lancrin, S.
(2013) Art for art’s sake? The impact of arts education. OECD Publishing. Google Scholar logo with link to Google Scholar
Young, R., & Ottley, M.
 
Mobile Menu Logo with link to supplementary files background Layer 1 jbe-platform.quadraat-sans-bold jbe-platform.quadraat-sans-bold-dark jbe-platform.quadraat-sans-bold-light jbe-platform.quadraat-sans-bold prag Twitter_Logo_Blue