Cover not available
Article published In:
Gesture
Vol. 18:1 (2019) ► pp.57–82

Dynamic processes of intermodal coordination in the ontogenesis of language

| University of the Basque Country
| University of the Basque Country
| University of the Basque Country
| University of the Basque Country

The aim of this study is to explore the multimodal communicative patterns used by infants during their first-words transition period. The combinatorial patterns of twelve children living in Basque Country with different mother tongues were analyzed longitudinally from 9 to 21 months of age. A total of 4,299 communicative behaviors were recorded and coded (vocalizations, gestures, and pragmatic functions). Results showed a significant increase in multimodal communicative patterns from 12 months onwards, and differences in the infants’ vocal construction depending on the specific types of gestures involved. Thus, it was observed that gestures and speech combinations have influence on the child’s pragmatic function and vocalizations structure.

Keywords: multimodal communication, gesture, early grammatical development, pragmatics, language development
Article outline
  • Introduction
  • Method
    • Participants
    • Materials and procedure
    • Coding and reliability
  • Results
  • Discussion and conclusions
  • Acknowledgements
  • References
Published online: 11 September 2020
DOI logo
https://doi.org/10.1075/gest.00033.rom
References
Acredolo, Linda & Susan Goodwin
(1988) Symbolic gesturing in normal infants. Child Development, 59 (2), 450–466. DOI logoGoogle Scholar
Alibali, Martha W., Sotaro Kita, & Amanda J. Young
(2000) Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes, 15 (6), 593–613. DOI logoGoogle Scholar
Aureli, Tiziana, Maria Spinelli, Mirco Fasolo, Maria Concetta Garito, Paola Perucchini, & Laura D’Odorico
(2017) The pointing-vocal coupling progression in the first half of the second year of life. Infancy, 22 (6), 801–818. DOI logoGoogle Scholar
Bates, Elizabeth, Luigia Camaioni, & Virginia Volterra
(1975) The acquisition of performatives prior to speech. Merrill-Palmer Quarterly of Behavior and Development, 21 (3), 205–224.Google Scholar
Bates, Elizabeth, Laura Benigni, Inge Bretherton, Luigia Camaioni, & Virginia Volterra
(1979) The emergence of symbols: Cognition and communication in infancy. New York: Academic Press.Google Scholar
Bergmann, Kirsten, Volkan Aksu, & Stefan Kopp
(2011) The relation of speech and gestures: Temporal synchrony follows semantic synchrony. Proceedings of the 2nd Workshop on Gesture and Speech in Interaction (GeSpIn 2011). Bielefeld, Germany.Google Scholar
Blake, Joanna, Paula O’Rourke, & Grace Borzellino
(1994) Form and function in the development of pointing and reaching gestures. Infant Behavior & Development, 17 (2), 195–203. DOI logoGoogle Scholar
Bosch, Laura
(2004).Evaluación fonológica del habla infantil. Barcelona: Masson.Google Scholar
Butcher, Cynthia & Susan Goldin-Meadow
(2000) Gesture and the transition from one- to two-word speech: when hand and mouth come together. In David McNeill (Ed.), Language and gesture (pp. 235–258). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Cadime, Irene, Carla Silva, Sandra Santos, Iolanda Ribeiro, & Fernanda Leopoldina Viana
(2017) The interrelatedness between infants’ communicative gestures and lexicon size: A longitudinal study. Infant Behavior and Development, 481, 88–97. DOI logoGoogle Scholar
Capirci, Olga, Jana M. Iverson, Elena Pizzuto, & Virginia Volterra
(1996) Gestures and words during the transition to two-word speech. Journal of Child Language, 23 (3), 645–673. DOI logoGoogle Scholar
Capone, Nina C. & Karla K. McGregor
(2004) Gesture development: a review for clinicians and researchers. Journal of Speech, Language, and Hearing Research, 47 (1), 173–186. DOI logoGoogle Scholar
Carpenter, Malinda, Katherine Nagell, Michael Tomasello, George Butterworth, & Chris Moore
(1998) Social cognition, joint attention, and communicative competence from 9 to 15 months of age. Monographs of the Society for Research in Child Development, 63 (4), 152–174. DOI logoGoogle Scholar
Caselli, Maria Cristina, Pasquale Rinaldi, Silvia Stefanini, & Virginia Volterra
(2012) Early action and gesture ‘vocabulary’ and its relation with word comprehension and production. Child Development, 83 (2), 526–542. DOI logoGoogle Scholar
Church, Ruth Breckinridge, Martha W. Alibali, & Spencer D. Kelly
(2017) Why gesture? How the hands function in speaking, thinking and communicating. Amsterdam & Philadelphia: John Benjamins Publishing Company. DOI logoGoogle Scholar
Cochet, Hélène & Jacques Vauclair
(2010) Pointing gesture in young children: hand preference and language development. Gesture, 10 (2/3), 129–149. DOI logoGoogle Scholar
Colonnesi, Cristina, Geert Jan J. Stams, Irene Koster, & Marc J. Noom
(2010) The relation between pointing and language development: A meta-analysis. Developmental Review, 30 (4), 352–366. DOI logoGoogle Scholar
De Ruiter, Jan-Peter
(1998) Gesture and speech production. Doctoral dissertation, Nijmegen: Katholieke Universiteit.Google Scholar
(2000) The production of gesture and speech. In David McNeill (Ed.), Language and gesture (pp. 284–311). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Ejiri, Keiko & Nobuo Masataka
(2001) Co-occurrence of preverbal vocal behavior and motor action in early infancy. Developmental Science, 4 (1), 40–48. DOI logoGoogle Scholar
Esteve-Gibert, Núria & Pilar Prieto
(2013) Intonational and gestural structures are temporally coordinated. Laboratory Phonology (LabPhon 13). DOI logoGoogle Scholar
(2014) Infants temporally coordinate gesture-speech combinations before they produce their first words. Speech Communication, 571, 301–316. DOI logoGoogle Scholar
Esteve-Gibert, Núria, Pilar Prieto, & Ferran Pons
(2015) Nine-month-old infants are sensitive to the temporal alignment of prosodic and gesture prominences. Infant Behavior and Development, 381, 126–129. DOI logoGoogle Scholar
Ezeizabarrena, Maria Jose
(2002) Root infinitives in two pro-drop languages. In Ana Teresa Pérez-Leroux & Juana Muñoz Liceras (Eds.), The acquisition of Spanish morphosyntax (pp. 35–65). Dordrecht: Kluwer. DOI logoGoogle Scholar
Fasolo, Mirco & Laura D’Odorico
(2012) Gesture-plus-word combinations, transitional forms, and language development. Gesture, 12 (1), 1–15. DOI logoGoogle Scholar
Feldman, Ruth & J. Steven Reznick
(1996) Maternal perception of infant intentionality at 4 and 8 months. Infant Behavior and Development, 19 (4), 483–496. DOI logoGoogle Scholar
Fernández, Isabel
(2009) ¿Cómo hablan los niños? El desarrollo del componente fonológico en el lenguaje infantil. Madrid: Arco/Libros.Google Scholar
Goldin-Meadow, Susan, Whitney Goodrich, Eve Sauer, & Jana Iverson
(2007) Young children use their hands to tell their mothers what to say. Developmental Science, 10 (6), 778–785. DOI logoGoogle Scholar
Goldstein, Brian A. & Karen E. Pollock
(2000) Vowel errors in Spanish-speaking children with phonological disorders: a retrospective, comparative study. Clinical Linguistics and Phonetics, 141, 217–225. DOI logoGoogle Scholar
Goldstein, Michael H., Jennifer A. Schwade, & Marc H. Bornstein
(2009) The value of vocalizing five-month-old infants associate their own noncry vocalizations with responses from caregivers. Child Development, 80 (3), 636–644. DOI logoGoogle Scholar
Grice, H. Paul
(1975) Logic and conversation. In Peter Cole & Jerry L. Morgan (Eds.), Syntax and semantics, Vol. 3: Speech acts (pp. 41–58). New York: Academic Press.Google Scholar
Idiazabal, Itziar
(1991) Adquisición del lenguaje en niños bilingües y monolingües. Bilbao: UPV/EHU.Google Scholar
Igualada, Alfonso, Laura Bosch, & Pilar Prieto
(2015) Language development at 18 months is related to multimodal communicative strategies at 12 months. Infant Behavior and Development, 391, 42–52. DOI logoGoogle Scholar
Iverson, Jana M.
(2010) Multimodality in infancy: vocal-motor and speech-gesture coordinations in typical and atypical development. Enfance 2010 (3), 257–274. DOI logoGoogle Scholar
Iverson, Jana M., Olga Capirci, Virginia Volterra, & Susan Goldin-Meadow
(2008) Learning to talk in a gesture-rich world: Early communication in Italian vs. American children. First Language, 28 (2), 164–181. DOI logoGoogle Scholar
Iverson, Jana M. & Susan Goldin-Meadow
(2005) Gesture paves the way for language development. Psychological Science, 16 (5), 367–371. DOI logoGoogle Scholar
Iverson, Jana M., Heather L. Tencer, Jill Lany, & Susan Goldin-Meadow
(2000) The relation between gesture and speech in congenitally blind and sighted language-learners. Journal of Nonverbal Behavior, 24 (2), 105–130. DOI logoGoogle Scholar
Karousou, Alexandra
(2003) Análisis de las vocalizaciones tempranas: su patrón evolutivo y su función determinante en la emergencia de la palabra. Unpublished doctoral dissertation. Madrid: Universidad Complutense.Google Scholar
Kendon, Adam
(1993) Human gesture. In Kathleen R. Gibson, & Tim Ingold (Eds.), Tools, language, and cognition in human evolution (pp. 43–62). New York: Cambridge University Press.Google Scholar
Keren-Portnoy, Tamar, Marinella Majorano, & Marilyn Vihman
(2009) From phonetics to phonology: The emergence of first words in Italian. Journal of Child Language, 36 (2), 235–267. DOI logoGoogle Scholar
Krahmer, Emiel & Marc Swerts
(2007) The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57 (3), 396–414. DOI logoGoogle Scholar
Larrañaga, Pilar & Pedro Guijarro-Fuentes
(2012) Clitics in L1 bilingual acquisition. First language, 321, 151–175. DOI logoGoogle Scholar
Lausberg, Hedda & Han Sloetjes
(2009) Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, 41 (3), 841–849. DOI logoGoogle Scholar
Legerstee, Maria
(1991) Changes in the quality of infant sounds as a function of social and nonsocial stimulation. First Language, 11 (33), 327–343. DOI logoGoogle Scholar
Leonard, Thomas & Fred Cummins
(2010) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26 (10), 1295–1309. DOI logoGoogle Scholar
Liszkowski, Ulf & Michael Tomasello
(2011) Individual differences in social, cognitive, and morphological aspects of infant pointing. Cognitive Development, 26 (1), 16–29. DOI logoGoogle Scholar
Loehr, Daniel
(2007) Aspects of rhythm in gesture and speech. Gesture, 7 (2), 179–214. DOI logoGoogle Scholar
Lüke, Carina, Ute Ritterfeld, Angela Grimminger, Ulf Liszkowski, & Katharina J. Rohlfing
(2017) Development of pointing gestures in children with typical and delayed language acquisition. Journal of Speech, Language, and Hearing Research, 601, 3185–3197. DOI logoGoogle Scholar
Masataka, Nobuo
(1993) Effects of contingent and noncontingent maternal stimulation on the vocal behaviour of three- to four-month-old Japanese infants. Journal of Child Language, 20 (2), 303–312. DOI logoGoogle Scholar
(1995) The relation between index-finger extension and the acoustic quality of cooing in three-month-old infants. Journal of Child Language, 22 (2), 247–257. DOI logoGoogle Scholar
McNeill, David
(1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.Google Scholar
Miller, Jennifer L. & Amanda K. Lossia
(2013) Prelinguistic infants’ communicative system: Role of caregiver social feedback. First Language, 33 (5), 524–544. DOI logoGoogle Scholar
Moore, Chris & Barbara D’Entremont
(2001) Developmental changes in pointing as a function of parent’s attentional focus. Journal of Cognition and Development, 21, 109–129. DOI logoGoogle Scholar
Mumford, Katherine H. & Sotaro Kita
(2014) Children use gesture to interpret novel verb meanings. Child Development, 851, 1181–1189. DOI logoGoogle Scholar
Murillo, Eva & Mercedes Belinchón
(2012) Gestural-vocal coordination: Longitudinal changes and predictive value on early lexical development. Gesture, 12 (1), 16–39. DOI logoGoogle Scholar
(2013) Patrones comunicativos multimodales en la transición a las primeras palabras: cambios en la coordinación de gestos y vocalizaciones. Infancia y Aprendizaje: Journal for the Study of Education and Development, 36 (4), 473–487. DOI logoGoogle Scholar
Murillo, Eva & Almudena Capilla
(2015) Properties of vocalization- and gesture-combinations in the transition to first words. Journal Child Language, 41, 1–24. DOI logoGoogle Scholar
Oller, D. Kimbrough, Leslie A. Wieman, William J. Doyle, & Carol Ross
(1976) Infant babbling and speech. Journal of Child Language, 31, 1–11. DOI logoGoogle Scholar
Özçaliskan, Seyda, & Susan Goldin-Meadow
(2005) Do parents lead their children by the hand? Journal of child language, 32 (3), 481–505. DOI logoGoogle Scholar
Papaeliou, Christina & Colwyn Trevarthen
(2006) Prelinguistic pitch patterns expressing ‘communication’ and ‘apprehension’. Journal of Child Language, 3 (3), 163–178. DOI logoGoogle Scholar
Rivero, Magda
(2003) Los inicios de la comunicación: la intencionalidad comunicativa y el significado como procesos graduales. Anuario de Psicología, 34 (3), 337–356.Google Scholar
Rochat, Phililppe
(2007) Intentional action arises from early reciprocal exchanges. Acta Psychologica, 124 (1), 8–25. DOI logoGoogle Scholar
Romero, Asier, Aintzane Etxebarria, Iñaki Gaminde, & Urtza Garay
(2015) El papel de la prosodia en la enseñanza de la L1. Un aporte didáctico para el aula de Educación Infantil y de Educación Primaria. Revista Phonica, 111, 64–86.Google Scholar
Romero, Asier
(2017) La vibrante en el País Vasco: adquisición fonológica y caracterización acústica desde el español y desde el euskera. Verba, 441, 169–194. DOI logoGoogle Scholar
Romero, Asier, Aintzane Etxebarria, Irati De Pablo, & Ainara Romero
(2017) The interrelation of gestures and vocalization in early communication functions: Evidence from Basque language. Signos. Estudios de Lingüística, 50 (93), 96–123. DOI logoGoogle Scholar
Romero, Asier, Irati De Pablo, Aintzane Etxebarria, & Ainara Romero
(2018) Coordinación entre vocalizaciones, gestos y prosodia antes del inicio de la comunicación verbal: evidencias desde la lengua vasca. Infancia y Aprendizaje, 41 (2), 325–368. DOI logoGoogle Scholar
Roustan, Benjamin & Marion Dohen
(2010) Co-production of contrastive prosodic focus and manual gestures: temporal coordination and effects on the acoustic and articulatory correlates of focus. In Proceedings of Speech Prosody 2010, Chicago. [URL]
Rowe, Meredith & Susan Goldin-Meadow
(2009) Differences in early gesture explain SES disparities in child vocabulary size at school entry. Science, 323 (5916), 951–953. DOI logoGoogle Scholar
Sacks, Jacqueline
(2005) Communication development in infancy. In Jean Berko Gleason (Ed.), The development of language (pp. 40–68). Boston, MA: Pearson.Google Scholar
Sarriá, Encarnación
(1991) Observación de la comunicación intencional preverbal: Un sistema de codificación basado en el concepto de la categoría natural. Psicotema, 31, 359–380.Google Scholar
Shore, Cecilia, Elizabeth Bates, Inge Bretherton, Marjorie Beeghly, & Barbara O’Connell
(1990) Vocal and gestural symbols: Similarities and differences from 13 to 28 months. In Virginia Volterra & Carol J. Erting (Eds.), From gesture to language in hearing and deaf children (pp. 211–236). New York: Springer-Verlag. DOI logoGoogle Scholar
Smith, Bruce L., Sharon Brown-Sweeney, & Carol Stoel-Gammon
(1989) A quantitative analysis of reduplicated and variegated babbling. First Language, 9 (26), 175–189. DOI logoGoogle Scholar
Stewart, Jessica Rae
(2016) The use of gestures in typically developing children 9–15 months of age. Available from ProQuest Dissertations & Theses Global. Retrieved from [URL]
Tamarit, Javier
(2001) Prueba ACACIA: Análisis de competencia comunicativa interactiva, autismo y otros transtornos. Madrid: EOS.Google Scholar
Tomasello, Michael
(1988) The role of joint attentional process in early language development. Language Sciences, 10 (1), 69–88. DOI logoGoogle Scholar
Tomasello, Michael, Malinda Carpenter, & Ulf Liszkowski
(2007) A new look at infant pointing. Child Development, 78 (3), 705–722. DOI logoGoogle Scholar
Tomasello, Michael, & Michael Jeffrey Farrar
(1986) Joint attention and early language. Child Development, 57 (6), 1454–1463. DOI logoGoogle Scholar
Vihman, Marilyn May & Ruth Miller
(1988) Words and babble at the threshold of language acquisition. In Michael D. Smith & John L. Locke (Eds.), The emergent lexicon: The child’s development of a linguistic vocabulary (pp. 151–184). New York: Academic Press.Google Scholar
Volterra, Virginia, Luigia Camaioni, Laura Benigni, & Elizabeth Bates
(1981) Le prime parole. Giornale Italiano di Psicología, 81, 243–263.Google Scholar
Wakefield, Elizabeth M., Miriam A. Novack, & Susan Goldin-Meadow
(2017) Unpacking the ontogeny of gesture understanding: How movement becomes meaningful across development. Child Development, 89 (3), e245–e260. DOI logoGoogle Scholar
West, Brady T., Kathleen B. Welch, & Andrzej T. Galecki
(2007) Linear mixed models: A practical guide using statistical software. New York: Chapman & Hall/CRC.Google Scholar
Wu, Zhen & Julie Gros-Louis
(2014) Infants’ prelinguistic communicative acts and maternal responses: Relations to linguistic development. First Language, 34 (1), 72–90. DOI logoGoogle Scholar