Cover not available
Part of
The Development of Prosody in First Language Acquisition
Edited by Pilar Prieto and Núria Esteve-Gibert
[Trends in Language Acquisition Research 23] 2018
► pp. 103–124

Chapter 6
Set in time

Temporal coordination of prosody and gesture in the development of spoken language production

| Duquesne University
| Aix Marseille Université, CNRS, LPL UMR 7309 | Universitat de Barcelona

The purpose of this chapter is to discuss the relationship between prosody, gesture, and spoken language production from a developmental perspective. The coordination of prosody and manual movements from theoretical, behavioral and neuroanatomical perspectives will be explored. We focus on how gesture landmarks coordinate with prosodic prominence from infants to school-aged children, and we compare these results with adult patterns. The reviewed literature shows that gesture movements, prosody, and speech abilities in general, develop in a parallel and dynamic way, the emergence of a specific ability in one modality entraining the emergence of a parallel ability in another modality. Lastly, implications of the coordination of prosody and gesture for children with communication disorders will be explored.

Article outline
  • Introduction
  • Theoretical underpinnings
  • What does it mean to be temporally coordinated?
  • Developmental sequence of gestures
  • Temporal coordination of prosody and gesture in development
    • Vocal-motor entrainment in early infancy
    • Prosodic-gestural coordination in infancy and toddlerhood
    • The preschool years and beyond
  • Implications for children with speech sound disorders
  • Conclusions
  • Acknowledgements
  • Notes
  • References
Published online: 24 May 2018
DOI logo
https://doi.org/10.1075/tilar.23.06rus
References
Acredolo, L., & Goodwyn, S.
(1988) Symbolic gesturing in normal infants. Child Development, 59, 450–466. DOI logoGoogle Scholar
Albert, M. L., Sparks, R. W., & Helm, N. A.
(1973) Melodic intonation therapy for aphasia. Archives of Neurology, 29(2), 130–131. DOI logoGoogle Scholar
Barrett, K., & Campos, J. J.
(1987) Perspectives on emotional development II: A functionalist approach to emotions. In Osofsky J. D. (Ed.), Handbook of infant development (pp.555–578). Oxford: John Wiley & Sons.Google Scholar
Bates, E., Camaioni, L., & Volterra, V.
(1975) The acquisition of performatives prior to speech. Merrill-Palmer Quarterly of Behavior and Development, 21(3), 205–226.Google Scholar
Bates, E., & Dick, F.
(2002) Language, gesture, and the developing brain. Developmental Psychobiology, 40, 293–310. DOI logoGoogle Scholar
Bernstein, D.
(1989) Language development: The school age years. Language and communication disorders in children. Columbus, OH: Merrill/MacMillon.Google Scholar
Birdwhistell, R. L.
(1952) Introduction to kinesics. An annotation system for analysis of body motion and gesture. Louisville, KY: University of Louisville Press.Google Scholar
Butcher, C., & Goldin-Meadow, S.
(2000) Gesture and the transition from one- to two-word speech: When hand and mouth come together. In McNeill D. (Ed.), Language and gesture pp.235–257). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Capone, N. C., & McGregor, K. K.
(2004) Gesture development: A review for clinical and research practices. Journal of Speech, Language, and Hearing Research, 47(1), 173–186.DOI logoGoogle Scholar
(2005) The effect of semantic representation on toddlers’ word retrieval. Journal of Speech, Language, and Hearing Research, 48, 1468–1480. DOI logoGoogle Scholar
Cole, P. M., & Moore, G. A.
(2015) About face! Infant facial expression of emotion. Emotion Review, 7(2), 116–120. DOI logoGoogle Scholar
Colletta, J. M., Guidetti, M., Capirci, O., Cristilli, C., Demir, O. E., Kunene-Nicolas, R. N., & Levine, S.
(2015) Effects of age and language on co-speech gesture production: An investigation of French, American, and Italian children’s narratives. Journal of Child Language, 42(1), 122–145. DOI logoGoogle Scholar
Connaghan, K. P., & Patel, R.
(2013) Impact of prosodic strategies on vowel intelligibility in childhood motor speech impairment. Journal of Medical Speech-Language Pathology, 20(4), 133–139.Google Scholar
Cook, S. W., Duffy, R. G., & Fenn, K. M.
(2013) Consolidation and transfer of learning after observing hand gesture. Child Development, 84(6), 1863–1871. DOI logoGoogle Scholar
Corriveau, K. H., & Goswami, U.
(2009) Rhythmic motor entrainment in children with speech and language impairments: Tapping to the beat. Cortex, 45(1), 119–130. DOI logoGoogle Scholar
Crais, E. R., Watson, L. R., & Baranek, G. T.
(2009) Use of gesture development in profiling children’s prelinguistic communication skills. American Journal of Speech-Language Pathology, 18, 95–108. DOI logoGoogle Scholar
De Marchena, A., & Eigsti, I. M.
(2010) Conversational gestures in autism spectrum disorders: Asynchrony but not decreased frequency. Autism Research, 3(6), 311–322. DOI logoGoogle Scholar
De Ruiter, J. P. (1998) Gesture and speech production. PhD dissertation. Katholieke Universiteit, Nijmegen.Google Scholar
De Ruiter, J. P.
(2000) The production of gesture and speech. In D. McNeill (Ed.), Language and gesture (pp.284–311). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
DeThorne, L. S., Johnson, C. J., Walder, L., & Mahurin-Smith, J.
(2009) When “Simon Says” doesn’t work: Alternatives to imitation for facilitating early speech development. American Journal of Speech-Language Pathology, 18(2), 133–145. DOI logoGoogle Scholar
Dittmann, A. T., & Llewellyn, L. G.
(1969) Body movement and speech rhythm in social conversation. Journal of Personality and Social Psychology, 11(2), 98–106. DOI logoGoogle Scholar
Ellawadi, A. B., & Weismer, S. E.
(2014) Assessing gestures in young children with autism spectrum disorder. Journal of Speech, Language, and Hearing Research, 57(2), 524–531. DOI logoGoogle Scholar
Ejiri, K., & Masataka, N.
(2001) Co-occurrence of preverbal vocal behavior and motor action in early infancy. Developmental Science, 4(1), 40–48. DOI logoGoogle Scholar
Esteve-Gibert, N., Borràs-Comes, J., Asor, E., Swerts, M., & Prieto, P.
(2017) The timing of head movements: the role of prosodic heads and edges. Journal of the Acoustical Society of America, 141(6), 4727–4739.DOI logoGoogle Scholar
Esteve-Gibert, N., & Prieto, P.
(2013) Prosodic structure shapes the temporal realization of intonation and manual gesture movements. Journal of Speech, Language, and Hearing Research, 56(3), 850–865. DOI logoGoogle Scholar
(2014) Infants temporally coordinate gesture-speech combinations before they produce their first words. Speech Communication, 57, 301–316. DOI logoGoogle Scholar
Esteve-Gibert, N., Prieto, P., & Pons, F.
(2015) Nine-month-old infants are sensitive to the temporal alignment of prosodic and gesture prominences. Infant Behavior and Development, 38, 126–129. DOI logoGoogle Scholar
Evans, J. L., Alibali, M. W., & McNeil, N. M.
(2001) Divergence of verbal expression and embodied knowledge: Evidence from speech and gesture in children with specific language impairment. Language and Cognitive processes, 16(2–3), 309–331. DOI logoGoogle Scholar
Fujii, S., & Wan, C. Y.
(2014) The role of rhythm in speech and language rehabilitation: The SEP hypothesis. Frontiers in Human Neuroscience, 8, 1–15. DOI logoGoogle Scholar
Gentilucci, M., & Dalla Volta, R.
(2007) The motor system and the relationships between speech and gesture. Gesture, 7(2), 159–177. DOI logoGoogle Scholar
Gentilucci, M., Santunione, P., Roy, A. C., & Stefanini, S.
(2004) Execution and observation of bringing a fruit to the mouth affect syllable pronunciation. European Journal of Neuroscience, 19(1), 190–202. DOI logoGoogle Scholar
Goodwyn, S. W., Acredolo, L. P., & Brown, C. A.
(2000) Impact of symbolic gesturing on early language development. Journal of Nonverbal Behavior, 24(2), 81–103. DOI logoGoogle Scholar
Green, J. R., Moore, C. A., Higashikawa, M., & Steeve, R. W.
(2000) The physiologic development of speech motor control: Lip and jaw coordination. Journal of Speech, Language and Hearing Research, 43(1), 239–255. DOI logoGoogle Scholar
Green, J. R., Moore, C. A., & Reilly, K. J.
(2002) The sequential development of jaw and lip control for speech. Journal of Speech, Language, and Hearing Research, 45(1), 66–79. DOI logoGoogle Scholar
Guellaï, B., Langus, A., & Nespor, M.
(2014) Prosody in the hands of the speaker. Frontiers in Psychology, 5, 00700.Google Scholar
Hulit, L. M., Fahey, K. R., & Howard, M. R.
(2015) Born to talk: An introduction to speech and language development. Boston, MA: Pearson.Google Scholar
Igualada, A., Bosch, L., & Prieto, P.
(2015) Language development at 18 months is related to multimodal communicative strategies at 12 months. Infant Behavior and Development, 39, 42–52. DOI logoGoogle Scholar
Igualada, A., Esteve-Gibert, N., & Prieto, P.
(2017) Beat gestures improve word recall in 3- to 5-year old children. Journal of Experimental Child Psychology, 156, 99–112.DOI logoGoogle Scholar
Igualada, A., Wray, C., Prieto, P., & Norbury, C
(2016) Synchronous gesture-prosody alignments in narrations by children with specific language impairment (SLI). Paper presented at the VIIIth International Conference of Language Acquisition (AEAL), Palma, Spain.Google Scholar
Ito, J .P
(2012) Focal impulses and expressive performance. In M. Aramaki, M. Barthet, R. Kronland-Martinet, & S. Ystad (Eds.), From sounds to music and emotions (pp.480–489). Berlin: Springer.Google Scholar
Iverson, J. M., & Braddock, B. A.
(2011) Gesture and motor skill in relation to language in children with language impairment. Journal of Speech, Language, and Hearing Research, 54(1), 72–86. DOI logoGoogle Scholar
Iverson, J. M., Capirci, O., & Caselli, M. C.
(1994) From communication to language in two modalities. Cognitive Development, 9(1), 23–43. DOI logoGoogle Scholar
Iverson, J. M., & Fagan, M. K.
(2004) Infant vocal-motor coordination: Precursor to the gesture-speech system? Child Development, 75(4), 1053–1066. DOI logoGoogle Scholar
Iverson, J. M., & Goldin-Meadow, S.
(2005) Gesture paves the way for language development. Psychological Science, 16(5), 367–371. DOI logoGoogle Scholar
Iverson, J. M., & Thelen, E.
(1999) Hand, mouth and brain. The dynamic emergence of speech and gesture. Journal of Consciousness Studies, 6, 19–40.Google Scholar
Kelso, J. S., Tuller, B., & Harris, K. S.
(1983) A “dynamic pattern” perspective on the control and coordination of movement. In P. F. MacNeilage (Ed.), The production of speech (pp.137–173). New York, NY: Springer. DOI logoGoogle Scholar
Kendon, A.
(1980) Gesticulation and speech: Two aspects of the process of utterance. In M. R. Key (Ed.), The relationship of verbal and nonverbal communication (pp.207–227). The Hague: Mouton.Google Scholar
Kent, R. D., & Bauer, H. R.
(1985) Vocalization of one-year-olds. Journal of Child Language, 12, 491–526. DOI logoGoogle Scholar
Kim, J., Cvejic, E., & Davis, C.
(2014) Tracking eyebrows and head gestures associated with spoken prosody. Speech Communication, 57, 317–330. DOI logoGoogle Scholar
Krahmer, E., & Swerts, M.
(2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414. DOI logoGoogle Scholar
Krauss, R. M., Chen, Y., & Gottesman, R. F.
(2000) Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp.261–283). New York, NY: Cambridge University Press. DOI logoGoogle Scholar
Krivokapić, J., Tiede, M., Tyrone, M., & Goldenberg, D.
(2016) Speech and manual gesture coordination in a pointing task. Paper presented at the meeting Framing speech: Celebrating 40 years of inquiry with Stefanie Shattuck-Hufnagel, Boston, USA.DOI logoGoogle Scholar
Large, E. W., & Jones, M. R.
(1999) The dynamics of attending: How people track time-varying events. Psychological Review, 106(1), 119–159. DOI logoGoogle Scholar
Leonard, T., & Cummins, F.
(2011) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. DOI logoGoogle Scholar
Mainela-Arnold, E., Evans, J. L., & Alibali, M. W.
(2006) Understanding conservation delays in children with Specific Language Impairment: Task representations revealed in speech and gesture. Journal of Speech, Language, and Hearing Research, 49, 1267–1279. DOI logoGoogle Scholar
Mathew, M., Yuen, I., & Demuth, K.
(2017) Talking to the beat: Six-year-olds’ use of stroke-defined non-referential gestures. First Language, https://doi.org/10.1177/0142723717734949Google Scholar
Mathew, M., & Manjula, R.
(2015) Patterns in the emergence of hand actions in typically developing infants. Journal of Communication Disorders, Deaf Studies & Hearing, Aids, 3, 140.Google Scholar
Mathew, M., Yuen, I., Shattuck-Hufnagel, S., Ren, A., & Demuth, K.
(2014) The development of prosodic gestures during parent-child discourse interactions. Paper presented at the 14th Conference on Laboratory Phonology, Tokyo, Japan.Google Scholar
McCafferty, S .G
(2006) Gesture and the materialization of second language prosody. IRAL-International Review of Applied Linguistics in Language Teaching, 44(2), 197–209. DOI logoGoogle Scholar
McNeill, D.
(1992) Hand and mind: What gestures reveal about thought. Chicago, IL: The University of Chicago Press.Google Scholar
Merker, B., Madison, G., & Eckerdal, P.
(2009) On the role and origin of isochrony in human rhythmic entrainment. Cortex, 45, 1–17. DOI logoGoogle Scholar
Murillo, E., & Belinchón, M.
(2012) Gestural-vocal coordination: Longitudinal changes and predictive value on early lexical development. Gesture, 12(1), 16–39. DOI logoGoogle Scholar
Murillo, E., & Capilla, A.
(2016) Properties of vocalization-and gesture-combinations in the transition to first words. Journal of Child Language, 43(4), 890–913.DOI logoGoogle Scholar
Nicoladis, E., Mayberry, R. I., & Genesee, F.
(1999) Gesture and early bilingual development. Developmental Psychology, 35(2), 514–526. DOI logoGoogle Scholar
Oller, D. K., Wieman, L., Doyle, W., & Ross, C.
(1976) Infant babbling and speech. Journal of Child Language, 3, 1–11. DOI logoGoogle Scholar
Owens, R. E.
(2016) Language development: An introduction. Boston, MA: Pearson.Google Scholar
Özçalışkan, S., Gentner, D., & Goldin-Meadow, S.
(2013) Do iconic gestures pave the way for children’s early verbs? Applied Psycholinguistics, 35(6), 1143–1162. DOI logoGoogle Scholar
Özçalışkan, S., & Goldin-Meadow, S.
(2005) Gesture is at the cutting edge of early language development. Cognition, 96, B101–B113. DOI logoGoogle Scholar
(2011) Is there an iconic gesture spurt at 26 months? In S. Gale, & I. Mika (Eds.), Integrating gestures: The interdisciplinary nature of gesture, (pp.163–174). Amsterdam: John Benjamins.DOI logoGoogle Scholar
Patel, R.
(2004) The acoustics of contrastive prosody in adults with cerebral palsy. Journal of Medical Speech-Language Pathology, 12(4), 189–193.Google Scholar
Patel, R., & Brayton, J. T.
(2009) Identifying prosodic contrasts in utterances produced by 4-, 7-, and 11-year-old children. Journal of Speech Language and Hearing Research, 52, 790–801. DOI logoGoogle Scholar
Patel, R., & Grigos, M. I.
(2006) Acoustic characterization of the question-statement contrast in 4, 7, and 11 year-old children. Speech Communication, 48, 1308–1318. DOI logoGoogle Scholar
Port, R.
(2003) Meter and speech. Journal of Phonetics, 31, 599–611. DOI logoGoogle Scholar
Renard, R
(1979) Introduction à la méthode verbo-tonale de correction phonétique. Bruxelles: Didier, Mons: CIPA.Google Scholar
Rochet-Capellan, A., Laboissierre, R., Galvan, A., & Schwartz, J.
(2008) The speech focus position effect on jaw-finger coordination in a pointing task. Journal of Speech, Language, and Hearing Research, 51, 1507–1521. DOI logoGoogle Scholar
Rusiewicz, H. L.
(2011, September). Synchronization of speech and gesture: A dynamic systems perspective. Paper presented at the 2nd Gesture and Speech in Interaction (GESPIN), Bielefeld, Germany.Google Scholar
Rusiewicz, H. L. & Rivera, J. L.
(2017) The effect of hand gesture cues within the treatment of /r/ for a college-aged adult with persisting childhood apraxia of speech. American Journal of Speech-Language Pathology, 26(4), 1236–1243.DOI logoGoogle Scholar
Rusiewicz, H. L., Shaiman, S., Iverson, J. M., & Szuminsky, N.
(2013) Effects of prosody and position on the timing of deictic gestures. Journal of Speech, Language, and Hearing Research, 56(2), 458–470. DOI logoGoogle Scholar
(2014) Effects of perturbation and prosody on the coordination of speech and gesture. Speech Communication, 57, 283–300. DOI logoGoogle Scholar
Sauer, E., Levine, S. C., & Goldin-Meadow, S.
(2010) Early gesture predicts language delay in children with pre- or perinatal brain lesions. Child Development, 81(2), 528–539. DOI logoGoogle Scholar
Smith, A., & Zelaznik, H. N.
(2004) Development of functional synergies for speech motor coordination in childhood and adolescence. Developmental Psychobiology, 45(1), 22–33. DOI logoGoogle Scholar
Steve, R.
(2010) Babbling and chewing: Jaw kinematics from 8 to 22 months. Journal of Phonetics, 38(3), 445–458. DOI logoGoogle Scholar
Tomasello, M., Carpenter, M., & Liszkowski, U.
(2007) A new look at infant pointing. Child Development, 78(3), 705–722. DOI logoGoogle Scholar
Tuite, K.
(1993) The production of gesture. Semiotica, 93, 8–105. DOI logoGoogle Scholar
Volterra, V., Caselli, M. C., Capirci, O., & Pizzuto, E.
(2005) Gesture and the emergence and development of language. In M. Tomasello, & D. Slobin (Eds.), Beyond nature-nurture. Essays in honor of Elizabeth Bates (pp.3–40). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Yang, J., Andric, M., & Mathew, M. M.
(2015) The neural basis of hand gesture comprehension: A meta-analysis of functional magnetic resonance imaging studies. Neuroscience & Biobehavioral Reviews, 57, 88–104. DOI logoGoogle Scholar
Cited by

Cited by 2 other publications

Esteve-Gibert, Núria & Bahia Guellaï
2018. Prosody in the Auditory and Visual Domains: A Developmental Perspective. Frontiers in Psychology 9 DOI logo
Pouw, Wim & James A. Dixon
2019. Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback. Cognitive Science 43:3 DOI logo

This list is based on CrossRef data as of 22 april 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.