Chapter published in:
The Development of Prosody in First Language Acquisition
Edited by Pilar Prieto and Núria Esteve-Gibert
[Trends in Language Acquisition Research 23] 2018
► pp. 103–124

Set in time

Temporal coordination of prosody and gesture in the development of spoken language production

| Duquesne University
| Aix Marseille Université, CNRS, LPL UMR 7309 | Universitat de Barcelona
The purpose of this chapter is to discuss the relationship between prosody, gesture, and spoken language production from a developmental perspective. The coordination of prosody and manual movements from theoretical, behavioral and neuroanatomical perspectives will be explored. We focus on how gesture landmarks coordinate with prosodic prominence from infants to school-aged children, and we compare these results with adult patterns. The reviewed literature shows that gesture movements, prosody, and speech abilities in general, develop in a parallel and dynamic way, the emergence of a specific ability in one modality entraining the emergence of a parallel ability in another modality. Lastly, implications of the coordination of prosody and gesture for children with communication disorders will be explored.
Published online: 24 May 2018
https://doi.org/10.1075/tilar.23.06rus
References

References

Acredolo, L., & Goodwyn, S.
(1988) Symbolic gesturing in normal infants. Child Development, 59, 450–466. CrossrefGoogle Scholar
Albert, M. L., Sparks, R. W., & Helm, N. A.
(1973) Melodic intonation therapy for aphasia. Archives of Neurology, 29(2), 130–131. CrossrefGoogle Scholar
Barrett, K., & Campos, J. J.
(1987) Perspectives on emotional development II: A functionalist approach to emotions. In Osofsky J. D. (Ed.), Handbook of infant development (pp.555–578). Oxford: John Wiley & Sons.Google Scholar
Bates, E., Camaioni, L., & Volterra, V.
(1975) The acquisition of performatives prior to speech. Merrill-Palmer Quarterly of Behavior and Development, 21(3), 205–226.Google Scholar
Bates, E., & Dick, F.
(2002) Language, gesture, and the developing brain. Developmental Psychobiology, 40, 293–310. CrossrefGoogle Scholar
Bernstein, D.
(1989) Language development: The school age years. Language and communication disorders in children. Columbus, OH: Merrill/MacMillon.Google Scholar
Birdwhistell, R. L.
(1952) Introduction to kinesics. An annotation system for analysis of body motion and gesture. Louisville, KY: University of Louisville Press.Google Scholar
Butcher, C., & Goldin-Meadow, S.
(2000) Gesture and the transition from one- to two-word speech: When hand and mouth come together. In McNeill D. (Ed.), Language and gesture pp.235–257). Cambridge: Cambridge University Press. CrossrefGoogle Scholar
Capone, N. C., & McGregor, K. K.
(2004) Gesture development: A review for clinical and research practices. Journal of Speech, Language, and Hearing Research, 47(1), 173–186.CrossrefGoogle Scholar
(2005) The effect of semantic representation on toddlers’ word retrieval. Journal of Speech, Language, and Hearing Research, 48, 1468–1480. CrossrefGoogle Scholar
Cole, P. M., & Moore, G. A.
(2015) About face! Infant facial expression of emotion. Emotion Review, 7(2), 116–120. CrossrefGoogle Scholar
Colletta, J. M., Guidetti, M., Capirci, O., Cristilli, C., Demir, O. E., Kunene-Nicolas, R. N., & Levine, S.
(2015) Effects of age and language on co-speech gesture production: An investigation of French, American, and Italian children’s narratives. Journal of Child Language, 42(1), 122–145. CrossrefGoogle Scholar
Connaghan, K. P., & Patel, R.
(2013) Impact of prosodic strategies on vowel intelligibility in childhood motor speech impairment. Journal of Medical Speech-Language Pathology, 20(4), 133–139.Google Scholar
Cook, S. W., Duffy, R. G., & Fenn, K. M.
(2013) Consolidation and transfer of learning after observing hand gesture. Child Development, 84(6), 1863–1871. CrossrefGoogle Scholar
Corriveau, K. H., & Goswami, U.
(2009) Rhythmic motor entrainment in children with speech and language impairments: Tapping to the beat. Cortex, 45(1), 119–130. CrossrefGoogle Scholar
Crais, E. R., Watson, L. R., & Baranek, G. T.
(2009) Use of gesture development in profiling children’s prelinguistic communication skills. American Journal of Speech-Language Pathology, 18, 95–108. CrossrefGoogle Scholar
De Marchena, A., & Eigsti, I. M.
(2010) Conversational gestures in autism spectrum disorders: Asynchrony but not decreased frequency. Autism Research, 3(6), 311–322. CrossrefGoogle Scholar
De Ruiter, J. P. (1998) Gesture and speech production. PhD dissertation. Katholieke Universiteit, Nijmegen.Google Scholar
De Ruiter, J. P.
(2000) The production of gesture and speech. In D. McNeill (Ed.), Language and gesture (pp.284–311). Cambridge: Cambridge University Press. CrossrefGoogle Scholar
DeThorne, L. S., Johnson, C. J., Walder, L., & Mahurin-Smith, J.
(2009) When “Simon Says” doesn’t work: Alternatives to imitation for facilitating early speech development. American Journal of Speech-Language Pathology, 18(2), 133–145. CrossrefGoogle Scholar
Dittmann, A. T., & Llewellyn, L. G.
(1969) Body movement and speech rhythm in social conversation. Journal of Personality and Social Psychology, 11(2), 98–106. CrossrefGoogle Scholar
Ellawadi, A. B., & Weismer, S. E.
(2014) Assessing gestures in young children with autism spectrum disorder. Journal of Speech, Language, and Hearing Research, 57(2), 524–531. CrossrefGoogle Scholar
Ejiri, K., & Masataka, N.
(2001) Co-occurrence of preverbal vocal behavior and motor action in early infancy. Developmental Science, 4(1), 40–48. CrossrefGoogle Scholar
Esteve-Gibert, N., Borràs-Comes, J., Asor, E., Swerts, M., & Prieto, P.
(2017) The timing of head movements: the role of prosodic heads and edges. Journal of the Acoustical Society of America, 141(6), 4727–4739.CrossrefGoogle Scholar
Esteve-Gibert, N., & Prieto, P.
(2013) Prosodic structure shapes the temporal realization of intonation and manual gesture movements. Journal of Speech, Language, and Hearing Research, 56(3), 850–865. CrossrefGoogle Scholar
(2014) Infants temporally coordinate gesture-speech combinations before they produce their first words. Speech Communication, 57, 301–316. CrossrefGoogle Scholar
Esteve-Gibert, N., Prieto, P., & Pons, F.
(2015) Nine-month-old infants are sensitive to the temporal alignment of prosodic and gesture prominences. Infant Behavior and Development, 38, 126–129. CrossrefGoogle Scholar
Evans, J. L., Alibali, M. W., & McNeil, N. M.
(2001) Divergence of verbal expression and embodied knowledge: Evidence from speech and gesture in children with specific language impairment. Language and Cognitive processes, 16(2–3), 309–331. CrossrefGoogle Scholar
Fujii, S., & Wan, C. Y.
(2014) The role of rhythm in speech and language rehabilitation: The SEP hypothesis. Frontiers in Human Neuroscience, 8, 1–15. CrossrefGoogle Scholar
Gentilucci, M., & Dalla Volta, R.
(2007) The motor system and the relationships between speech and gesture. Gesture, 7(2), 159–177. CrossrefGoogle Scholar
Gentilucci, M., Santunione, P., Roy, A. C., & Stefanini, S.
(2004) Execution and observation of bringing a fruit to the mouth affect syllable pronunciation. European Journal of Neuroscience, 19(1), 190–202. CrossrefGoogle Scholar
Goodwyn, S. W., Acredolo, L. P., & Brown, C. A.
(2000) Impact of symbolic gesturing on early language development. Journal of Nonverbal Behavior, 24(2), 81–103. CrossrefGoogle Scholar
Green, J. R., Moore, C. A., Higashikawa, M., & Steeve, R. W.
(2000) The physiologic development of speech motor control: Lip and jaw coordination. Journal of Speech, Language and Hearing Research, 43(1), 239–255. CrossrefGoogle Scholar
Green, J. R., Moore, C. A., & Reilly, K. J.
(2002) The sequential development of jaw and lip control for speech. Journal of Speech, Language, and Hearing Research, 45(1), 66–79. CrossrefGoogle Scholar
Guellaï, B., Langus, A., & Nespor, M.
(2014) Prosody in the hands of the speaker. Frontiers in Psychology, 5, 00700.Google Scholar
Hulit, L. M., Fahey, K. R., & Howard, M. R.
(2015) Born to talk: An introduction to speech and language development. Boston, MA: Pearson.Google Scholar
Igualada, A., Bosch, L., & Prieto, P.
(2015) Language development at 18 months is related to multimodal communicative strategies at 12 months. Infant Behavior and Development, 39, 42–52. CrossrefGoogle Scholar
Igualada, A., Esteve-Gibert, N., & Prieto, P.
(2017) Beat gestures improve word recall in 3- to 5-year old children. Journal of Experimental Child Psychology, 156, 99–112.CrossrefGoogle Scholar
Igualada, A., Wray, C., Prieto, P., & Norbury, C.
(2016) Synchronous gesture-prosody alignments in narrations by children with specific language impairment (SLI). Paper presented at the VIIIth International Conference of Language Acquisition (AEAL), Palma, Spain.Google Scholar
Ito, J .P
(2012) Focal impulses and expressive performance. In M. Aramaki, M. Barthet, R. Kronland-Martinet, & S. Ystad (Eds.), From sounds to music and emotions (pp.480–489). Berlin: Springer.Google Scholar
Iverson, J. M., & Braddock, B. A.
(2011) Gesture and motor skill in relation to language in children with language impairment. Journal of Speech, Language, and Hearing Research, 54(1), 72–86. CrossrefGoogle Scholar
Iverson, J. M., Capirci, O., & Caselli, M. C.
(1994) From communication to language in two modalities. Cognitive Development, 9(1), 23–43. CrossrefGoogle Scholar
Iverson, J. M., & Fagan, M. K.
(2004) Infant vocal-motor coordination: Precursor to the gesture-speech system? Child Development, 75(4), 1053–1066. CrossrefGoogle Scholar
Iverson, J. M., & Goldin-Meadow, S.
(2005) Gesture paves the way for language development. Psychological Science, 16(5), 367–371. CrossrefGoogle Scholar
Iverson, J. M., & Thelen, E.
(1999) Hand, mouth and brain. The dynamic emergence of speech and gesture. Journal of Consciousness Studies, 6, 19–40.Google Scholar
Kelso, J. S., Tuller, B., & Harris, K. S.
(1983) A “dynamic pattern” perspective on the control and coordination of movement. In P. F. MacNeilage (Ed.), The production of speech (pp.137–173). New York, NY: Springer. CrossrefGoogle Scholar
Kendon, A.
(1980) Gesticulation and speech: Two aspects of the process of utterance. In M. R. Key (Ed.), The relationship of verbal and nonverbal communication (pp.207–227). The Hague: Mouton.Google Scholar
Kent, R. D., & Bauer, H. R.
(1985) Vocalization of one-year-olds. Journal of Child Language, 12, 491–526. CrossrefGoogle Scholar
Kim, J., Cvejic, E., & Davis, C.
(2014) Tracking eyebrows and head gestures associated with spoken prosody. Speech Communication, 57, 317–330. CrossrefGoogle Scholar
Krahmer, E., & Swerts, M.
(2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414. CrossrefGoogle Scholar
Krauss, R. M., Chen, Y., & Gottesman, R. F.
(2000) Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp.261–283). New York, NY: Cambridge University Press. CrossrefGoogle Scholar
Krivokapić, J., Tiede, M., Tyrone, M., & Goldenberg, D.
(2016) Speech and manual gesture coordination in a pointing task. Paper presented at the meeting Framing speech: Celebrating 40 years of inquiry with Stefanie Shattuck-Hufnagel, Boston, USA. CrossrefGoogle Scholar
Large, E. W., & Jones, M. R.
(1999) The dynamics of attending: How people track time-varying events. Psychological Review, 106(1), 119–159. CrossrefGoogle Scholar
Leonard, T., & Cummins, F.
(2011) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. CrossrefGoogle Scholar
Mainela-Arnold, E., Evans, J. L., & Alibali, M. W.
(2006) Understanding conservation delays in children with Specific Language Impairment: Task representations revealed in speech and gesture. Journal of Speech, Language, and Hearing Research, 49, 1267–1279. CrossrefGoogle Scholar
Mathew, M., Yuen, I., & Demuth, K.
(2017) Talking to the beat: Six-year-olds’ use of stroke-defined non-referential gestures. First Language, https://doi.org/10.1177/0142723717734949Google Scholar
Mathew, M., & Manjula, R.
(2015) Patterns in the emergence of hand actions in typically developing infants. Journal of Communication Disorders, Deaf Studies & Hearing, Aids, 3, 140.Google Scholar
Mathew, M., Yuen, I., Shattuck-Hufnagel, S., Ren, A., & Demuth, K.
(2014) The development of prosodic gestures during parent-child discourse interactions. Paper presented at the 14th Conference on Laboratory Phonology, Tokyo, Japan.Google Scholar
McCafferty, S .G
(2006) Gesture and the materialization of second language prosody. IRAL-International Review of Applied Linguistics in Language Teaching, 44(2), 197–209. CrossrefGoogle Scholar
McNeill, D.
(1992) Hand and mind: What gestures reveal about thought. Chicago, IL: The University of Chicago Press.Google Scholar
Merker, B., Madison, G., & Eckerdal, P.
(2009) On the role and origin of isochrony in human rhythmic entrainment. Cortex, 45, 1–17. CrossrefGoogle Scholar
Murillo, E., & Belinchón, M.
(2012) Gestural-vocal coordination: Longitudinal changes and predictive value on early lexical development. Gesture, 12(1), 16–39. CrossrefGoogle Scholar
Murillo, E., & Capilla, A.
(2016) Properties of vocalization-and gesture-combinations in the transition to first words. Journal of Child Language, 43(4), 890–913.CrossrefGoogle Scholar
Nicoladis, E., Mayberry, R. I., & Genesee, F.
(1999) Gesture and early bilingual development. Developmental Psychology, 35(2), 514–526. CrossrefGoogle Scholar
Oller, D. K., Wieman, L., Doyle, W., & Ross, C.
(1976) Infant babbling and speech. Journal of Child Language, 3, 1–11. CrossrefGoogle Scholar
Owens, R. E.
(2016) Language development: An introduction. Boston, MA: Pearson.Google Scholar
Özçalışkan, S., Gentner, D., & Goldin-Meadow, S.
(2013) Do iconic gestures pave the way for children’s early verbs? Applied Psycholinguistics, 35(6), 1143–1162. CrossrefGoogle Scholar
Özçalışkan, S., & Goldin-Meadow, S.
(2005) Gesture is at the cutting edge of early language development. Cognition, 96, B101–B113. CrossrefGoogle Scholar
(2011) Is there an iconic gesture spurt at 26 months? In S. Gale, & I. Mika (Eds.), Integrating gestures: The interdisciplinary nature of gesture, (pp.163–174). Amsterdam: John Benjamins.CrossrefGoogle Scholar
Patel, R.
(2004) The acoustics of contrastive prosody in adults with cerebral palsy. Journal of Medical Speech-Language Pathology, 12(4), 189–193.Google Scholar
Patel, R., & Brayton, J. T.
(2009) Identifying prosodic contrasts in utterances produced by 4-, 7-, and 11-year-old children. Journal of Speech Language and Hearing Research, 52, 790–801. CrossrefGoogle Scholar
Patel, R., & Grigos, M. I.
(2006) Acoustic characterization of the question-statement contrast in 4, 7, and 11 year-old children. Speech Communication, 48, 1308–1318. CrossrefGoogle Scholar
Port, R.
(2003) Meter and speech. Journal of Phonetics, 31, 599–611. CrossrefGoogle Scholar
Renard, R.
(1979) Introduction à la méthode verbo-tonale de correction phonétique. Bruxelles: Didier, Mons: CIPA.Google Scholar
Rochet-Capellan, A., Laboissierre, R., Galvan, A., & Schwartz, J.
(2008) The speech focus position effect on jaw-finger coordination in a pointing task. Journal of Speech, Language, and Hearing Research, 51, 1507–1521. CrossrefGoogle Scholar
Rusiewicz, H. L.
(2011, September). Synchronization of speech and gesture: A dynamic systems perspective. Paper presented at the 2nd Gesture and Speech in Interaction (GESPIN), Bielefeld, Germany.Google Scholar
Rusiewicz, H. L. & Rivera, J. L.
(2017) The effect of hand gesture cues within the treatment of /r/ for a college-aged adult with persisting childhood apraxia of speech. American Journal of Speech-Language Pathology, 26(4), 1236–1243.CrossrefGoogle Scholar
Rusiewicz, H. L., Shaiman, S., Iverson, J. M., & Szuminsky, N.
(2013) Effects of prosody and position on the timing of deictic gestures. Journal of Speech, Language, and Hearing Research, 56(2), 458–470. CrossrefGoogle Scholar
(2014) Effects of perturbation and prosody on the coordination of speech and gesture. Speech Communication, 57, 283–300. CrossrefGoogle Scholar
Sauer, E., Levine, S. C., & Goldin-Meadow, S.
(2010) Early gesture predicts language delay in children with pre- or perinatal brain lesions. Child Development, 81(2), 528–539. CrossrefGoogle Scholar
Smith, A., & Zelaznik, H. N.
(2004) Development of functional synergies for speech motor coordination in childhood and adolescence. Developmental Psychobiology, 45(1), 22–33. CrossrefGoogle Scholar
Steve, R.
(2010) Babbling and chewing: Jaw kinematics from 8 to 22 months. Journal of Phonetics, 38(3), 445–458. CrossrefGoogle Scholar
Tellier, M.
(2008) The effect of gestures on second language memorisation by young children. Gesture, 8, 219–235. CrossrefGoogle Scholar
Tomasello, M., Carpenter, M., & Liszkowski, U.
(2007) A new look at infant pointing. Child Development, 78(3), 705–722. CrossrefGoogle Scholar
Tuite, K.
(1993) The production of gesture. Semiotica, 93, 8–105. CrossrefGoogle Scholar
Volterra, V., Caselli, M. C., Capirci, O., & Pizzuto, E.
(2005) Gesture and the emergence and development of language. In M. Tomasello, & D. Slobin (Eds.), Beyond nature-nurture. Essays in honor of Elizabeth Bates (pp.3–40). Mahwah, NJ: Lawrence Erlbaum Associates.Google Scholar
Yang, J., Andric, M., & Mathew, M. M.
(2015) The neural basis of hand gesture comprehension: A meta-analysis of functional magnetic resonance imaging studies. Neuroscience & Biobehavioral Reviews, 57, 88–104. CrossrefGoogle Scholar
Cited by

Cited by 3 other publications

Esteve-Gibert, Núria & Bahia Guellaï
2018. Prosody in the Auditory and Visual Domains: A Developmental Perspective. Frontiers in Psychology 9 Crossref logo
Pouw, Wim & James A. Dixon
2019. Entrainment and Modulation of Gesture–Speech Synchrony Under Delayed Auditory Feedback. Cognitive Science 43:3 Crossref logo
Pouw, Wim, Steven J. Harrison, Núria Esteve-Gibert & James A. Dixon
2020. Energy flows in gesture-speech physics: The respiratory-vocal system and its coupling with hand gestures. The Journal of the Acoustical Society of America 148:3 ► pp. 1231 ff. Crossref logo

This list is based on CrossRef data as of 12 july 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.