Chapter published in:
The Development of Prosody in First Language AcquisitionEdited by Pilar Prieto and Núria Esteve-Gibert
[Trends in Language Acquisition Research 23] 2018
► pp. 103–124
Chapter 6. Set in time
Temporal coordination of prosody and gesture in the development of spoken language production
Heather Leavy Rusiewicz
| Duquesne University
Núria Esteve-Gibert | Aix Marseille Université, CNRS, LPL UMR 7309/Universitat de Barcelona
The purpose of this chapter is to discuss the relationship between prosody, gesture, and spoken language production from a developmental perspective. The coordination of prosody and manual movements from theoretical, behavioral and neuroanatomical perspectives will be explored. We focus on how gesture landmarks coordinate with prosodic prominence from infants to school-aged children, and we compare these results with adult patterns. The reviewed literature shows that gesture movements, prosody, and speech abilities in general, develop in a parallel and dynamic way, the emergence of a specific ability in one modality entraining the emergence of a parallel ability in another modality. Lastly, implications of the coordination of prosody and gesture for children with communication disorders will be explored.
Published online: 24 May 2018
https://doi.org/10.1075/tilar.23.06rus
https://doi.org/10.1075/tilar.23.06rus
References
References
Acredolo, L., & Goodwyn, S.
(1988) Symbolic gesturing in normal
infants. Child Development, 59, 450–466. 
Albert, M. L., Sparks, R. W., & Helm, N. A.
(1973) Melodic intonation therapy for
aphasia. Archives of Neurology, 29(2), 130–131.
Barrett, K., & Campos, J. J.
(1987) Perspectives on emotional development II: A
functionalist approach to emotions. In Osofsky J. D. (Ed.), Handbook of infant development (pp.555–578). Oxford: John Wiley & Sons.
Bates, E., Camaioni, L., & Volterra, V.
(1975) The acquisition of performatives prior to
speech. Merrill-Palmer Quarterly of Behavior and
Development, 21(3), 205–226.
Bates, E., & Dick, F.
(2002) Language, gesture, and the developing
brain. Developmental Psychobiology, 40, 293–310.
Bernstein, D.
(1989) Language development: The school age years. Language and
communication disorders in children. Columbus, OH: Merrill/MacMillon.
Birdwhistell, R. L.
(1952) Introduction to kinesics. An annotation system for
analysis of body motion and gesture. Louisville, KY: University of Louisville Press.
Butcher, C., & Goldin-Meadow, S.
(2000) Gesture and the transition from one- to two-word
speech: When hand and mouth come together. In McNeill D. (Ed.), Language and gesture pp.235–257). Cambridge: Cambridge University Press.
Capone, N. C., & McGregor, K. K.
(2004) Gesture development: A review for clinical and
research practices. Journal of Speech, Language, and Hearing
Research, 47(1), 173–186.
(2005) The effect of semantic representation on
toddlers’ word retrieval. Journal of Speech, Language, and Hearing
Research, 48, 1468–1480.
Cole, P. M., & Moore, G. A.
(2015) About face! Infant facial expression of
emotion. Emotion Review, 7(2), 116–120.
Colletta, J. M., Guidetti, M., Capirci, O., Cristilli, C., Demir, O. E., Kunene-Nicolas, R. N., & Levine, S.
(2015) Effects of age and language on co-speech gesture
production: An investigation of French, American, and
Italian children’s narratives. Journal of Child Language, 42(1), 122–145.
Connaghan, K. P., & Patel, R.
(2013) Impact of prosodic strategies on vowel
intelligibility in childhood motor speech
impairment. Journal of Medical Speech-Language Pathology, 20(4), 133–139.
Cook, S. W., Duffy, R. G., & Fenn, K. M.
(2013) Consolidation and transfer of learning after
observing hand gesture. Child Development, 84(6), 1863–1871.
Corriveau, K. H., & Goswami, U.
(2009) Rhythmic motor entrainment in children with
speech and language impairments: Tapping to the
beat. Cortex, 45(1), 119–130.
Crais, E. R., Watson, L. R., & Baranek, G. T.
(2009) Use of gesture development in profiling
children’s prelinguistic communication
skills. American Journal of Speech-Language Pathology, 18, 95–108.
De Marchena, A., & Eigsti, I. M.
(2010) Conversational gestures in autism spectrum
disorders: Asynchrony but not decreased
frequency. Autism Research, 3(6), 311–322.
De Ruiter, J. P. (1998) Gesture and speech production. PhD dissertation. Katholieke Universiteit, Nijmegen.
De Ruiter, J. P.
(2000) The production of gesture and
speech. In D. McNeill (Ed.), Language and gesture (pp.284–311). Cambridge: Cambridge University Press.
DeThorne, L. S., Johnson, C. J., Walder, L., & Mahurin-Smith, J.
(2009) When “Simon Says” doesn’t work: Alternatives to
imitation for facilitating early speech
development. American Journal of Speech-Language Pathology, 18(2), 133–145.
Dittmann, A. T., & Llewellyn, L. G.
(1969) Body movement and speech rhythm in social
conversation. Journal of Personality and Social Psychology, 11(2), 98–106.
Ellawadi, A. B., & Weismer, S. E.
(2014) Assessing gestures in young children with autism
spectrum disorder. Journal of Speech, Language, and Hearing
Research, 57(2), 524–531.
Ejiri, K., & Masataka, N.
(2001) Co-occurrence of preverbal vocal behavior and
motor action in early infancy. Developmental Science, 4(1), 40–48.
Esteve-Gibert, N., Borràs-Comes, J., Asor, E., Swerts, M., & Prieto, P.
(2017) The timing of head movements: the role of
prosodic heads and edges. Journal of the Acoustical Society of America, 141(6), 4727–4739.
Esteve-Gibert, N., & Prieto, P.
(2013) Prosodic structure shapes the temporal
realization of intonation and manual gesture
movements. Journal of Speech, Language, and Hearing
Research, 56(3), 850–865.
(2014) Infants temporally coordinate gesture-speech
combinations before they produce their first
words. Speech Communication, 57, 301–316.
Esteve-Gibert, N., Prieto, P., & Pons, F.
(2015) Nine-month-old infants are sensitive to the
temporal alignment of prosodic and gesture
prominences. Infant Behavior and Development, 38, 126–129.
Evans, J. L., Alibali, M. W., & McNeil, N. M.
(2001) Divergence of verbal expression and embodied
knowledge: Evidence from speech and gesture in children with
specific language impairment. Language and Cognitive processes, 16(2–3), 309–331.
Fujii, S., & Wan, C. Y.
(2014) The role of rhythm in speech and language
rehabilitation: The SEP hypothesis. Frontiers in Human Neuroscience, 8, 1–15.
Gentilucci, M., & Dalla Volta, R.
(2007) The motor system and the relationships between
speech and gesture. Gesture, 7(2), 159–177.
Gentilucci, M., Santunione, P., Roy, A. C., & Stefanini, S.
(2004) Execution and observation of bringing a fruit to
the mouth affect syllable pronunciation. European Journal of Neuroscience, 19(1), 190–202.
Goodwyn, S. W., Acredolo, L. P., & Brown, C. A.
(2000) Impact of symbolic gesturing on early language
development. Journal of Nonverbal Behavior, 24(2), 81–103.
Green, J. R., Moore, C. A., Higashikawa, M., & Steeve, R. W.
(2000) The physiologic development of speech motor
control: Lip and jaw coordination. Journal of Speech, Language and Hearing
Research, 43(1), 239–255.
Green, J. R., Moore, C. A., & Reilly, K. J.
(2002) The sequential development of jaw and lip control
for speech. Journal of Speech, Language, and Hearing
Research, 45(1), 66–79.
Guellaï, B., Langus, A., & Nespor, M.
(2014) Prosody in the hands of the
speaker. Frontiers in Psychology, 5, 00700.
Hulit, L. M., Fahey, K. R., & Howard, M. R.
(2015) Born to talk: An introduction to speech and language
development. Boston, MA: Pearson.
Igualada, A., Bosch, L., & Prieto, P.
(2015) Language development at 18 months is related to
multimodal communicative strategies at 12
months. Infant Behavior and Development, 39, 42–52.
Igualada, A., Esteve-Gibert, N., & Prieto, P.
(2017) Beat gestures improve word recall in 3- to 5-year
old children. Journal of Experimental Child Psychology, 156, 99–112.
Igualada, A., Wray, C., Prieto, P., & Norbury, C.
(2016) Synchronous gesture-prosody alignments in
narrations by children with specific language impairment
(SLI). Paper presented at the VIIIth International Conference
of Language Acquisition (AEAL), Palma, Spain.
Ito, J .P
(2012) Focal impulses and expressive
performance. In M. Aramaki, M. Barthet, R. Kronland-Martinet, & S. Ystad (Eds.), From sounds to music and emotions (pp.480–489). Berlin: Springer.
Iverson, J. M., & Braddock, B. A.
(2011) Gesture and motor skill in relation to language
in children with language impairment. Journal of Speech, Language, and Hearing
Research, 54(1), 72–86.
Iverson, J. M., Capirci, O., & Caselli, M. C.
(1994) From communication to language in two
modalities. Cognitive Development, 9(1), 23–43.
Iverson, J. M., & Fagan, M. K.
(2004) Infant vocal-motor coordination: Precursor to the
gesture-speech system? Child Development, 75(4), 1053–1066.
Iverson, J. M., & Goldin-Meadow, S.
(2005) Gesture paves the way for language
development. Psychological Science, 16(5), 367–371.
Iverson, J. M., & Thelen, E.
(1999) Hand, mouth and brain. The dynamic emergence of
speech and gesture. Journal of Consciousness Studies, 6, 19–40.
Kelso, J. S., Tuller, B., & Harris, K. S.
(1983) A “dynamic pattern” perspective on the control
and coordination of movement. In P. F. MacNeilage (Ed.), The production of speech (pp.137–173). New York, NY: Springer.
Kendon, A.
(1980) Gesticulation and speech: Two aspects of the
process of utterance. In M. R. Key (Ed.), The relationship of verbal and nonverbal
communication (pp.207–227). The Hague: Mouton.
Kent, R. D., & Bauer, H. R.
(1985) Vocalization of one-year-olds. Journal of Child Language, 12, 491–526.
Kim, J., Cvejic, E., & Davis, C.
(2014) Tracking eyebrows and head gestures associated
with spoken prosody. Speech Communication, 57, 317–330.
Krahmer, E., & Swerts, M.
(2007) The effects of visual beats on prosodic
prominence: Acoustic analyses, auditory perception and
visual perception. Journal of Memory and Language, 57(3), 396–414.
Krauss, R. M., Chen, Y., & Gottesman, R. F.
(2000) Lexical gestures and lexical access: A process
model. In D. McNeill (Ed.), Language and gesture (pp.261–283). New York, NY: Cambridge University Press.
Krivokapić, J., Tiede, M., Tyrone, M., & Goldenberg, D.
(2016) Speech and manual gesture coordination in a pointing
task. Paper presented at the meeting Framing speech:
Celebrating 40 years of inquiry with Stefanie
Shattuck-Hufnagel, Boston, USA.
Large, E. W., & Jones, M. R.
(1999) The dynamics of attending: How people track
time-varying events. Psychological Review, 106(1), 119–159.
Leonard, T., & Cummins, F.
(2011) The temporal relation between beat gestures and
speech. Language and Cognitive Processes, 26(10), 1457–1471.
Mainela-Arnold, E., Evans, J. L., & Alibali, M. W.
(2006) Understanding conservation delays in children
with Specific Language Impairment: Task representations
revealed in speech and gesture. Journal of Speech, Language, and Hearing
Research, 49, 1267–1279.
Mathew, M., Yuen, I., & Demuth, K.
(2017) Talking to the beat: Six-year-olds’ use of
stroke-defined non-referential gestures. First
Language, https://doi.org/10.1177/0142723717734949
Mathew, M., & Manjula, R.
(2015) Patterns in the emergence of hand actions in
typically developing infants. Journal of Communication Disorders, Deaf Studies &
Hearing, Aids, 3, 140.
Mathew, M., Yuen, I., Shattuck-Hufnagel, S., Ren, A., & Demuth, K.
(2014) The development of prosodic gestures during parent-child
discourse interactions. Paper presented at the 14th Conference on Laboratory
Phonology, Tokyo, Japan.
McCafferty, S .G
(2006) Gesture and the materialization of second
language prosody. IRAL-International Review of Applied Linguistics in
Language Teaching, 44(2), 197–209.
McNeill, D.
(1992) Hand and mind: What gestures reveal about
thought. Chicago, IL: The University of Chicago Press.
Merker, B., Madison, G., & Eckerdal, P.
(2009) On the role and origin of isochrony in human
rhythmic entrainment. Cortex, 45, 1–17.
Murillo, E., & Belinchón, M.
(2012) Gestural-vocal coordination: Longitudinal changes
and predictive value on early lexical
development. Gesture, 12(1), 16–39.
Murillo, E., & Capilla, A.
(2016) Properties of vocalization-and
gesture-combinations in the transition to first
words. Journal of Child Language, 43(4), 890–913.
Nicoladis, E., Mayberry, R. I., & Genesee, F.
(1999) Gesture and early bilingual
development. Developmental Psychology, 35(2), 514–526.
Oller, D. K., Wieman, L., Doyle, W., & Ross, C.
(1976) Infant babbling and speech. Journal of Child Language, 3, 1–11.
Owens, R. E.
(2016) Language development: An introduction. Boston, MA: Pearson.
Özçalışkan, S., Gentner, D., & Goldin-Meadow, S.
(2013) Do iconic gestures pave the way for children’s
early verbs? Applied Psycholinguistics, 35(6), 1143–1162.
Özçalışkan, S., & Goldin-Meadow, S.
(2005) Gesture is at the cutting edge of early language
development. Cognition, 96, B101–B113.
(2011) Is there an iconic gesture spurt at 26
months? In S. Gale, & I. Mika (Eds.), Integrating gestures: The interdisciplinary nature of
gesture, (pp.163–174). Amsterdam: John Benjamins.
Patel, R.
(2004) The acoustics of contrastive prosody in adults
with cerebral palsy. Journal of Medical Speech-Language Pathology, 12(4), 189–193.
Patel, R., & Brayton, J. T.
(2009) Identifying prosodic contrasts in utterances
produced by 4-, 7-, and 11-year-old children. Journal of Speech Language and Hearing Research, 52, 790–801.
Patel, R., & Grigos, M. I.
(2006) Acoustic characterization of the
question-statement contrast in 4, 7, and 11 year-old
children. Speech Communication, 48, 1308–1318.
Port, R.
(2003) Meter and speech. Journal of Phonetics, 31, 599–611.
Renard, R.
(1979) Introduction à la méthode verbo-tonale de correction
phonétique. Bruxelles: Didier, Mons: CIPA.
Rochet-Capellan, A., Laboissierre, R., Galvan, A., & Schwartz, J.
(2008) The speech focus position effect on jaw-finger
coordination in a pointing task. Journal of Speech, Language, and Hearing
Research, 51, 1507–1521.
Rusiewicz, H. L.
(2011, September). Synchronization of speech and gesture: A dynamic systems
perspective. Paper presented at the 2nd Gesture and Speech in
Interaction (GESPIN), Bielefeld, Germany.
Rusiewicz, H. L. & Rivera, J. L.
(2017) The effect of hand gesture cues within the
treatment of /r/ for a college-aged adult with persisting
childhood apraxia of speech. American Journal of Speech-Language Pathology, 26(4), 1236–1243.
Rusiewicz, H. L., Shaiman, S., Iverson, J. M., & Szuminsky, N.
(2013) Effects of prosody and position on the timing of
deictic gestures. Journal of Speech, Language, and Hearing
Research, 56(2), 458–470.
(2014) Effects of perturbation and prosody on the
coordination of speech and gesture. Speech Communication, 57, 283–300.
Sauer, E., Levine, S. C., & Goldin-Meadow, S.
(2010) Early gesture predicts language delay in children
with pre- or perinatal brain lesions. Child Development, 81(2), 528–539.
Smith, A., & Zelaznik, H. N.
(2004) Development of functional synergies for speech
motor coordination in childhood and
adolescence. Developmental Psychobiology, 45(1), 22–33.
Steve, R.
(2010) Babbling and chewing: Jaw kinematics from 8 to 22
months. Journal of Phonetics, 38(3), 445–458.
Tellier, M.
(2008) The effect of gestures on second language
memorisation by young children. Gesture, 8, 219–235.
Tomasello, M., Carpenter, M., & Liszkowski, U.
(2007) A new look at infant pointing. Child Development, 78(3), 705–722.
Tuite, K.
(1993) The production of gesture. Semiotica, 93, 8–105.
Volterra, V., Caselli, M. C., Capirci, O., & Pizzuto, E.
(2005) Gesture and the emergence and development of
language. In M. Tomasello, & D. Slobin (Eds.), Beyond nature-nurture. Essays in honor of Elizabeth
Bates (pp.3–40). Mahwah, NJ: Lawrence Erlbaum Associates.
Yang, J., Andric, M., & Mathew, M. M.
(2015) The neural basis of hand gesture comprehension: A
meta-analysis of functional magnetic resonance imaging
studies. Neuroscience & Biobehavioral Reviews, 57, 88–104.