Article published In:
GestureVol. 7:2 (2007) ► pp.179–214
Aspects of rhythm in gesture and speech
This article investigates the rhythmic relationship between gesture and speech. Four subjects were filmed in natural conversations with friends. From the resulting videos, several thousand time-stamped annotations pertaining to rhythm were manually recorded in a digital annotation tool, and exported for statistical analysis. They revealed a rich rhythmic relationship between the hands, head, and voice. Each articulator produced pikes (a general term for short, distinctive expressions, regardless of the modality) in complex synchrony with other articulators. Even eyeblinks were synchronized, with eyelids held closed until reopening on the rhythmic beat, akin to a pre-stroke hold before a gestural stroke. Average tempos similar to previously reported natural human tempos — e.g. Fraisse’s (1982) 600 ms figure — were found in hands, head, and speech, although hands tended to move most quickly and speech most slowly. All three also shared a common tempo of around a third of a second, perhaps to synchronize inter-articulator meeting points. These findings lend empirical weight to earlier observations of a rhythmic relationship between gesture and speech, providing support for the theory of a common cognitive origin of the two modalities.
Cited by
Cited by 65 other publications
Arnold, Lynnette
2012. Dialogic Embodied Action: Using Gesture to Organize Sequence and Participation in Instructional Interaction. Research on Language & Social Interaction 45:3 ► pp. 269 ff. 
Arvaniti, Amalia
2021. Measuring Speech Rhythm. In The Cambridge Handbook of Phonetics, ► pp. 312 ff.
Brentari, Diane
2018. Modality and contextual salience in co-sign vs. co-speech gesture. Theoretical Linguistics 44:3-4 ► pp. 215 ff.
Brentari, Diane
2019. Sign Language Phonology,
BRENTARI, DIANE, MARIE A. NADOLSKE & GEORGE WOLFORD
2012. Can experience with co-speech gesture influence the prosody of a sign language? Sign language prosodic cues in bimodal bilinguals. Bilingualism: Language and Cognition 15:2 ► pp. 402 ff.
Cantarutti, Marina N. & Beatrice Szczepek Reed
2021. Stress and Rhythm. In The Cambridge Handbook of Phonetics, ► pp. 159 ff.
Cartmill, Erica A.
2022. Gesture. Annual Review of Anthropology 51:1 ► pp. 455 ff.
Cavicchio, Federica & Maria Grazia Busà
2023. The Role of Representational Gestures and Speech Synchronicity in Auditory Input by L2 and L1 Speakers. Journal of Psycholinguistic Research 52:5 ► pp. 1721 ff.
Church, R. Breckinridge, Spencer Kelly & David Holcombe
2014. Temporal synchrony between speech, action and gesture during language production. Language, Cognition and Neuroscience 29:3 ► pp. 345 ff.
Congdon, Eliza L. & Susan Goldin-Meadow
2021. Mechanisms of Embodied Learning Through Gestures and Actions: Lessons from Development. In Handbook of Embodied Psychology, ► pp. 527 ff.
Congdon, Eliza L., Miriam A. Novack, Neon Brooks, Naureen Hemani-Lopez, Lucy O'Keefe & Susan Goldin-Meadow
2017. Better together: Simultaneous presentation of speech and gesture in math instruction supports generalization and retention. Learning and Instruction 50 ► pp. 65 ff.
Costello, Brigid M.
2018. Culture and Time. In Rhythm, Play and Interaction Design [Springer Series on Cultural Computing, ], ► pp. 13 ff.
Danner, Samantha Gordon, Adriano Vilela Barbosa & Louis Goldstein
2018. Quantitative analysis of multimodal speech data. Journal of Phonetics 71 ► pp. 268 ff.
De Jonge-Hoekstra, Lisette, Steffie Van der Steen, Paul Van Geert & Ralf F. A. Cox
2016. Asymmetric Dynamic Attunement of Speech and Gestures in the Construction of Children’s Understanding. Frontiers in Psychology 7
de Marchena, Ashley & Inge‐Marie Eigsti
2010. Conversational gestures in autism spectrum disorders: Asynchrony but not decreased frequency. Autism Research 3:6 ► pp. 311 ff.
Esteve-Gibert, Núria & Pilar Prieto
2013. Prosodic Structure Shapes the Temporal Realization of Intonation and Manual Gesture Movements. Journal of Speech, Language, and Hearing Research 56:3 ► pp. 850 ff.
Esteve-Gibert, Núria & Pilar Prieto
2014. Infants temporally coordinate gesture-speech combinations before they produce their first words. Speech Communication 57 ► pp. 301 ff.
Fenlon, Jordan, Kensy Cooperrider, Jon Keane, Diane Brentari & Susan Goldin-Meadow
2019. Comparing sign language and gesture: Insights from pointing. Glossa: a journal of general linguistics 4:1
Florit-Pons, Júlia, Ingrid Vilà-Giménez, Patrick Louis Rohrer & Pilar Prieto
2023. Multimodal Development in Children's Narrative Speech: Evidence for Tight Gesture–Speech Temporal Alignment Patterns as Early as 5 Years Old. Journal of Speech, Language, and Hearing Research 66:3 ► pp. 888 ff.
Graziano, Maria & Marianne Gullberg
2024. Providing evidence for a well-worn stereotype: Italians and Swedes do gesture differently. Frontiers in Communication 9
Graziano, Maria, Elena Nicoladis & Paula Marentette
2020. How Referential Gestures Align With Speech: Evidence From Monolingual and Bilingual Speakers. Language Learning 70:1 ► pp. 266 ff.
Hardison, Debra M.
2018. Visualizing the acoustic and gestural beats of emphasis in multimodal discourse. Journal of Second Language Pronunciation 4:2 ► pp. 232 ff.
Hawkins, Sarah
2014. Situational influences on rhythmicity in speech, music, and their interaction. Philosophical Transactions of the Royal Society B: Biological Sciences 369:1658 ► pp. 20130398 ff.
Jiménez-Bravo, Miguel & Victoria Marrero-Aguiar
2020. Multimodal perception of prominence in spontaneous speech: A methodological proposal using mixed models and AIC. Speech Communication 124 ► pp. 28 ff.
Kelly, Spencer D.
2017. Chapter 11. Exploring the boundaries of gesture-speech integration during language comprehension. In Why Gesture? [Gesture Studies, 7], ► pp. 243 ff.
Lawson, Francesca R. Sborgi, Joshua David Sims & John Scott Lawson
2020. When Audiences Become Performers and Speech Becomes Music: New Tools to Analyze Speech, Song, and Participation in Chinese Crosstalk. Music & Science 3 ► pp. 205920432093798 ff.
Levine, Sergey, Philipp Krähenbühl, Sebastian Thrun & Vladlen Koltun
2010. ACM SIGGRAPH 2010 papers, ► pp. 1 ff.
Levine, Sergey, Philipp Krähenbühl, Sebastian Thrun & Vladlen Koltun
2010. Gesture controllers. ACM Transactions on Graphics 29:4 ► pp. 1 ff.
Lipari, Lisbeth
2014. On interlistening and the idea of dialogue. Theory & Psychology 24:4 ► pp. 504 ff.
Lücking, Andy & Jonathan Ginzburg
2023. Leading voices: dialogue semantics, cognitive science and the polyphonic structure of multimodal interaction. Language and Cognition 15:1 ► pp. 148 ff.
Marchant, Paola, Carlos Cornejo & Patricio Felmer
2023. Student Insights in Mathematics Problem Solving: Cognition, Affect, and Gesture. International Journal of Science and Mathematics Education 21:3 ► pp. 713 ff.
Marstaller, L. & H. Burianová
2015. A common functional neural network for overt production of speech and gesture. Neuroscience 284 ► pp. 29 ff.
Murillo, Eva, Carlota Ortega, Alicia Otones, Irene Rujas & Marta Casla
2018. Changes in the Synchrony of Multimodal Communication in Early Language Development. Journal of Speech, Language, and Hearing Research 61:9 ► pp. 2235 ff.
Myers, Brett, Miriam Lense & Reyna Gordon
2019. Pushing the Envelope: Developments in Neural Entrainment to Speech and the Biological Underpinnings of Prosody Perception. Brain Sciences 9:3 ► pp. 70 ff.
Navarretta, Costanza
2019. 2019 10th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), ► pp. 215 ff.
Navarretta, Costanza
2023. Identifying the Function of Hand Gestures from Their Form in Political Speech. In Accentuated Innovations in Cognitive Info-Communication [Topics in Intelligent Engineering and Informatics, 16], ► pp. 203 ff.
Navarretta, Costanza & Lucretia Oemig
2019. Big Data and Multimodal Communication: A Perspective View. In Innovations in Big Data Mining and Embedded Knowledge [Intelligent Systems Reference Library, 159], ► pp. 167 ff.
Nirme, Jens, Magnus Haake, Agneta Gulz & Marianne Gullberg
2020. Motion capture-based animated characters for the study of speech–gesture integration. Behavior Research Methods 52:3 ► pp. 1339 ff.
Novack, Miriam A. & Susan Goldin-Meadow
2017. Gesture as representational action: A paper about function. Psychonomic Bulletin & Review 24:3 ► pp. 652 ff.
Novack, Miriam A. & Susan Goldin-Meadow
2017. Chapter 17. Understanding gesture as representational action. In Why Gesture? [Gesture Studies, 7], ► pp. 381 ff.
Novack, Miriam A. & Susan Goldin-Meadow
2023. Harnessing gesture to understand and support healthy development. In Encyclopedia of Child and Adolescent Health, ► pp. 40 ff.
Obermeier, Christian & Thomas C. Gunter
2015. Multisensory Integration: The Case of a Time Window of Gesture–Speech Integration. Journal of Cognitive Neuroscience 27:2 ► pp. 292 ff.
Ogden, Richard
2020. Audibly Not Saying Something with Clicks. Research on Language and Social Interaction 53:1 ► pp. 66 ff.
Ousterhout, Thomas
2015. 2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), ► pp. 493 ff.
Ousterhout, Thomas & Costanza Navarretta
2015. 2015 6th IEEE International Conference on Cognitive Infocommunications (CogInfoCom), ► pp. 499 ff.
Paggio, Patrizia & Costanza Navarretta
2017. The Danish NOMCO corpus: multimodal interaction in first acquaintance conversations. Language Resources and Evaluation 51:2 ► pp. 463 ff.
Perniss, Pamela, David Vinson & Gabriella Vigliocco
2020. Making Sense of the Hands and Mouth: The Role of “Secondary” Cues to Meaning in British Sign Language and English. Cognitive Science 44:7
Prieto, Pilar, Cecilia Puglesi, Joan Borràs-Comes, Ernesto Arroyo & Josep Blat
2015. Exploring the contribution of prosody and gesture to the perception of focus using an animated agent☆. Journal of Phonetics 49 ► pp. 41 ff.
Ravignani, Andrea, Cinzia Chiandetti & Sonja A. Kotz
2019. Rhythm and Music in Animal Signals. In Encyclopedia of Animal Behavior, ► pp. 615 ff.
Robledo, Juan Pablo, Sarah Hawkins, Carlos Cornejo, Ian Cross, Daniel Party, Esteban Hurtado & Psyche Loui
2021. Musical improvisation enhances interpersonal coordination in subsequent conversation: Motor and speech evidence. PLOS ONE 16:4 ► pp. e0250166 ff.
Roche, Jennifer M., Rick Dale & Gina M. Caucci
2012. Doubling up on double meanings: Pragmatic alignment. Language and Cognitive Processes 27:1 ► pp. 1 ff.
Rohrer, Patrick Louis, Elisabeth Delais-Roussarie & Pilar Prieto
2023. Visualizing prosodic structure: Manual gestures as highlighters of prosodic heads and edges in English academic discourses. Lingua 293 ► pp. 103583 ff.
Romero Andonegi, Asier, Irati de Pablo Delgado, Aintzane Etxebarria Lejarreta & Ainara Romero Andonegi
2019. Dynamic processes of intermodal coordination in the ontogenesis of language. Gesture 18:1 ► pp. 57 ff.
Rusiewicz, Heather Leavy, Susan Shaiman, Jana M. Iverson & Neil Szuminsky
2014. Effects of perturbation and prosody on the coordination of speech and gesture. Speech Communication 57 ► pp. 283 ff.
Smotrova, Tetyana
2017. Making Pronunciation Visible: Gesture In Teaching Pronunciation. TESOL Quarterly 51:1 ► pp. 59 ff.
Stam, Gale
2018. Chapter 3. Gesture and speaking a second language. In Speaking in a Second Language [AILA Applied Linguistics Series, 17], ► pp. 49 ff.
Tapus, Adriana & Amir Aly
2011. 2011 International Conference on Collaboration Technologies and Systems (CTS), ► pp. 165 ff.
Ticca, Anna-Claudia
2014. Managing multiactivity in a travel agency. In Multiactivity in Social Interaction, ► pp. 191 ff.
Tkachman, Oksana, Kathleen Currie Hall, Robert Fuhrman & Yurika Aonuki
2019. Visible amplitude: Towards quantifying prominence in sign language. Journal of Phonetics 77 ► pp. 100935 ff.
WILBUR, RONNIE B. & EVGUENIA MALAIA
2008. CONTRIBUTIONS OF SIGN LANGUAGE RESEARCH TO GESTURE UNDERSTANDING: WHAT CAN MULTIMODAL COMPUTATIONAL SYSTEMS LEARN FROM SIGN LANGUAGE RESEARCH. International Journal of Semantic Computing 02:01 ► pp. 5 ff.
Yang, Yanzhe, Jimei Yang & Jessica Hodgins
2020. Statistics‐based Motion Synthesis for Social Conversations. Computer Graphics Forum 39:8 ► pp. 201 ff.
Zhang, Ye, Diego Frassinelli, Jyrki Tuomainen, Jeremy I. Skipper & Gabriella Vigliocco
2021. More than words: word predictability, prosody, gesture and mouth movements in natural language comprehension. Proceedings of the Royal Society B: Biological Sciences 288:1955 ► pp. 20210500 ff.
Zheng, Annie, Yukari Hirata & Spencer D. Kelly
2018. Exploring the Effects of Imitating Hand Gestures and Head Nods on L1 and L2 Mandarin Tone Production. Journal of Speech, Language, and Hearing Research 61:9 ► pp. 2179 ff.
Özyürek, Aslı
2014. Hearing and seeing meaning in speech and gesture: insights from brain and behaviour. Philosophical Transactions of the Royal Society B: Biological Sciences 369:1651 ► pp. 20130296 ff.
[no author supplied]
2020. References. In Developing Self and Self-Concepts in Early Childhood Education and Beyond, ► pp. 115 ff.
This list is based on CrossRef data as of 30 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.