Article published In:
GestureVol. 4:2 (2005) ► pp.157–195
Linguistic influences on gesture’s form
Hand gestures in face-to-face dialogue are symbolic acts, integrated with speech. Little is known about the factors that determine the physical form of these gestures. When the gesture depicts a previous nonsymbolic action, it obviously resembles this action; however, such gestures are not only noticeably different from the original action but, when they occur in a series, are different from each other. This paper presents an experiment with two separate analyses (one quantitative, one qualitative) testing the hypothesis that the immediate communicative function is a determinant of the symbolic form of the gesture. First, we manipulated whether the speaker was describing the previous action to an addressee who had done the same actions and therefore shared common ground or to one who had done different actions and therefore did not share common ground. The common ground gestures were judged to be significantly less complex, precise, or informative than the latter, a finding similar to the effects of common ground on words. In the qualitative analysis, we used the given versus new principle to analyze a series of gestures about the same actions by the same speaker. The speaker emphasized the new information in each gesture by making it larger, clearer, etc. When this information became given, a gesture for the same action became smaller or less precise, which is similar to findings for given versus new information in words. Thus the immediate communicative function (e.g., to convey information that is common ground or that is new) played a major role in determining the physical form of the gestures.
Keywords: hand gesture, gesture form, communication, common ground, given/new
Cited by
Cited by 76 other publications
Alibali, Martha W., Mitchell J. Nathan, Rebecca Boncoddo & Elizabeth Pier
2019. Managing common ground in the classroom: teachers use gestures to support students’ contributions to classroom discourse. ZDM 51:2 ► pp. 347 ff. 
Asalıoğlu, Esma Nur & Tilbe Göksun
2023. The role of hand gestures in emotion communication: Do type and size of gestures matter?. Psychological Research 87:6 ► pp. 1880 ff.
Baumard, Josselin, Alice Laniepce, Mathieu Lesourd, Léna Guezouli, Virginie Beaucousin, Maureen Gehin, François Osiurak & Angela Bartolo
2024. The Neurocognitive Bases of Meaningful Intransitive Gestures: A Systematic Review and Meta-analysis of Neuropsychological Studies. Neuropsychology Review
Bavelas, Janet, Jennifer Gerwing, Chantelle Sutton & Danielle Prevost
2008. Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language 58:2 ► pp. 495 ff.
Bergmann, Kirsten
2013. Co-speech Gesture Generation for Embodied Agents and its Effects on User Evaluation. In Coverbal Synchrony in Human-Machine Interaction, ► pp. 223 ff.
Campisi, Emanuela & Asli Özyürek
2013. Iconicity as a communicative strategy: Recipient design in multimodal demonstrations for adults and children. Journal of Pragmatics 47:1 ► pp. 14 ff.
Clough, Sharice & Melissa C. Duff
2020. The Role of Gesture in Communication and Cognition: Implications for Understanding and Treating Neurogenic Communication Disorders. Frontiers in Human Neuroscience 14
Clough, Sharice, Caitlin Hilverman, Sarah Brown-Schmidt & Melissa C. Duff
2022. Evidence of Audience Design in Amnesia: Adaptation in Gesture but Not Speech. Brain Sciences 12:8 ► pp. 1082 ff.
Cochet, Hélène & Jacques Vauclair
2014. Deictic gestures and symbolic gestures produced by adults in an experimental context: Hand shapes and hand preferences. Laterality: Asymmetries of Body, Brain and Cognition 19:3 ► pp. 278 ff.
Cohen, Cathy & Ciara R. Wigham
2019. A comparative study of lexical word search in an audioconferencing and a videoconferencing condition. Computer Assisted Language Learning 32:4 ► pp. 448 ff.
Cooperrider, Kensy
de Ruiter, Jan P., Adrian Bangerter & Paula Dings
2012. The Interplay Between Gesture and Speech in the Production of Referring Expressions: Investigating the Tradeoff Hypothesis. Topics in Cognitive Science 4:2 ► pp. 232 ff.
Debreslioska, Sandra & Marianne Gullberg
2019. Discourse Reference Is Bimodal: How Information Status in Speech Interacts with Presence and Viewpoint of Gestures. Discourse Processes 56:1 ► pp. 41 ff.
Debreslioska, Sandra & Marianne Gullberg
2020. The semantic content of gestures varies with definiteness, information status and clause structure. Journal of Pragmatics 168 ► pp. 36 ff.
Debreslioska, Sandra & Marianne Gullberg
2022. Information Status Predicts the Incidence of Gesture in Discourse: An Experimental Study. Discourse Processes 59:10 ► pp. 791 ff.
Devanga, Suma R., Rachel Wilgenhof & Mili Mathew
2022. Collaborative referencing using hand gestures in Wernicke’s aphasia: Discourse analysis of a case study. Aphasiology 36:9 ► pp. 1072 ff.
Doedens, W.J. & L. Meteyard
2022. What is Functional Communication? A Theoretical Framework for Real-World Communication Applied to Aphasia Rehabilitation. Neuropsychology Review 32:4 ► pp. 937 ff.
Flack, Zoe M., Martha Naylor & David A. Leavens
2018. Pointing to Visible and Invisible Targets. Journal of Nonverbal Behavior 42:2 ► pp. 221 ff.
Galati, Alexia & Susan E. Brennan
2014. Speakers adapt gestures to addressees' knowledge: implications for models of co-speech gesture. Language, Cognition and Neuroscience 29:4 ► pp. 435 ff.
Gerwing, Jennifer & Shuangyu Li
2019. Body-oriented gestures as a practitioner's window into interpreted communication. Social Science & Medicine 233 ► pp. 171 ff.
Gullberg, Marianne
2010. Methodological reflections on gesture analysis in second language acquisition and bilingualism research. Second Language Research 26:1 ► pp. 75 ff.
Gullberg, Marianne & Sotaro Kita
2009. Attention to Speech-Accompanying Gestures: Eye Movements and Information Uptake. Journal of Nonverbal Behavior 33:4 ► pp. 251 ff.
Hilverman, Caitlin, Sarah Brown-Schmidt & Melissa C. Duff
2019. Gesture height reflects common ground status even in patients with amnesia. Brain and Language 190 ► pp. 31 ff.
Hoetjes, Marieke, Ruud Koolen, Martijn Goudbeek, Emiel Krahmer & Marc Swerts
2015. Reduction in gesture during the production of repeated references. Journal of Memory and Language 79-80 ► pp. 1 ff.
Hoetjes, Marieke, Emiel Krahmer & Marc Swerts
2014. Do repeated references result in sign reduction?. Sign Language & Linguistics 17:1 ► pp. 56 ff.
Hoetjes, Marieke, Emiel Krahmer & Marc Swerts
2015. On what happens in gesture when communication is unsuccessful. Speech Communication 72 ► pp. 160 ff.
Holler, Judith
2010. Speakers’ Use of Interactive Gestures as Markers of Common Ground. In Gesture in Embodied Communication and Human-Computer Interaction [Lecture Notes in Computer Science, 5934], ► pp. 11 ff.
Holler, Judith
2022. Visual bodily signals as core devices for coordinating minds in interaction. Philosophical Transactions of the Royal Society B: Biological Sciences 377:1859
Holler, Judith & Janet Bavelas
2017. Chapter 10. Multi-modal communication of common ground. In Why Gesture? [Gesture Studies, 7], ► pp. 213 ff.
Holler, Judith, Janet Bavelas, Jonathan Woods, Mareike Geiger & Lauren Simons
2022. Given-New Effects on the Duration of Gestures and of Words in Face-to-Face Dialogue. Discourse Processes 59:8 ► pp. 619 ff.
Holler, Judith & Rachel Stevens
2007. The Effect of Common Ground on How Speakers Use Gesture and Speech to Represent Size Information. Journal of Language and Social Psychology 26:1 ► pp. 4 ff.
Holler, Judith & Katie Wilkin
2009. Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task. Language and Cognitive Processes 24:2 ► pp. 267 ff.
Holler, Judith & Katie Wilkin
2011. Co-Speech Gesture Mimicry in the Process of Collaborative Referring During Face-to-Face Dialogue. Journal of Nonverbal Behavior 35:2 ► pp. 133 ff.
Holler, Judith & Katie Wilkin
2011. An experimental investigation of how addressee feedback affects co-speech gestures accompanying speakers’ responses. Journal of Pragmatics 43:14 ► pp. 3522 ff.
Hostetter, Autumn B. & Martha W. Alibali
2010. Language, gesture, action! A test of the Gesture as Simulated Action framework. Journal of Memory and Language 63:2 ► pp. 245 ff.
Jarmołowicz-Nowikow, Ewa
2015. How Poles indicate people and objects, and what they think of certain forms of pointing gestures. Lingua Posnaniensis 56:1 ► pp. 85 ff.
Kelly, Spencer, Kelly Byrne & Judith Holler
2011. Raising the Ante of Communication: Evidence for Enhanced Gesture Use in High Stakes Situations. Information 2:4 ► pp. 579 ff.
Kita, Sotaro & Karen Emmorey
2023. Gesture links language and cognition for spoken and signed languages. Nature Reviews Psychology 2:7 ► pp. 407 ff.
Kuhlen, Anna K., Alexia Galati & Susan E. Brennano
2012. Gesturing integrates top-down and bottom-up information: Joint effects of speakers' expectations and addressees' feedback. Language and Cognition 4:1 ► pp. 17 ff.
Laparle, Schuyler
2023. Gradient at-issueness and semiotic complexity in gesture: a response. Theoretical Linguistics 49:3-4 ► pp. 261 ff.
Leonteva, Anna V., Alan Cienki & Olga V. Agafonova
2023. Metaphoric gestures in simultaneous interpreting. Russian Journal of Linguistics 27:4 ► pp. 820 ff.
Lopez-Ozieblo, Renia
2020. A multimodal cognitive approach to aid the conceptualization of Spanish utterances with ‘se’. Cognitive Linguistics 31:4 ► pp. 677 ff.
Masson-Carro, Ingrid, Martijn Goudbeek & Emiel Krahmer
2016. Can you handle this? The impact of object affordances on how co-speech gestures are produced. Language, Cognition and Neuroscience 31:3 ► pp. 430 ff.
Masson‐Carro, Ingrid, Martijn Goudbeek & Emiel Krahmer
2016. Imposing Cognitive Constraints on Reference Production: The Interplay Between Speech and Gesture During Grounding. Topics in Cognitive Science 8:4 ► pp. 819 ff.
Mertens, Ulrich J. & Katharina J. Rohlfing
2021. Progressive Reduction of Iconic Gestures Contributes to School-Aged Children’s Increased Word Production. Frontiers in Psychology 12
Morin, Olivier, Piers Kelly & James Winters
2020. Writing, Graphic Codes, and Asynchronous Communication. Topics in Cognitive Science 12:2 ► pp. 727 ff.
Nagels, Arne, Tilo Kircher, Miriam Steines, Michael Grosvald & Benjamin Straube
2015. A brief self-rating scale for the assessment of individual differences in gesture perception and production. Learning and Individual Differences 39 ► pp. 73 ff.
Nathan, Mitchell J., Martha W. Alibali & R. Breckinridge Church
2017. Chapter 13. Making and breaking common ground. In Why Gesture? [Gesture Studies, 7], ► pp. 285 ff.
Nicoladis, Elena, Trevor Luk & Shireen Gill
Parrill, Fey
2012. Interactions between discourse status and viewpoint inco-speech gesture. In Viewpoint in Language, ► pp. 97 ff.
Parrill, Fey, Jennifer Bullen & Huston Hoburg
2010. Effects of input modality on speech–gesture integration. Journal of Pragmatics 42:11 ► pp. 3130 ff.
Peeters, David, Mingyuan Chu, Judith Holler, Peter Hagoort & Aslı Özyürek
2015. Electrophysiological and Kinematic Correlates of Communicative Intent in the Planning and Production of Pointing Gestures and Speech. Journal of Cognitive Neuroscience 27:12 ► pp. 2352 ff.
Pouw, Wim, Jan de Wit, Sara Bögels, Marlou Rasenberg, Branka Milivojevic & Asli Ozyurek
2021. Semantically Related Gestures Move Alike: Towards a Distributional Semantics of Gesture Kinematics. In Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body, Motion and Behavior [Lecture Notes in Computer Science, 12777], ► pp. 269 ff.
Pouw, Wim, Mark Dingemanse, Yasamin Motamedi & Aslı Özyürek
2021. A Systematic Investigation of Gesture Kinematics in Evolving Manual Languages in the Lab. Cognitive Science 45:7
Richardson, Daniel C., Rick Dale & John M. Tomlinson
2009. Conversation, Gaze Coordination, and Beliefs About Visual Context. Cognitive Science 33:8 ► pp. 1468 ff.
Scherr, Rachel E.
2008. Gesture analysis for physics education researchers. Physical Review Special Topics - Physics Education Research 4:1
Scherr, Rachel E. & David Hammer
2009. Student Behavior and Epistemological Framing: Examples from Collaborative Active-Learning Activities in Physics. Cognition and Instruction 27:2 ► pp. 147 ff.
Schubotz, Louise, Aslı Özyürek & Judith Holler
2019. Age-related differences in multimodal recipient design: younger, but not older adults, adapt speech and co-speech gestures to common ground. Language, Cognition and Neuroscience 34:2 ► pp. 254 ff.
SEHYR, ZED SEVCIKOVA, BRENDA NICODEMUS, JENNIFER PETRICH & KAREN EMMOREY
2018. Referring strategies in American Sign Language and English (with co-speech gesture): The role of modality in referring to non-nameable objects. Applied Psycholinguistics 39:5 ► pp. 961 ff.
Shaw, Emily
Sowińska, Agnieszka & Monika Boruta-Żywiczyńska
2020. Gestures in patients’ presentation of medically unexplained symptoms (MUS). Gesture 19:1 ► pp. 97 ff.
Sparrow, Karen, Christopher Lind & Willem van Steenbrugge
2020. Gesture, communication, and adult acquired hearing loss. Journal of Communication Disorders 87 ► pp. 106030 ff.
Stam, Gale
2018. Chapter 3. Gesture and speaking a second language. In Speaking in a Second Language [AILA Applied Linguistics Series, 17], ► pp. 49 ff.
Stamp, Rose, Svetlana Dachkovsky, Hagit Hel-Or, David Cohn & Wendy Sandler
2024. A kinematic study of phonetic reduction in a young sign language. Journal of Phonetics 104 ► pp. 101311 ff.
Tellier, Marion, Gale Stam & Alain Ghio
Tetnowski, Jennifer Thompson, John A. Tetnowski & Jack S. Damico
2023. Looking at gesture: The reciprocal influence between gesture and conversation. Journal of Communication Disorders 106 ► pp. 106379 ff.
Thompson, Isabelle
2009. Scaffolding in the Writing Center. Written Communication 26:4 ► pp. 417 ff.
Trujillo, James P., Stephen C. Levinson & Judith Holler
2021. Visual Information in Computer-Mediated Interaction Matters: Investigating the Association Between the Availability of Gesture and Turn Transition Timing in Conversation. In Human-Computer Interaction. Design and User Experience Case Studies [Lecture Notes in Computer Science, 12764], ► pp. 643 ff.
Trujillo, James P., Stephen C. Levinson & Judith Holler
2022. A multi-scale investigation of the human communication system's response to visual disruption. Royal Society Open Science 9:4
Trujillo, James P., Irina Simanova, Harold Bekkering & Asli Özyürek
2018. Communicative intent modulates production and comprehension of actions and gestures: A Kinect study. Cognition 180 ► pp. 38 ff.
Trujillo, James P., Irina Simanova, Harold Bekkering & Asli Özyürek
2020. The communicative advantage: how kinematic signaling supports semantic comprehension. Psychological Research 84:7 ► pp. 1897 ff.
Trujillo, James P., Julija Vaitonyte, Irina Simanova & Asli Özyürek
2019. Toward the markerless and automatic analysis of kinematic features: A toolkit for gesture and movement research. Behavior Research Methods 51:2 ► pp. 769 ff.
Türk, Olcay & Sasha Calhoun
2023. Phrasal Synchronization of Gesture With Prosody and Information Structure. Language and Speech
Vajrabhaya, Prakaiwan & Eric Pederson
Verhulsdonck, Gustav
2007. Proceedings of the 25th annual ACM international conference on Design of communication, ► pp. 26 ff.
Yu, Yanning & David H. Uttal
2022. Gestures, embodiment, and learning the rate of change. Mathematical Thinking and Learning 24:3 ► pp. 203 ff.
This list is based on CrossRef data as of 30 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.