Speech-gesture mismatches
Evidence for one underlying representation of linguistic and nonlinguistic information
Justine Cassell | Media Laboratory, MIT
David McNeill | Psychology and Linguistics, University of Chicago
Karl-Erik McCullough | Psychology and Linguistics, University of Chicago
Adults and children spontaneously produce gestures while they speak, and such gestures appear to support and expand on the information communicated by the verbal channel. Little research, however, has been carried out to examine the role played by gesture in the listener's representation of accumulating information. Do listeners attend to the gestures that accompany narrative speech? In what kinds of relationships between gesture and speech do listeners attend to the gestural channel? If listeners do attend to information received in gesture, how is this information represented— is it 'tagged' as originating in the gestural channel? In this article research is described that addresses these questions. Results show that listeners do attend to information conveyed in gesture, when that information supplements or even contradicts the information conveyed by speech. And information received via gesture is available for retelling in speech. These results are taken to demonstrate that gesture is not taken by the listener to be epiphenomenal to the act of speaking, or a simple manual translation of speech. But they also suggest that the information conveyed in a discourse may be represented in a manner that is neither gesture nor language, although accessible to both channels.
Published online: 22 May 1999
https://doi.org/10.1075/pc.7.1.03cas
https://doi.org/10.1075/pc.7.1.03cas
Cited by
Cited by 114 other publications
Alviar, Camila, Rick Dale & Alexia Galati
Austin, Elizabeth E. & Naomi Sweller
Beege, Maik, Manuel Ninaus, Sascha Schneider, Steve Nebel, Julia Schlemmel, Jasmin Weidenmüller, Korbinian Moeller & Günter Daniel Rey
Beilock, S.L. & S. Goldin-Meadow
Bergman, Helena Fatouros, Gunilla Preisler & Andrzej Werbart
Bremner, Paul & Ute Leonards
Bremner, Paul & Ute Leonards
Buisine, Stéphanie & Jean-Claude Martin
Cabibihan, John-John, Wendy Yusson, Saba Salehi & Shuzhi Sam Ge
Carlson, Crystal, Steven A. Jacobs, Michelle Perry & Ruth Breckinridge Church
Carrazza, Cristina, Elizabeth M. Wakefield, Naureen Hemani-Lopez, Kristin Plath & Susan Goldin-Meadow
Chan, Dana Michelle & Spencer Kelly
Chen, Lele, Guofeng Cui, Celong Liu, Zhong Li, Ziyi Kou, Yi Xu & Chenliang Xu
Clough, Sharice & Melissa C. Duff
Cocks, Naomi, Suzanne Byrne, Madeleine Pritchard, Gary Morgan & Lucy Dipper
Cook, Susan Wagner & Michael K. Tanenhaus
Cook, Susan Wagner, Terina Kuangyi Yip & Susan Goldin-Meadow
Corradini, A.
Cutica, Ilaria & Monica Bucciarelli
Dargue, Nicole & Naomi Sweller
Dargue, Nicole & Naomi Sweller
de Marchena, A., E. S. Kim, A. Bagdasarov, J. Parish-Morris, B. B. Maddox, E. S. Brodkin & R. T. Schultz
Debreslioska, Sandra & Marianne Gullberg
Debreslioska, Sandra, Joost van de Weijer & Marianne Gullberg
Ducasse, Ana Maria
Ebert, Cornelia
Eggenberger, Noëmi, Basil C. Preisig, Rahel Schumacher, Simone Hopfner, Tim Vanbellingen, Thomas Nyffeler, Klemens Gutbrod, Jean-Marie Annoni, Stephan Bohlhalter, Dario Cazzoli, René M. Müri & Antoni Rodriguez-Fornells
Evans, Kelli & Karen Hux
Ferri, Francesca, Marianna Busiello, Giovanna C. Campione, Elisa De Stefani, Alessandro Innocenti, Gian Luca Romani, Marcello Costantini & Maurizio Gentilucci
Fröhlich, Marlen, Christine Sievers, Simon W. Townsend, Thibaud Gruber & Carel P. Schaik
Galati, Alexia & Arthur G. Samuel
GARCÍA-GÁMEZ, ANA B. & PEDRO MACIZO
Genty, E.
Ginosar, Shiry, Amir Bar, Gefen Kohavi, Caroline Chan, Andrew Owens & Jitendra Malik
Goldin-Meadow, Susan
Goldin-Meadow, Susan & Sian L. Beilock
GOODRICH SMITH, WHITNEY & CARLA L. HUDSON KAM
Greenwood, David, Stephen Laycock & Iain Matthews
Gullberg, Marianne
Gullberg, Marianne
Gullberg, Marianne
Gullberg, Marianne & Kenneth Holmqvist
Gullberg, Marianne & Sotaro Kita
Gunter, Thomas C., J. E. Douglas Weinbrenner & Henning Holle
Gurney, Pine & Wiseman
Gurney, Daniel J., Louise R. Ellis & Emily Vardon-Hynard
Gurney, Daniel J., Neil Howlett, Karen Pine, Megan Tracey & Rachel Moggridge
Gurney, Daniel John
Habets, Boukje, Sotaro Kita, Zeshu Shao, Asli Özyurek & Peter Hagoort
Hasegawa, Dai, Shinichi Shirakawa, Naoya Shioiri, Toshiki Hanawa, Hiroshi Sakuta & Kouzou Ohara
HASEGAWA, Komei & Yasushi NAKAUCHI
Heeyoung Kim, Sonya S. Kwak & Myungsuk Kim
Hirata, Yukari & Spencer D. Kelly
Holle, Henning, Thomas C. Gunter, Shirley-Ann Rüschemeyer, Andreas Hennenlotter & Marco Iacoboni
Ianì, Francesco, Andrea Foiadelli & Monica Bucciarelli
Johanson, Deborah L., Ho Seok Ahn & Elizabeth Broadbent
Joue, Gina, Linda Boven, Klaus Willmes, Vito Evola, Liliana R. Demenescu, Julius Hassemer, Irene Mittelberg, Klaus Mathiak, Frank Schneider & Ute Habel
Kamiya, Nobuhiro
Kelly, Spencer D., Peter Creigh & James Bartolotti
Kelly, Spencer D., Corinne Kravitz & Michael Hopkins
Kelly, Spencer D., Tara McDevitt & Megan Esch
Kelly, Spencer D., Sarah Ward, Peter Creigh & James Bartolotti
Kita, Sotaro & Thomas Stephen Davies
Krahmer, Emiel & Marc Swerts
Latif, Nida, Agnès Alsius & K. G. Munhall
Le, Quoc Anh, Souheil Hanoune & Catherine Pelachaud
Leonard, Thomas & Fred Cummins
Lopez-Ozieblo, Renia
Macoun, Alice & Naomi Sweller
McNeill, David
Mendoza-Denton, Norma & Stefanie Jannedy
Nathan, Mitchell J., Amelia Yeo, Rebecca Boncoddo, Autumn B. Hostetter & Martha W. Alibali
Nirme, Jens, Magnus Haake, Agneta Gulz & Marianne Gullberg
Otero, Nuno, Chrystopher Nehaniv, Dag Syrdal & Kerstin Dautenhahn
Pook, Polly K. & Dana H. Ballard
Provost, Emily Mower, Yuan Shangguan & Carlos Busso
Rago, Francesco
Roth, Wolff-Michael
Scandurra, Anna, Alessandra Alterisio, Lieta Marinelli, Paolo Mongillo, Gün Refik Semin & Biagio D’Aniello
Sekine, Kazuki & Sotaro Kita
Sekine, Kazuki & Sotaro Kita
Sekine, Kazuki, Hannah Sowden & Sotaro Kita
Sime, Daniela
Skipper, Jeremy I., Susan Goldin-Meadow, Howard C. Nusbaum & Steven L. Small
Skipper, Jeremy I., Susan Goldin-Meadow, Howard C. Nusbaum & Steven L. Small
Smith, Whitney Goodrich & Carla L. Hudson Kam
So, Wing Chee, Colin Sim Chen-Hui & Julie Low Wei-Shan
Sowińska, Agnieszka & Monika Boruta-Żywiczyńska
Stolzenwald, Janis & Paul Bremner
Stone, Matthew & Insuk Oh
Sueyoshi, Ayano & Debra M. Hardison
ten Brinke, Leanne & Max Weisbuch
Tree, Jean E. Fox
Vulchanova, Mila, Valentin Vulchanov, Isabella Fritz & Evelyn A. Milburn
Wanphet, Phalangchok & Jalila Sfaxi
Wessler, Janet & Jochim Hansen
Willems, Roel M., Aslı Özyürek & Peter Hagoort
Wu, Ying Choon & Seana Coulson
Wu, Ying Choon & Seana Coulson
Wu, Ying Choon & Seana Coulson
Wu, Ying Choon, Seana Coulson & Krish Sathian
Wu, Zhiming, Tao Lin, Hongyan Xu & Ningjiu Tang
Xenofontos, Constantinos & Paul Andrews
Özer, Demet & Tilbe Göksun
This list is based on CrossRef data as of 18 april 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.