Catchments, prosody and discourse
David McNeill | University of Chicago
Francis Quek | Wright State University
Karl-Erik McCullough | University of Chicago
Susan D. Duncan | Wright State University
Nobuhiro Furuyama | University of Chicago
Robert Bryll | Wright State University
Nobuhiro Furuyama | Wright State University
Rashid Ansari | University of Illinois
We present our work on the temporal integration of hierarchies of communicative actions: kinesic, prosodic and discursive. We use the device of the ‘catchment’ as the locus around which this integration proceeds. We present a detailed case study of a gesture and speech elicitation experiment in which a subject describes her living space to an interlocutor. First, we process the video data to obtain the motion traces of both of the subject’s hands using the vector coherence mapping algorithm. We code the gestures to identify the catchments. We recover discourse purposes utilizing a system of guided questions. Finally, we define prosody in terms of the ToBI system. The results of these analyses are compared against the computed motion traces to identify the cues accessible in the gestural and audio data that correlate well with the psycholinguistic analyses. The results show that motion, prosody and discourse structure are integrated at each moment of speaking.
The electronic edition of this article includes audio-visual data.
Keywords: discourse, prosody, gesture groups, temporal integration, discourse purposes, ToBI, catchments
Published online: 06 June 2002
https://doi.org/10.1075/gest.1.1.03mcn
https://doi.org/10.1075/gest.1.1.03mcn
Cited by
Cited by 45 other publications
Alibali, Martha W., Mitchell J. Nathan, Rebecca Boncoddo & Elizabeth Pier
Alibali, Martha W., Mitchell J. Nathan, Matthew S. Wolfgram, R. Breckinridge Church, Steven A. Jacobs, Chelsea Johnson Martinez & Eric J. Knuth
Arzarello, Ferdinando, Ornella Robutti & Mike Thomas
Arzarello, Ferdinando & Cristina Sabena
Becvar, Amaya, James Hollan & Edwin Hutchins
Bryll, R., R.T. Rose & F. Quek
Campbell, Nick
Cohn, Neil
Colletta, Jean-Marc, Ramona N. Kunene, Aurélie Venouil, Virginie Kaufmann & Jean-Pascal Simon
Dick, Anthony Steven, Susan Goldin-Meadow, Uri Hasson, Jeremy I. Skipper & Steven L. Small
Feyereisen, Pierre
Flecha-García, María L.
FURUYAMA, NOBUHIRO
Jenkins, Theodore, Marie Coppola & Carl Coelho
Kataoka, Kuniyoshi
Kataoka, Kuniyoshi
Krause, Christina M. & Alexander Salle
Krivokapić, Jelena
Krivokapić, Jelena, Mark K. Tiede & Martha E. Tyrone
Kröger, Bernd J., Peter Birkholz, Jim Kannampuzha, Emily Kaufmann & Irene Mittelberg
Lempert, Michael
Levy, Elena T.
Madeo, Renata C. B., Clodoaldo A. M. Lima & Sarajane M. Peres
Martin, Jean-Claude, Patrizia Paggio, Peter Kuehnlein, Rainer Stiefelhagen & Fabio Pianesi
McNeill, David
Mcneill, David, Elena T. Levy & Susan D. Duncan
Mendoza-Denton, Norma & Stefanie Jannedy
Mittelberg, Irene
Muto, Yumiko, Shoji Takasugi, Tomohito Yamamoto & Yoshihiro Miyake
Müller, Cornelia & Tag, Susanne
Pouw, Wim & James A. Dixon
Quek, F.
Quek, F., R. Bryll, M. Harper, Lei Chen & L. Ramig
Quek, Francis, David McNeill, Robert Bryll, Susan Duncan, Xin-Feng Ma, Cemil Kirbas, Karl E. McCullough & Rashid Ansari
Radford, Luis & Cristina Sabena
Sabena, Cristina
Sambre, Paul & Kurt Feyaerts
Stone, Matthew, Doug DeCarlo, Insuk Oh, Christian Rodriguez, Adrian Stere, Alyssa Lees & Chris Bregler
Yasui, Eiko
Yildirim, Serdar & Shrikanth Narayanan
Yingen Xiong, F. Quek & D. McNeill
This list is based on CrossRef data as of 05 march 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.