Publications

Publication details [#45071]

Ruiter, Jan Peter de. 2007. Postcards from the mind: The relationship between speech, imagistic gesture, and thought. Gesture 7 (1) : 21–38.
Publication type
Article in journal
Publication language
English
Place, Publisher
John Benjamins
Journal DOI
10.1075/gest

Annotation

This paper compares three different assumptions about the relationship between speech, thought and gesture. These assumptions have profound consequences for theories about the representations and processing involved in gesture and speech production. The assumptions are associated with three simplified processing architectures. In the Window Architecture, gesture provides us with a ‘window into the mind’. In the Language Architecture, properties of language have an influence on gesture. In the Postcard Architecture, gesture and speech are planned by a single process to become one multimodal message. The popular Window Architecture is based on the assumption that gestures come, as it were, straight out of the mind. It is argued that during the creation of overt imagistic gestures, many processes, especially those related to (a) recipient design, and (b) effects of language structure, cause an observable gesture to be very different from the original thought that it expresses. The Language Architecture and the Postcard Architecture differ from the Window Architecture in that they both incorporate a central component which plans gesture and speech together, however they differ from each other in the way they align gesture and speech. The Postcard Architecture assumes that the process creating a multimodal message involving both gesture and speech has access to the concepts that are available in speech, while the Language Architecture relies on interprocess communication to resolve potential conflicts between the content of gesture and speech.