Cover not available
Article published In:
Gesture
Vol. 15:1 (2016) ► pp.60–78

Obligatory processing of irrelevant gesture

| A*STAR — Institute of High Performance Computing, Singapore
| Oxford Brookes University

This paper presents a study of selected iconic gestures with a view to determining their effects on RT in a task-relevant and a task-irrelevant context. In two experiments, participants were presented with a coloured shape on a computer screen, a spoken statement referring to the presented shape, and a gesture that was task irrelevant. The findings from both experiments show strong support for the assumption that gesture processing is obligatory; irrelevant gestures affected speed of task performance. Furthermore the findings suggest that for slower, more cognitively controlled decisions incongruent gestures have an inhibitory effect, while for faster, more cognitively automated decisions congruent gestures have a facilitatory effect.

Keywords: obligatory, inhibitory, facilitatory, speech, gesture, relevance, communication
Published online: 19 May 2016
DOI logo
https://doi.org/10.1075/gest.15.1.03fel
References
Barrett, Lisa F., Christine D. Wilson-Mendenhall, & Lawrence W. Barsalou
(2014) A psychological construction account of emotion regulation and dysregulation: The role of situated conceptualizations. In James J. Gross (Ed.), The handbook of emotion regulation (pp. 447–465). New York: Guilford.Google Scholar
Barsalou, Lawrence W
(1999) Perceptual symbol systems. Behavioral & Brain Sciences, 221, 577–660. DOI logoGoogle Scholar
Barsalou, Lawrence W. & Katja Wiemer-Hastings
(2005) Situated abstract concepts. In Diane Pecher & Rolf A. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thinking (pp. 129–163). Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Bergen, Benjamin
(2012) Louder than words: The new science of how the mind makes meaning. New York: Basic Books.Google Scholar
Bernardis, Paolo, Elena Salillas, & Nicoletta Caramelli
(2008) Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 25 (7/8), 1114–1128. DOI logoGoogle Scholar
Bloem, Ineke, Sylvia van den Boogaard, & Wido La Heij
(2004) Semantic facilitation and semantic interference in language production: Further evidence for the conceptual selection model of lexical access. Journal of Memory and Language, 511, 307–323. DOI logoGoogle Scholar
Damasio, Antonio
(1999) The feeling of what happens: Body and emotion in the making of consciousness. New York: Harcourt.Google Scholar
Diederich, Adele & Hans Colonius
(2015) The time window of multisensory integration: Relating reaction times and judgments of temporal order. Psychological Review 2015, Feb 23. Online at [URL], last date of access 20 March 2015. DOI logoGoogle Scholar
Gellatly, Angus R.H. & Vernon H. Gregg
(1974) The effect of set size on the latency to name words. Acta Psychologica, 381, 93–98. DOI logoGoogle Scholar
Gentner, Dedre, Özyürek, Aslı, Özge Gürcanli, & Susan Goldin-Meadow
(2013) Spatial language facilitates spatial cognition: Evidence from children who lack language input. Cognition, 1271, 318–330. DOI logoGoogle Scholar
Gibbs, Raymond W
(2003) Embodied experience and linguistic meaning. Brain & Language, 841, 1–15. DOI logoGoogle Scholar
Gibson, James J
(1979) The ecological approach to visual perception. Hillsday: Erlbaum.Google Scholar
Glenberg, Arthur M. & Michael P. Kaschak
(2002) Grounding language in action. Psychonomic Bulleting & Review, 91, 558–565. DOI logoGoogle Scholar
Hauk, Olaf, Ingrid Johnsrude, & Friedemann Pulvermueller
(2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron, 411, 301–307. DOI logoGoogle Scholar
Holle, Henning & Thomas C. Gunter
(2007) The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19 (7), 1175–1192. DOI logoGoogle Scholar
Hostetter, Autumn B. & Martha W. Alibali
(2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514. DOI logoGoogle Scholar
Kelly, Spencer D., Aslı Özyürek, & Eric Maris
(2010) Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 211, 260–267. DOI logoGoogle Scholar
Kelly, Spencer D., Peter Creigh, & James Bartolotti
(2010) Integrating speech and iconic gestures in a Stroop-like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 221, 683–694. DOI logoGoogle Scholar
Lakoff, George & Mark Johnson
(1980) Metaphors we live by. Chicago: University of Chicago Press.Google Scholar
(1999) Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.Google Scholar
McNamara, Timothy P
(2005) Semantic priming: Perspectives from memory and word recognition. New York: Psychology Press. DOI logoGoogle Scholar
Mayr, Susanne & Alex Buchner
(2007) Negative priming as a memory phenomenon. A review of 20 years of negative priming research. Zeitschrift für Psychologie, 215 (1), 35–51. DOI logoGoogle Scholar
Metta, Giorgio, et al.
(2008) The iCub humanoid robot: An open platform for research in embodied cognition. In Raj Madhavan & Elena R. Messina (Eds.), Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems (pp. 50–56). New York: ACM. DOI logoGoogle Scholar
Neely, James H
(1991) Semantic priming effects in visual word recognition: A selective review of current findings and theories. In Derek Besner & Glyn W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 264–336). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.Google Scholar
Neggers, Bas & Harold Bekkering
(2001) Gaze anchoring to a pointing target is present during the entire pointing movement and is driven by a non-visual signal. Journal of Neurophysiology, 861, 961–970. DOI logoGoogle Scholar
Niebur, Ernst, et al.
(2001) Research, robots, and reality: A statement on current trends in biorobotics. Behavioral and Brain Sciences, 24 (6), 1072–1073. DOI logoGoogle Scholar
Obermeier, Christian & Thomas C. Gunter
(2014) Multisensory integration: The case of a time window of gesture-speech integration. Journal of Cognitive Neuroscience, 27 (2), 292–307. DOI logoGoogle Scholar
Pouw, Wim T.J.L. et al.
(2014) Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5, 359. DOI logoGoogle Scholar
Prinz, Jesse J. & Lawrence W. Barsalou
(2000) Steering a course for embodied representation. In Eric Dietrich & Arthur B. Markman (Eds.), Cognitive dynamics: Conceptual and representational change in humans and machines (pp. 51–77). Cambridge, MA: MIT Press.Google Scholar
Rizzolatti, Giacomo & Laila Craighero
(2004) The mirror neuron system. Annual Review of Neuroscience, 271, 169–192. DOI logoGoogle Scholar
Rizzolatti, Giacomo, Luciano Fadiga, Vittorio Gallese, & Leonardo Fogassi
(1996) Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 31, 131–141. DOI logoGoogle Scholar
Seliger, Herbert
(1980) Utterance planning and correction behavior: Its function in the grammar construction process for second language learners. In Hans W. Dechert & Manfred Raupach (Eds.), Towards a crosslinguistic assessment of speech production (pp. 87–99). Frankfurt am Main, Germany: Peter Lang.Google Scholar
So, Wing-Chee, Alvan Low Yi-Feng, De-Fu Yap, Eugene Kheng, & Ju-Min Melvin Yap
(2013) Iconic gestures prime words: Comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 4, 779. DOI logoGoogle Scholar
Tipper, Steven P
(1985) The negative priming effect: Inhibitory priming by ignored objects. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 37 (4), 571–590. DOI logoGoogle Scholar
Tversky, Barbara & Brigitte M. Hard
(2009) Embodied and disembodied cognition: Spatial perspective taking. Cognition, 1101, 124–129. DOI logoGoogle Scholar
Vacharkulksemsuk, Tanya & Barbara L. Fredrickson
(2012) Strangers in sync: Achieving embodied rapport through shared movements. Journal of Experimental Social Psychology, 481, 399–402. DOI logoGoogle Scholar
Vainiger, Dana, Ludovica Labruna, Richard Ivry, & Michal Lavidor
(2014) Beyond words: Evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes. Psychological Research, 781, 55–69. DOI logoGoogle Scholar
van Dantzig, Saskia, René Zeelenberg, & Diane Pecher
(2009) Unconstraining theories of embodied cognition. Journal of Experimental Social Psychology, 451, 345–351. DOI logoGoogle Scholar
Yap, De-Fu, Wing-Chee So, Yu-Min Melvin Yap, Tan, Ying-Quan, & Ruo-Li Serene Teoh
(2011) Iconic gestures prime words. Cognitive Science, 35 (1), 171–183. DOI logoGoogle Scholar
Ziemke, Tom & Robert Lowe
(2009) On the role of emotion in embodied cognitive architectures: From organisms to robots. Cognitive Computation, 1 (1), 104–117. DOI logoGoogle Scholar
Cited by

Cited by 1 other publications

Walsh, Erin I., Will J. Grant & Ginny M. Sargent
2023. Prose, panels and people: the impact of comic presentation style on procedural information learning. International Journal of Science Education, Part B ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 30 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.