Article published In:
GestureVol. 15:1 (2016) ► pp.60–78
Obligatory processing of irrelevant gesture
This paper presents a study of selected iconic gestures with a view to determining their effects on RT in a task-relevant and a task-irrelevant context. In two experiments, participants were presented with a coloured shape on a computer screen, a spoken statement referring to the presented shape, and a gesture that was task irrelevant. The findings from both experiments show strong support for the assumption that gesture processing is obligatory; irrelevant gestures affected speed of task performance. Furthermore the findings suggest that for slower, more cognitively controlled decisions incongruent gestures have an inhibitory effect, while for faster, more cognitively automated decisions congruent gestures have a facilitatory effect.
References (40)
Barrett, Lisa F., Christine D. Wilson-Mendenhall, & Lawrence W. Barsalou (2014). A psychological construction account of emotion regulation and dysregulation: The role of situated conceptualizations. In James J. Gross (Ed.), The handbook of emotion regulation (pp. 447–465). New York: Guilford.
Barsalou, Lawrence W. (1999). Perceptual symbol systems. Behavioral & Brain Sciences, 221, 577–660.
Barsalou, Lawrence W. & Katja Wiemer-Hastings (2005). Situated abstract concepts. In Diane Pecher & Rolf A. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thinking (pp. 129–163). Cambridge: Cambridge University Press.
Bergen, Benjamin (2012). Louder than words: The new science of how the mind makes meaning. New York: Basic Books.
Bernardis, Paolo, Elena Salillas, & Nicoletta Caramelli (2008). Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 25 (7/8), 1114–1128.
Bloem, Ineke, Sylvia van den Boogaard, & Wido La Heij (2004). Semantic facilitation and semantic interference in language production: Further evidence for the conceptual selection model of lexical access. Journal of Memory and Language, 511, 307–323.
Damasio, Antonio (1999). The feeling of what happens: Body and emotion in the making of consciousness. New York: Harcourt.
Diederich, Adele & Hans Colonius (2015). The time window of multisensory integration: Relating reaction times and judgments of temporal order. Psychological Review, 2015, Feb 23. Online at [URL], last date of access 20 March 2015.
Gellatly, Angus R.H. & Vernon H. Gregg (1974). The effect of set size on the latency to name words. Acta Psychologica, 381, 93–98.
Gentner, Dedre, Özyürek, Aslı, Özge Gürcanli, & Susan Goldin-Meadow (2013). Spatial language facilitates spatial cognition: Evidence from children who lack language input. Cognition, 1271, 318–330.
Gibbs, Raymond W. (2003). Embodied experience and linguistic meaning. Brain & Language, 841, 1–15.
Gibson, James J. (1979). The ecological approach to visual perception. Hillsday: Erlbaum.
Glenberg, Arthur M. & Michael P. Kaschak (2002). Grounding language in action. Psychonomic Bulleting & Review, 91, 558–565.
Hauk, Olaf, Ingrid Johnsrude, & Friedemann Pulvermueller (2004). Somatotopic representation of action words in human motor and premotor cortex. Neuron, 411, 301–307.
Holle, Henning & Thomas C. Gunter (2007). The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19 (7), 1175–1192.
Hostetter, Autumn B. & Martha W. Alibali (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514.
Kelly, Spencer D., Aslı Özyürek, & Eric Maris (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 211, 260–267.
Kelly, Spencer D., Peter Creigh, & James Bartolotti (2010). Integrating speech and iconic gestures in a Stroop-like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 221, 683–694.
Lakoff, George & Mark Johnson (1980). Metaphors we live by. Chicago: University of Chicago Press.
Lakoff, George & Mark Johnson (1999). Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.
McNamara, Timothy P. (2005). Semantic priming: Perspectives from memory and word recognition. New York: Psychology Press.
Mayr, Susanne & Alex Buchner (2007). Negative priming as a memory phenomenon. A review of 20 years of negative priming research. Zeitschrift für Psychologie, 215 (1), 35–51.
Metta, Giorgio, et al. (2008). The iCub humanoid robot: An open platform for research in embodied cognition. In Raj Madhavan & Elena R. Messina (Eds.), Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems (pp. 50–56). New York: ACM.
Neely, James H. (1991). Semantic priming effects in visual word recognition: A selective review of current findings and theories. In Derek Besner & Glyn W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 264–336). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
Neggers, Bas & Harold Bekkering (2001). Gaze anchoring to a pointing target is present during the entire pointing movement and is driven by a non-visual signal. Journal of Neurophysiology, 861, 961–970.
Niebur, Ernst, et al. (2001). Research, robots, and reality: A statement on current trends in biorobotics. Behavioral and Brain Sciences, 24 (6), 1072–1073.
Obermeier, Christian & Thomas C. Gunter (2014). Multisensory integration: The case of a time window of gesture-speech integration. Journal of Cognitive Neuroscience, 27 (2), 292–307.
Pouw, Wim T.J.L. et al. (2014). Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5, 359.
Prinz, Jesse J. & Lawrence W. Barsalou (2000). Steering a course for embodied representation. In Eric Dietrich & Arthur B. Markman (Eds.), Cognitive dynamics: Conceptual and representational change in humans and machines (pp. 51–77). Cambridge, MA: MIT Press.
Rizzolatti, Giacomo & Laila Craighero (2004). The mirror neuron system. Annual Review of Neuroscience, 271, 169–192.
Rizzolatti, Giacomo, Luciano Fadiga, Vittorio Gallese, & Leonardo Fogassi (1996). Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 31, 131–141.
Seliger, Herbert (1980). Utterance planning and correction behavior: Its function in the grammar construction process for second language learners. In Hans W. Dechert & Manfred Raupach (Eds.), Towards a crosslinguistic assessment of speech production (pp. 87–99). Frankfurt am Main, Germany: Peter Lang.
So, Wing-Chee, Alvan Low Yi-Feng, De-Fu Yap, Eugene Kheng, & Ju-Min Melvin Yap (2013). Iconic gestures prime words: Comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 4, 779.
Tipper, Steven P. (1985). The negative priming effect: Inhibitory priming by ignored objects. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 37 (4), 571–590.
Tversky, Barbara & Brigitte M. Hard (2009). Embodied and disembodied cognition: Spatial perspective taking. Cognition, 1101, 124–129.
Vacharkulksemsuk, Tanya & Barbara L. Fredrickson (2012). Strangers in sync: Achieving embodied rapport through shared movements. Journal of Experimental Social Psychology, 481, 399–402.
Vainiger, Dana, Ludovica Labruna, Richard Ivry, & Michal Lavidor (2014). Beyond words: Evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes. Psychological Research, 781, 55–69.
van Dantzig, Saskia, René Zeelenberg, & Diane Pecher (2009). Unconstraining theories of embodied cognition. Journal of Experimental Social Psychology, 451, 345–351.
Yap, De-Fu, Wing-Chee So, Yu-Min Melvin Yap, Tan, Ying-Quan, & Ruo-Li Serene Teoh (2011). Iconic gestures prime words. Cognitive Science, 35 (1), 171–183.
Ziemke, Tom & Robert Lowe (2009). On the role of emotion in embodied cognitive architectures: From organisms to robots. Cognitive Computation, 1 (1), 104–117.
Cited by (1)
Cited by one other publication
Walsh, Erin I., Will J. Grant & Ginny M. Sargent
2023.
Prose, panels and people: the impact of comic presentation style on procedural information learning.
International Journal of Science Education, Part B ► pp. 1 ff.
This list is based on CrossRef data as of 2 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.