We examined the cognitive resources
involved in processing speech with gesture compared to the same speech without
gesture across four studies using a dual-task paradigm. Participants viewed videos of a woman describing
spatial arrays either with gesture or without. They then attempted to choose the
target array from among four choices. Participants’ cognitive load was measured
as they completed this comprehension task by measuring how well they could
remember the location and identity of digits in a secondary task. We found that addressees experience additional visuospatial load when processing gestures compared to speech alone, and that the load primarily comes when addressees attempt to use their memory of the descriptions with gesture to choose the target array. However,
this cost only occurs when gestures about horizontal spatial relations (i.e.,
left and right) are produced from the speaker’s egocentric perspective.
2022. Visuospatial Working Memory and Understanding Co-Speech Iconic Gestures: Do Gestures Help to Paint a Mental Picture?. Discourse Processes 59:4 ► pp. 275 ff.
Yuan, Qingshu, Keming Chen, Qihao Yang, Zhigeng Pan, Jin Xu & Zhengwei Yao
2023. Exploring Intuitive Visuo-Tactile Interaction Design for Culture Education: A Chinese-Chess-Based Case Study. International Journal of Human–Computer Interaction► pp. 1 ff.
Yuan, Qingshu, Ruonan Wang, Zhigeng Pan, QianYu Meng, Shuchang Xu, Zihan Wang & Jiaxin Liu
2022. TIPTAB: A tangible interactive projection tabletop for virtual experiments. Computer Applications in Engineering Education 30:5 ► pp. 1350 ff.
Özer, Demet & Tilbe Göksun
2020. Gesture Use and Processing: A Review on Individual Differences in Cognitive Resources. Frontiers in Psychology 11
This list is based on CrossRef data as of 28 january 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.