Article published In:
Gesture: Online-First Articles

Do speakers’ gestures affect listeners’ understanding of temporal relationships between events?

| Waseda University
ORCID logo | Waseda University
This study investigated how the direction and movement of gestures affect mental representations of time. Previous research by Tversky and Jamalian (2021) demonstrated that gestures influence how people perceive temporal relationships, with participants’ drawings reflecting the shape (circular or linear) of the gestures they observed. However, the influence of gesture direction was not examined. In the present study, 50 Japanese adults were exposed to different types of gestures, including leftward and rightward linear or circular gestures. Participants were then asked to draw diagrams representing the temporal flow of events. The results showed significant associations between the type of gesture and the participants’ drawings. Specifically, the direction and form of the gestures — whether leftward or rightward, linear or circular — significantly influenced how participants depicted temporal relationships. These findings highlight the importance of both gesture direction and movement in shaping individuals’ mental representations of time.
Keywords: co-speech gestures, temporal relationship, time metaphor, multimodal integration
Article outline
  • Background
  • Method
    • Participants
    • Experimental design
    • Experimental material
    • Experimental equipment
    • Procedure
  • Results
    • Relationship between gesture type and drawing response
    • Analysis of diagrams drawn by experimental participants
    • Analysis of congruence between the presented gesture and drawn response
  • Discussion
    • Pattern of responses
    • Congruence
    • Relationship with story content
    • Future directions
  • References
Published online: 30 September 2024
DOI logo
https://doi.org/10.1075/gest.23020.yos
References (20)
References
Alcaraz Carrión, D. & Valenzuela, J. (2021). Distant time, distant gesture: speech and gesture correlate to express temporal distance. Semiotica, 2411, 159–183. DOI logoGoogle Scholar
Boroditsky, L., & Ramscar, M. (2002). The roles of body and mind in abstract thought. Psychological Science, 13(2), 185–189. DOI logoGoogle Scholar
Bergen, B. K., & Lau, T. T. C. (2012). Writing direction affects how people map space onto time. Frontiers in psychology, 3, 109, 1–5. DOI logoGoogle Scholar
Callizo-Romero, C., Tutnjević, S., Pandza, M., Ouellet, M., Kranjec, A., Ilić, S., Gu, Y., Göksun, T., Chahboun, S., Casasanto, D., & Santiago, J. (2022). Does time extend asymmetrically into the past and the future? A multitask crosscultural study. Language and Cognition, 14(2), 275–302. DOI logoGoogle Scholar
Casasanto, D., & Bottini, R. (2014). Spatial language and abstract concepts. WIREs Cognitive Science, 51, 139–149. DOI logoGoogle Scholar
Casasanto, D., & Jasmin, K. (2012). The hands of time: Temporal gestures in English speakers. Cognitive Linguistics, 23(4), 643–674. DOI logoGoogle Scholar
Clark, H. H. (1973). Space, time, semantics, and the child. In T. E. Moore (Ed.), Cognitive development and the acquisition of language (pp. 27–63). New York: Academic Press. DOI logoGoogle Scholar
de la Fuente, J., Santiago, J., Román, A., Dumitrache, C., & Casasanto, D. (2014). When you think about it, your past is in front of you: How culture shapes spatial conceptions of time. Psychological Science, 25(9), 1682–1690. DOI logoGoogle Scholar
Feist, M. I., & Duffy, S. E. (2023). To each their own: A review of individual differences and metaphorical perspectives on time. Frontiers in Psychology. 141:1213719. DOI logoGoogle Scholar
Gu, Y., Mol, L., Hoetjes, H., & Swerts, M. (2017). Conceptual and lexical effects on gestures: The case of vertical spatial metaphors for time in Chinese. Language, Cognition and Neuroscience, 32(8), 1048–1063. DOI logoGoogle Scholar
Kugelmass, S. & Lieblich, A. (1979). Impact of learning to read on directionality in perception: A further cross-cultural analysis. Human development, 22(6), 406–415. DOI logoGoogle Scholar
Miles, L. K., Tan, L., Noble, G. D. (2011). Can a mind have two time lines? Exploring space-time mapping in Mandarin and English speakers. Psychonomic Bulletin & Review, 181, 598–604. DOI logoGoogle Scholar
Núñez, R. E., Cooperrider, K., Doan, D., & Wassmann, J. (2012). Contours of time: Topographic construals of past, present, and future in the Yupno Valley of Papua New Guinea. Cognition, 124(1), 25–35. DOI logoGoogle Scholar
Núñez, R. E., Motz, B. A., & Teuscher, U. (2006). Time after time: The psychological reality of the ego — and time-reference-point distinction in metaphorical construals of time. Metaphor and Symbol, 21 (3), 133–146. DOI logoGoogle Scholar
Pagán Cánovas, C., Valenzuela, J., Alcaraz Carrión, D., Olza, I., & Ramscar, M. (2020). Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions. PLOS ONE 15(6): e0233892. DOI logoGoogle Scholar
Sekine, K., Sowden, H., & Kita, S. (2015). The Development of the ability to semantically integrate information in speech and iconic gesture in comprehension. Cognitive Science, 39 (8), 1855–1880. DOI logoGoogle Scholar
Stites, L., & Özçalışkan, Ş. (2021). The time is at hand: literacy predicts changes in children’s gestures about time. Journal of Psycholinguistic Research, 501, 967–983. DOI logoGoogle Scholar
Tversky, B., & Jamalian, A. (2021). Thinking tools: gestures change thought about time. Topics in Cognitive Science, 131, 750–776. DOI logoGoogle Scholar
Tversky, B., Kugelmass, S., & Winter, A. (1991). Cross-cultural and developmental trends in graphic productions. Cognitive Psychology, 23(4), 515–557. DOI logoGoogle Scholar
Winter, B., & Duffy, S. E. (2020). Can co-speech gestures alone carry the mental time line? Journal of Experimental Psychology: Learning, Memory, and Cognition, 46(9), 1768–1781. DOI logoGoogle Scholar