The study investigates the consistency and divergence between language and gesture in the expression of spatial orientations in the metaphorical conceptualization of sequence time, and the influence of the diversity in the reading and writing practices used in Taiwan on the spatialization of earlier and later events across modalities. The study was based on Chinese conversational data in face-to-face communication. The spontaneous gestures occurring along with speech reveal real-time metaphorical conceptualization in the context of use. It was found that the spatial orientations that are consistent between the two modalities bear out the online activation of the universal front-back and the culture-specific up-down concepts in the source domains. When speech and gesture are not redundant, the divergence reflects the more complex temporal spatialization involving two timelines or different orientations on the same timeline. The most preferred cross-modal combination of two timelines is the co-occurrence of lateral gestures and the front-back spatial words. Finally, the two different directions in which Chinese characters can be read and written were found to affect people’s conceptualization of the earlier or later event as being rightward or leftward.
(2006) Hand gestures and facial displays as part of language use in face-to-face dialogue. In Valerie Manusov & Miles L. Patterson (Eds.), Handbook of nonverbal communication (pp. 97–15). Thousand Oaks, CA: Sage.
Bergen, Benjamin K. & Ting Ting Chan Lau
(2012) Writing direction affects how people map space onto time. Frontiers in Psychology, 31 (April), 1–5.
(2000) Metaphoric structuring: Understanding time through spatial metaphors. Cognition, 751, 1–28.
(2001) Does language shape thought? Mandarin and English speakers’ conceptions of time. Cognitive Psychology, 431, 1–22.
Boroditsky, Lera & Michael Ramscar
(2002) The roles of body and mind in abstract thought. Psychological Science, 131, 185–189.
Boroditsky, Lera & Alice Gaby
(2010) Remembrances of times East: absolute spatial representations of time in an Australian aboriginal community. Psychological Science, 21 (11), 1635–1639.
Boroditsky, Lera, Orly Fuhrman, & Kelly McCormick
(2011) Do English and Mandarin speakers think about time differently?Cognition, 118 (1), 123–129.
Casasanto, Daniel & Kyle Jasmin
(2012) The hands of time: Temporal gesture in English speakers. Cognitive Linguistics, 23 (4), 643–674.
Chan, Ting Ting & Benjamin Bergen
(2005) Writing direction influences spatial cognition. In Bruno G. Bara, Lawrence Barsalou, & Monica Bucciarelli (Eds.), Proceedings of the Twenty-seventh Annual Conference of the Cognitive Science Society (pp. 412–417). Mahwah, NJ: Lawrence Erlbaum.
(2011) Conceptual metaphors in gesture. Cognitive Linguistics, 22 (3), 437–458.
Chui, Kawai & Huei-ling Lai
(2008) The NCCU Corpus of Spoken Chinese: Mandarin, Hakka, and Southern Min. Taiwan Journal of Linguistics, 6 (2), 119–144.
Chui, Kawai, Huei-ling Lai, & Hui-chen Chan
(2017) The Taiwan Spoken Chinese Corpus. In Rint Sybesma (Ed.), Encyclopedia of Chinese language and linguistics (pp. 257–259). Boston: Brill.
(1998) Metaphoric gestures and some of their relations to verbal metaphorical expressions. In Jean-Pierre Koenig (Ed.), Discourse and cognition (pp. 189–205). Stanford, CA: CSLI Publication.
Cienki, Alan & Cornelia Müller
(2008) Metaphor, gesture, and thought. In Raymond W. Gibbs Jr. (Ed.), The Cambridge handbook of metaphor and thought (pp. 483–501). New York: Cambridge University Press.
Clark, Herbert H.
(1996) Using language. Cambridge: Cambridge University Press.
Woodin, Greg, Bodo Winter, Marcus Perlman, Jeannette Littlemore, Teenie Matlock & Dennis Tay
2020. 'Tiny numbers' are actually tiny: Evidence from gestures in the TV News Archive. PLOS ONE 15:11 ► pp. e0242142 ff.
This list is based on CrossRef data as of 20 may 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.