The study investigates the consistency and divergence between language and gesture in the expression of spatial orientations in the metaphorical conceptualization of sequence time, and the influence of the diversity in the reading and writing practices used in Taiwan on the spatialization of earlier and later events across modalities. The study was based on Chinese conversational data in face-to-face communication. The spontaneous gestures occurring along with speech reveal real-time metaphorical conceptualization in the context of use. It was found that the spatial orientations that are consistent between the two modalities bear out the online activation of the universal front-back and the culture-specific up-down concepts in the source domains. When speech and gesture are not redundant, the divergence reflects the more complex temporal spatialization involving two timelines or different orientations on the same timeline. The most preferred cross-modal combination of two timelines is the co-occurrence of lateral gestures and the front-back spatial words. Finally, the two different directions in which Chinese characters can be read and written were found to affect people’s conceptualization of the earlier or later event as being rightward or leftward.
Bavelas, Janet Beavin & Nicole Chovil (2006). Hand gestures and facial displays as part of language use in face-to-face dialogue. In Valerie Manusov & Miles L. Patterson (Eds.), Handbook of nonverbal communication (pp. 97–15). Thousand Oaks, CA: Sage.
Bergen, Benjamin K. & Ting Ting Chan Lau (2012). Writing direction affects how people map space onto time. Frontiers in Psychology, 31 (April), 1–5.
Boroditsky, Lera (2000). Metaphoric structuring: Understanding time through spatial metaphors. Cognition, 751, 1–28.
Boroditsky, Lera (2001). Does language shape thought? Mandarin and English speakers’ conceptions of time. Cognitive Psychology, 431, 1–22.
Boroditsky, Lera & Michael Ramscar (2002). The roles of body and mind in abstract thought. Psychological Science, 131, 185–189.
Boroditsky, Lera & Alice Gaby (2010). Remembrances of times East: absolute spatial representations of time in an Australian aboriginal community. Psychological Science, 21 (11), 1635–1639.
Boroditsky, Lera, Orly Fuhrman, & Kelly McCormick (2011). Do English and Mandarin speakers think about time differently?Cognition, 118 (1), 123–129.
Casasanto, Daniel & Kyle Jasmin (2012). The hands of time: Temporal gesture in English speakers. Cognitive Linguistics, 23 (4), 643–674.
Chan, Ting Ting & Benjamin Bergen (2005). Writing direction influences spatial cognition. In Bruno G. Bara, Lawrence Barsalou, & Monica Bucciarelli (Eds.), Proceedings of the Twenty-seventh Annual Conference of the Cognitive Science Society (pp. 412–417). Mahwah, NJ: Lawrence Erlbaum.
Chui, Kawai & Huei-ling Lai (2008). The NCCU Corpus of Spoken Chinese: Mandarin, Hakka, and Southern Min. Taiwan Journal of Linguistics, 6 (2), 119–144.
Chui, Kawai, Huei-ling Lai, & Hui-chen Chan (2017). The Taiwan Spoken Chinese Corpus. In Rint Sybesma (Ed.), Encyclopedia of Chinese language and linguistics (pp. 257–259). Boston: Brill.
Cienki, Alan (1998). Metaphoric gestures and some of their relations to verbal metaphorical expressions. In Jean-Pierre Koenig (Ed.), Discourse and cognition (pp. 189–205). Stanford, CA: CSLI Publication.
Cienki, Alan & Cornelia Müller (2008). Metaphor, gesture, and thought. In Raymond W. Gibbs Jr. (Ed.), The Cambridge handbook of metaphor and thought (pp. 483–501). New York: Cambridge University Press.
Clark, Herbert H. (1996). Using language. Cambridge: Cambridge University Press.
Emmorey, Karen (2002). Language, cognition and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum Associates.
Fuhrman, Orly & Lera Boroditsky (2010). Cross-cultural differences in mental representations of time: evidence from an implicit nonlinguistic task. Cognitive Science, 34 (8), 1430–1451.
Gallese, Vittorio & George Lakoff (2005). The brain’s concepts: The role of the sensory–motor system in conceptual knowledge. Cognitive Neuropsychology, 22 (3/4), 455–479.
Gibbs, Raymond W. (2006). Embodiment and cognitive science. New York: Cambridge University Press.
Gibbs, Raymond W. (2013). Walking the walk while thinking about the talk: Embodied interpretation of metaphorical narratives. Journal of Psycholinguistic Research, 42 (4), 363–378.
Gu, Yan, Lisette Mol, Marieke Hoetjes, & Marc Swerts (2017). Conceptual and lexical effects on gestures: The case of vertical spatial metaphors for time in Chinese. Language, Cognition and Neuroscience, 32 (8), 1048–1063.
Kendon, Adam (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
Lakoff, George & Mark Johnson (1980). Metaphors we live by. Chicago: University of Chicago Press.
Lakoff, George & Mark Johnson (1999). Philosophy in the flesh: The embodied mind and its challenge to Western thought. New York: Basic Books.
Lakoff, George & Mark Turner (1989). More cool than reason: A field guide to poetic metaphor. Chicago: University of Chicago Press.
Le Guen, Olivier, Pool Balam, & Lorena Ildefonsa (2012). No metaphorical timeline in gesture and cognition among Yucatec Mayas. Frontiers in Psychology, 31, 271.
McNeill, David (1992). Hand and mind. Chicago: University of Chicago Press.
McNeill, David (Ed.) (2000). Language and gesture. Cambridge: Cambridge University Press.
McNeill, David (2005). Gesture and thought. Chicago: University of Chicago Press.
Núñez, Rafael & Eve Sweetser (2006). With the future behind them: Convergent evidence from Aymara language and gesture in the crosslinguistic comparison of spatial construals of time. Cognitive Science, 30 (3), 1–49.
Núñez, Rafael, Benjamin A. Motz, & Ursina Teuscher (2006). Time after time: The psychological reality of the Ego-and Time-Reference-Point distinction in metaphorical construals of time. Metaphor and Symbol, 211, 133–146.
Núñez, Rafael, Kensy Cooperrider, D. Doan, & Jürg Wassmann (2012). Contours of time: Topographic construals of past, present, and future in the Yupno valley of Papua New Guinea. Cognition, 124 (1), 25–35.
Núñez, Rafael & Kensy Cooperrider (2013). The tangle of space and time in human cognition. Trends in Cognitive Sciences, 17 (5), 220–229.
Ouellet, Marc, Julio Santiago, Ziv Israeli, & Shai Gabay (2010). Is the future the right time?Experimental Psychology, 571, 308–314.
Sacks, Harvey, Emanuel A. Schegloff, & Gail Jefferson (1974). A simplest systematics for the organization of turn–taking for conversation. Language, 501, 696–735.
Santiago, Julio, Juan Lupáñez, Elvira Pérez, & María Jesús Funes (2007). Time (also) flies from left to right. Psychonomic Bulletin & Review, 14 (3), 512–516.
Santiago, Julio, Antonio Román, Marc Ouellet, Nieves Rodríguez, & Pilar Pérez-Azor (2010). In hindsight, life flows from left to right. Psychological Research, 74 (1), 59–70.
Stivers, Tanya, Nick J. Enfield, Penelope Brown, Christina Englert, Makoto Hayashi, Trine Heinemann, Gertie Hoymann, Federico Rossano, Jan Peter de Ruiter, Kyung-Eun Yoon, & Stephen C. Levinson (2009). Universals and cultural variation in turn-taking in conversation. Proceedings of the National Academy of Sciences of the United States of America, 106 (26), 10587–10592.
Sullivan, Karen & Linh Thuy Bui (2016). With the future coming up behind them: Evidence that time approaches from behind in Vietnamese. Cognitive Linguistics, 27 (2), 205–233.
Torralbo, Ana, Julio Santiago, & Juan Lupiáñez (2006). Flexible conceptual projection of time onto spatial frames of reference. Cognitive Science, 30 (4), 745–757.
Tversky, Barbara, Sol Kugelmass, & Atalia Winter (1991). Cross-cultural and developmental trends in graphic productions. Cognitive Psychology, 23 (4), 515–557.
Walker, Esther & Kensy Cooperrider (2016). The continuity of metaphor: Evidence from temporal gestures. Cognitive Science, 401, 481–495.
This list is based on CrossRef data as of 2 august 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.