Article published In:
GestureVol. 20:3 (2021) ► pp.376–416
Representational gestures correlated with meaning-associated aspects of L2 speech performance
Gesture and speech are closely associated channels involved in conveying meaning. Previous studies have reported the relationship between gesture use and speech performance for highly proficient speakers. This study extends the investigation of this relationship by correlating the representational gesture rate and complexity, accuracy, and fluency measures for L2 speech produced by lower-intermediate-level EFL learners with Chinese as their L1. Three speech tasks were adopted with two activating concrete concepts and one abstract concepts. The results showed that the representational gesture rate was correlated with meaning-associated but not form-associated speech measures for L2 learners, and that the task type did not influence the relationship between gesture and speech. This study suggests that representational gesture use has a close relationship with meaning-related speech measures for lower proficiency L2 speakers when they talk about both concrete and abstract concepts.
Keywords: representational gesture, L2 speech performance, concrete speech content, abstract speech content
Article outline
- Background
- The facilitating effect of representational gestures on speech production
- Representational gestures and speech performance
- Complexity, accuracy, and fluency in L2
- Representational gestures and speech content
- Method
- Participants
- Instruments
- Procedures
- Transcription
- Calculation and coding of speech measures
- Coding and calculation of gesture measures
- Results
- Research question 1: Correlations of the representational gesture rate and speech performance
- Research question 2: Interaction effects of the representational gesture rate and the task type on speech performance
- Discussion
- Correlations of the representational gesture rate and speech performance measures for L2 learners
- Interaction effects of the representational gesture rate and the task type on L2 speech performance
- Conclusion
- Notes
-
References
References
Alibali, Martha W.
(2005) Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation,
5
(4), 307–331. 
Alibali, Martha W., Kita, Sotaro, & Young, Amanda J.
(2000) Gesture and the process of speech production: We think, therefore we gesture. Language & Cognitive Processes,
15
(6), 593–613.
Aziz, Jasmine R. & Nicoladis, Elena
(2019) “My French is rusty”: Proficiency and bilingual gesture use in a majority English community. Bilingualism: Language & Cognition,
22
(4), 826–835.
Boroditsky, Lera
(2000) Metaphoric structuring: Understanding time through spatial metaphors. Cognition,
75
(1), 1–28.
Burns, Patrick, Mccormack, Teresa, Jaroslawska, Agnieszka J., O’Connor, Patrick A., & Caruso, Eugene M.
(2019) Time points: A gestural study of the development of space-time mappings. Cognitive Science,
43
(12).
Cartmill, Erica A. & Goldin-Meadow, Susan
(2016) Gesture. In David Matsumoto, Hyisung C. Hwang, & Mark G. Frank (Eds.), APA handbook of nonverbal communication (pp. 307–333). Washington, DC: American Psychological Association.
Chu, Mingyuan, Meyer, Antje, Foulkes, Lucy, & Kita, Sotaro
(2014) Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology General,
143
(2), 694–709.
Chui, Kawai
(2011) Conceptual metaphors in gesture. Cognitive Linguistics,
22
(3), 437–458.
Cienki, Alan & Müller, Cornelia
Cook, Susan Wagner, Yip, Terina Kuang Yi, & Goldin-Meadow, Susan
(2012) Gestures, but not meaningless movements, lighten working memory load when explaining math. Language & Cognitive Processes,
27
(4), 594–610.
Dewaele, Jean-Marc & Furnham, Adrian
(2000) Personality and speech production: A pilot study of second language learners. Personality & Individual Differences,
28
(2), 355–365.
Ellis, Rod & Barkhuizen, Gary
(2005) Analysing learner language. Oxford: Oxford University Press.
Feyereisen, Pierre & Havard, Isabelle
(1999) Mental imagery and production of hand gestures while speaking in younger and older adults. Journal of Nonverbal Behavior,
23
(2), 153–171.
Forceville, Charles
(2009) Non-verbal and multimodal metaphor in a cognitivist framework: Agendas for research. In Charles J. Forceville & Eduardo Urios-Aparisi (Eds.), Multimodal metaphor (pp. 19–42). Berlin & New York: Mouton de Gruyter.
Foster, Pauline, Tonkyn, Alan, & Wigglesworth, Gillian
(2000) Measuring spoken language: A unit for all reasons. Applied Linguistics, 21 (3), 354–375.
Frick-Horbury, Donna
(2002) The use of hand gestures as self-generated cues for recall of verbally associated targets. The American Journal of Psychology,
115
(1), 1–20.
Goldin-Meadow, Susan
(2003) Hearing gesture: How our hands help us think. Cambridge, MA.: Harvard University Press.
Goldin-Meadow, Susan, Nusbaum, Howard, Kelly, Spencer, & Wagner, Susan
(2001) Explaining math: Gesturing lightens the load. Psychological Science,
12
(6), 516–522.
Gullberg, Marianne
(1998) Gesture as a communication strategy in second language discourse: A study of learners of French and Swedish. Doctoral dissertation, Lund University, Lund.
Hostetter, Autumn B. & Alibali, Martha W.
(2004) On the tip of the mind: Gesture as a key to conceptualization. Proceedings of the Annual Meeting of the Cognitive Science Society,
26
1, 589–594. Retrieved from [URL]
(2007) Raise your hand if you’re spatial: Relations between verbal and spatial skills and gesture production. Gesture, 7 (1), 73–95.
Hostetter, Autumn B., Alibali, Martha W., & Kita, Sotaro
(2007) I see it in my hands’ eye: Representational gestures reflect conceptual demands. Language & Cognitive Processes,
22
(3), 313–336.
Hostetter, Autumn B. & Potthoff, Andrea L.
(2012) Effects of personality and social situation on representational gesture production. Gesture,
12
(1), 63–84.
Johnson, Mark
(1987) The body in the mind: The bodily basis of meaning, imagination, and reason. Chicago: University of Chicago Press.
Kendon, Adam
(2004) Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
Kita, Sotaro, Alibali, Martha W., & Chu, Mingyuan
(2017) How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review,
124
(3), 245–266.
Kita, Sotaro & Davies, Thomas S.
(2009) Competing conceptual representations trigger co-speech representational gestures. Language & Cognitive Processes,
24
(5), 761–775.
Kormos, Judit
(2006) Speech production and second language acquisition. Mahwah, NJ: Lawrence Erlbaum Associates.
Kövecses, Zoltán
(2000) Metaphor and emotion: Language, culture, and body in human feeling. Cambridge: Cambridge University Press.
Krauss, Robert M. & Hadar, Uri
(1999) The role of speech-related arm/hand gestures in word retrieval. In Lynn S. Messing & Ruth Campbell (Eds.), Gesture, speech, and sign (pp. 93–116). Oxford: Oxford University Press.
Lakoff, George
(1987) Women, fire, and dangerous things: What categories reveal about the mind. Chicago: The University of Chicago Press.
(1993) The contemporary theory of metaphor. In Andrew Ortony (Ed.), Metaphor and thought (2nd ed.) (pp. 202–251). Cambridge: Cambridge University Press.
Lakoff, George & Johnson, Mark
(1980) Metaphors we live by. Chicago: The University of Chicago Press.
Laurent, Angélique & Nicoladis, Elena
(2015) Gesture restriction affects French-English bilinguals’ speech only in French. Bilingualism: Language & Cognition,
18
(2), 340–349.
Laurent, Angélique, Nicoladis, Elena, & Marentette, Paula
(2015) The development of storytelling in two languages with words and gestures. International Journal of Bilingualism,
19
(1), 56–74.
Lausberg, Hedda & Sloetjes, Han
(2009) Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers, 41 (3), 841–849.
Lavergne, Joanne & Kimura, Doreen
(1987) Hand movement asymmetry during speech: No effect of speaking topic. Neuropsychologia,
25
(4), 689–693.
Levelt, Willem J. M.
(1989) Speaking: From intention to articulation. Cambridge, MA: MIT Press.
Li, Shaofeng & Fu, Mengxia
(2018) Strategic and unpressured within-task planning and their associations with working memory. Language Teaching Research,
22
(2), 230–253.
Lin, Yen-Liang
(2017) Co-occurrence of speech and gestures: A multimodal corpus linguistic approach to intercultural interaction. Journal of Pragmatics,
117
1, 155–167.
Lindstromberg, Seth
McCarthy, Philip M. & Jarvis, Scott
(2010) MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment. Behavior Research Methods,
42
(2), 381–392.
McNeill, David
(1992) Hand and mind: What the hands reveal about thought. Chicago, IL: University of Chicago Press.
Melinger, Alissa & Kita, Sotaro
(2007) Conceptualization load triggers gesture production. Language & Cognitive Processes,
22
(4), 473–500.
Mori, Souma
(2019) A cognitive analysis of the preposition OVER: Image-schema transformations and metaphorical extensions. Canadian Journal of Linguistics,
64
(3), 444–474.
Morsella, Ezequiel & Krauss, Robert M.
(2004) The role of gestures in spatial working memory and speech. The American Journal of Psychology,
117
(3), 411–424.
Mota, Mailce B.
(2005) Working memory capacity and fluency, accuracy, complexity, and lexical density in L2 speech production. Fragmentos,
24
1, 69–104. Retrieved from [URL]
Nagpal, Jaya, Nicoladis, Elena, & Marentette, Paula
(2011) Predicting individual differences in L2 speakers’ gestures. International Journal of Bilingualism,
15
(2), 205–214.
Nicoladis, Elena, Marentette, Paula, & Navarro, Samuel
(2016) Gesture frequency linked primarily to story length in 4-10-year old children’s stories. Journal of Psycholinguistic Research,
45
(2), 189–204.
Nicoladis, Elena, Mayberry, Rachel I., & Genesee, Fred
(1999) Gesture and early bilingual development. Developmental Psychology,
35
(2), 514–526.
Nicoladis, Elena, Pika, Simone, Yin, Hui, & Marentette, Paula
(2007) Gesture use in story recall by Chinese-English bilinguals. Applied Psycholinguistics,
28
(4), 721–735.
Nicoladis, Elena, Pika, Simone, & Marentette, Paula
(2009) Do French-English bilingual children gesture more than monolingual children? Journal of Psycholinguistic Research,
38
(6), 573–585.
Oya, Taeko, Manalo, Emmanuel, & Greenwood, Jackie
(2004) The influence of personality and anxiety on the oral performance of Japanese speakers of English. Applied Cognitive Psychology,
18
(7), 841–855.
Peng, Jian-E.
(2014) Willingness to communicate in the Chinese EFL university classroom: An ecological perspective. Bristol: Multilingual Matters.
Rauscher, Frances H., Krauss, Robert M., & Chen, Yihsiu
(1996) Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science,
7
(4), 226–231.
Skehan, Peter
(1998) A cognitive approach to language learning. Oxford: Oxford University Press.
(2009) Modelling second language performance: Integrating complexity, accuracy, fluency, and lexis. Applied Linguistics,
30
(4), 510–532.
Skehan, Peter & Foster, Pauline
(1999) The influence of task structure and processing conditions on narrative retellings. Language Learning,
49
(1), 93–120.
(2001) Cognition and tasks. In Peter Robinson (Ed.), Cognition and second language instruction (pp. 183–205). Cambridge: Cambridge University Press.
Smithson, Lisa, Nicoladis, Elena & Marentette, Paula
So, Wing C.
(2010) Cross-cultural transfer in gesture frequency in Chinese-English bilinguals. Language & Cognitive Processes,
25
(10), 1335–1353.
Stam, Gale
(2016) Gesture as a window onto conceptualization in multiple tasks: Implications for second language teaching. Yearbook of the German Cognitive Linguistics Association,
4
(1), 289–314.
Wang, Shouren (王守仁)
(2018) The application of China’s Standards of English Language Ability to college English teaching (中国英语能力等级量表在大学英语教学中的应用).
Foreign Language Education
(《外语教学》),
39
(4), 1–4.
Willems, Roel M., Özyürek, Aslı, & Hagoort, Peter
(2007) When language meets action: The neural integration of gesture and speech. Cerebral Cortex,
17
(10), 2322–2333.
Yuan, Fangyuan & Ellis, Rod
(2003) The effects of pre-task planning and on-line planning on fluency, complexity and accuracy in L2 monologic oral production. Applied Linguistics,
24
(1), 1–27.