Article published In:
GestureVol. 21:2/3 (2022) ► pp.167–200
Gestures are modulated by social context
A study of multimodal politeness across two cultures
This paper investigates gesture as a resource for marking politeness-related meanings. We asked 14 Korean and 14 Catalan participants to retell a cartoon, once to an unknown superior and once to a close friend. Participants in both languages curtail gestures when interacting with a socially distant superior. Speakers of both languages produced fewer gestures when addressing the superior, reduced their gesture space, decreased the encoding of manner, and reduced the use of character-viewpoint gestures. We see the decrease in gesture frequency and the less frequent encoding of manner as indicators of lower levels of iconicity when talking with status superiors. Curtailing gesture marks a less playful communicative context, and a more serious and deferential persona. Altogether, our research speaks to the importance of politeness in gesture production, and the social nature of gestures in human communication.
Keywords: iconicity, perspective, pragmatics, social deixis, audience design, social distance
Article outline
- Introduction
- Background
- The multimodality of politeness
- Gesture variation
- Gesturing in different languages and cultures
- Methodology
- Data collection
- Procedure
- Participants
- Coding and analysis
- Statistical analysis
- Results
- Gesture frequency
- Gesture size
- Two-handed gestures
- Hand configuration
- path, manner and ground
- Viewpoint
- General discussion
- Conclusion
- Acknowledgements
- Notes
-
References
References
Alibali, Martha W. & Don, Lisa S.
Allen, Shanley, Özyürek, Aslı, Kita, Sotaro, Brown, Amanda, Furman, Reyhan, Ishizuka, Tomoko, & Fujii, Mihoko
(2007) Language-specific and universal influences in children’s syntactic packaging of manner and path: A comparison of English, Japanese, and Turkish. Cognition,
102
(1), 16–48. 
Bavelas, Janet, Gerwing, Jennifer, Sutton, Chantelle, & Prevost, Danielle
(2008) Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language,
58
(2), 495–520.
Bavelas, Janet & Healing, Sara
Beattie, Geoffrey & Aboudan, Rima
(1994) Gestures, pauses and speech: An experimental investigation of the effects of changing social context on their precise temporal relationships. Semiotica,
99
(3/4), 239–272.
Beattie, Geoffrey & Shovelton, Heather
(2002) An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology,
93
(2), 179–192.
Beaulieu, Catherine
(2004) Intercultural study of personal space: A case study. Journal of Applied Social Psychology,
34
(4), 794–805.
Blokpoel, Mark, van Kesteren, Marlieke, Stolk, Arjen, Haselager, Pim, Toni, Ivan, & Van Rooij, Iris
(2012) Recipient design in human communication: Simple heuristics or perspective taking? Frontiers in Human Neuroscience,
6
1, 253.
Brown, Amanda & Chen, Jidong
(2013) Construal of Manner in speech and gesture in Mandarin, English, and Japanese. Cognitive Linguistics,
24
(4), 605–631.
Brown, Lucien
(2011) Korean honorifics and politeness in second language learning. Amsterdam & Philadelphia: John Benjamins Publishing Company.
(2015) Honorifics and politeness. In Lucien Brown & Jaehoon Yeon (Eds.), The handbook of Korean linguistics (pp. 303–319). New York: Wiley.
Brown, Lucien & Prieto, Pilar
(2017) (Im)politeness: Prosody and gesture. In Jonathan Culpeper, Michael Haugh, & Daniel Kádár (Eds.), The Palgrave handbook of linguistic (im)politeness (pp. 357–379). London: Palgrave Macmillan.
Brown, Lucien & Winter, Bodo
(2019) Multimodal indexicality in Korean: “Doing deference” and “performing intimacy” through nonverbal behavior. Journal of Politeness Research,
15
(1), 25–54.
Brown, Lucien, Winter, Bodo, Idemaru, Kaori, & Grawunder, Sven
(2014) Phonetics and politeness: Perceiving Korean honorific and non-honorific speech through phonetic cues. Journal of Pragmatics,
66
1, 45–60.
Brown, Penelope
(2015) Politeness and language. In James D. Wright (Ed.), The international encyclopedia of the social and behavioral sciences (IESBS) (2nd Ed., Vol. 181, pp. 326–330). Amsterdam: Elsevier.
Brown, Penelope & Levinson, Stephen
(1987) Politeness: Some universals in language usage. Cambridge: Cambridge University Press.
Burgoon, Judee K. & Dunbar, Norah E.
(2006) Nonverbal expressions of dominance and power in human relationships. In Valerie Manusov & Miles L. Patterson (Eds.), The Sage handbook of nonverbal communication (pp. 279–297). Thousand Oaks, CA: Sage Publishers.
Bürkner, Paul-Christian
(2017) brms: An R package for Bayesian multilevel models using Stan. Journal of Statistical Software,
80
(1), 1–28.
Christie, Christine
(2018) The indexical scope of adios: A relevance theoretic analysis of discursive constructions of gender and institutions and their impact on utterance interpretation. Journal of Politeness Research,
14
(1), 97–119.
Chu, Mingyuan, Meyer, Antje, Foulkes, Lucy, & Kita, Sotaro
(2014) Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology: General,
143
(2), 694–709.
Cook, Haruko Minegishi
(2008) Socializing identities through speech style: Learners of Japanese as a foreign language. Bristol: Multilingual Matters.
Dalmau, Maria Sabaté i & Gotor, Hortènsia Curell i
(2007) From “Sorry very much” to “I’m ever so sorry”: Acquisitional patterns in L2 apologies by Catalan learners of English. Intercultural Pragmatics,
4
(2), 287–315.
Dennison, Heeyon Y. & Bergen, Benjamin K.
(2010) Language-driven motor simulation is sensitive to social context. Proceedings of the Annual Meeting of the Cognitive Science Society,
32
1, 901–906.
Dingemanse, Mark & Thompson, Bill
(2020) Playful iconicity: Structural markedness underlies the relation between funniness and iconicity. Language and Cognition,
12
(1), 203–224.
ELAN (Version 6.0)
(2020) Nijmeden: Max Planck Institute for Psycholinguistics.
Galati, Alexia & Brennan, Susan E.
(2014) Speakers adapt gestures to addressees’ knowledge: Implications for models of co-speech gesture. Language, Cognition and Neuroscience,
29
(4), 435–451.
Goldin-Meadow, Susan & Saltzman, Jody
(2000) The cultural bounds of maternal accommodation: How Chinese and American mothers communicate with deaf and hearing children. Psychological Science,
11
(4), 307–314.
Goldsmith, Daena J.
(2007) Brown and Levinson’s politeness theory. In Bryan B. Whaley & Wendy Samter (Eds.), Explaining communication: Contemporary theories and exemplars (pp. 219–236). Mahwah, NJ: Erlbaum.
Guerrero, Laura K. & Floyd, Kory
(2006) Nonverbal communication in close relationships. Mahwah, NJ: Erlbaum.
Holler, Judith, Tutton, Mark, & Wilkin, Katie
(2011) Co-speech gestures in the process of meaning coordination. In 2nd Gesture & Speech in Interaction (GeSpin). [URL]
Holler, Judith & Wilkin, Katie
(2009) Communicating common ground: How mutually shared knowledge influences speech and gesture in a narrative task. Language and Cognitive Processes,
24
(2), 267–289.
Holtgraves, Thomas & Yang, Joong-Nam
(1992) Interpersonal underpinnings of request strategies: General principles and differences due to culture and gender. Journal of Personality and Social Psychology,
62
(2), 246.
Hübscher, Iris, Borràs-Comes, Joan, & Prieto, Pilar
(2017) Prosodic mitigation characterizes Catalan formal speech: The Frequency Code reassessed. Journal of Phonetics,
65
1, 145–159.
Hübscher, Iris, Sánchez-Conde, Cristina, Borràs-Comes, Joan, Vincze, Laura, & Prieto, Pilar
forthcoming). Multimodal mitigation: How facial and body cues index social meaning in Catalan requests. Journal of Politeness Research.
Idemaru, Kaori, Winter, Bodo, & Brown, Lucien
(2019) Cross-cultural multimodal politeness: The phonetics of Japanese deferential speech in comparison to Korean. Intercultural Pragmatics,
16
(5), 517–555.
Idemaru, Kaori, Winter, Bodo, Brown, Lucien, & Oh, Grace Eunhae
(2020) Loudness trumps pitch in politeness judgments: Evidence from Korean deferential speech. Language and Speech,
63
(1), 123–148.
Iverson, Jana M., Capirci, Olga, Volterra, Virginia, & Goldin-Meadow, Susan
(2008) Learning to talk in a gesture-rich world: Early communication in Italian vs. American children. First Language,
28
(2), 164–181.
Jacobs, Naomi & Garnham, Alan
(2007) The role of conversational hand gestures in a narrative task. Journal of Memory and Language,
56
(2), 291–303.
Kádár, Dániel Z. & Haugh, Michael
(2013) Understanding politeness. Cambridge: Cambridge University Press.
Kelly, Spencer, Byrne, Kelly, & Holler, Judith
(2011) Raising the ante of communication: Evidence for enhanced gesture use in high stakes situations. Information,
2
(4), 579–593.
Kiesling, Scott F.
(2004) Dude. American Speech,
79
(3), 281–305.
Kita, Sotaro
(2000) How representational gestures help speaking. Language and Gesture,
1
1, 162–185.
(2009) Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes,
24
(2), 145–167.
Kita, Sotaro & Essegbey, James
(2001) Pointing left in Ghana: How a taboo on the use of the left hand influences gestural practice. Gesture,
1
(1), 73–95.
Kita, Sotaro & Ide, Sachiko
(2007) Nodding, aizuchi, and final particles in Japanese conversation: How conversation reflects the ideology of communication and social relationships. Journal of Pragmatics,
39
(7), 1242–1254.
Kita, Sotaro & Özyürek, Aslı
(2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language,
48
(1), 16–32.
Koo, Jasook
(1995) Politeness theory: Universality and specificity. Doctoral dissertation, Harvard University, Cambridge, MA.
Krahmer, Emiel & Swerts, Marc
(2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language,
57
(3), 396–414.
Leech, Geoffrey N.
(2016) Principles of pragmatics. London: Routledge.
Lempert, Michael
(2011) Barack Obama, being sharp: Indexical order in the pragmatics of precision-grip gesture. Gesture,
11
(3), 241–270.
McNeill, David
(1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
(2005) Gesture and thought. Chicago: University of Chicago Press.
McNeill, David & Duncan, Susan D.
(2000) Growth points in thinking-for-speaking. In David McNeill (Ed.), Language and gesture (pp. 141–161). Cambridge: Cambridge University Press.
Nadeu, Marianna & Prieto, Pilar
(2011) Pitch range, gestural information, and perceived politeness in Catalan. Journal of Pragmatics,
43
(3), 841–854.
Newman-Norlund, Sarah E., Noordzij, Matthijs L., Newman-Norlund, Roger D., Volman, Inge A. C., de Ruiter, Jan Peter, Hagoort, Peter, & Toni, Ivan
(2009) Recipient design in tacit communication. Cognition,
111
(1), 46–54.
Nicoladis, Elena, Nagpal, Jaya, Marentette, Paula, & Hauer, Brandon
(2018) Gesture frequency is linked to story-telling style: Evidence from bilinguals. Language and Cognition,
10
(4), 641–664.
Ochs, Elinor
(1993) Constructing social identity: A language socialization perspective. Research on Language and Social Interaction,
26
(3), 287–306.
Orie, Ọlanikẹ Ọla
Özyürek, Aslı
(2002) Do speakers design their cospeech gestures for their addressees? The effects of addressee location on representational gestures. Journal of Memory and Language,
46
(4), 688–704.
Özyürek, Aslı, Kita, Sotaro, Allen, Shanley, Brown, Amanda, Furman, Reyhan, & Ishizuka, Tomoko
(2008) Development of cross-linguistic variation in speech and gesture: Motion events in English and Turkish. Developmental Psychology,
44
(4), 1040.
Özyürek, Aslı, Hickman, M., Veneziano, E., & Jisa, H.
(2018) Cross-linguistic variation in children’s multimodal utterances. In Maya Hickmann, Edy Veneziano, & Harriet Jisa (Eds.), Sources of variation in first language acquisition: Languages, contexts, and learners (pp. 123–138). Amsterdam & Philadelphia: John Benjamins.
Parrill, Fey
(2010a) The hands are part of the package: Gesture, common ground, and information packaging. In Sally Rice & John Newman (Eds.), Empirical and experimental methods in cognitive/functional research (pp. 285–302). Stanford, CA: CSLI Publications.
(2010b) Viewpoint in speech–gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes,
25
(5), 650–668.
Paxton, Alexandra & Dale, Rick
(2013) Frame-differencing methods for measuring bodily synchrony in conversation. Behavior Research Methods,
45
(2), 329–343.
Peirce, Charles S.
(1940) The philosophical Peirce: Selected writings (Justus Buchler, Ed.). New York: Harcourt, Brace.
Pizziconi, Barbara & Christie, Chris
(2017) Indexicality and (im)politeness. In Jonathan Culpeper, Michael Haugh, & Daniel Kádár (Eds.), The Palgrave handbook of linguistic (Im)politeness (pp. 143–170). London: Palgrave Macmillan.
R Core Team
(2019) R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. [URL]
Ren-Mitchell, Ada
Silverstein, Michael
(2003) Indexical order and the dialectics of social life. Language and Communication,
23
1, 193–229.
So, Wing Chee
(2010) Cross-cultural transfer in gesture frequency in Chinese–English bilinguals. Language and Cognitive Processes,
25
(10), 1335–1353.
Sohn, Ho-Min
(2001) The Korean Language. Cambridge: Cambridge University Press.
Stein, Nancy & Glenn, Christine
(1979) An analysis of story comprehension in elementary school children. In Roy Freedle (Ed.), New directions in discourse processing (pp. 53–120). Norwood, NJ: Ablex. [URL]
Talmy, Leonard
(1985) Lexicalization patterns: Semantic structure in lexical forms. Language Typology and Syntactic Description,
3
(99), 36–149.
Wickham, Hadley, Averick, Mara, Bryan, Jennifer, Chang, Winston, McGowan, Lucy D’Agostino, François, Romain, […], & Hester, Jim
Winter, Bodo
(2019) Statistics for linguists: An introduction using R. New York, NY: Routledge.
Winter, Bodo & Bürkner, Paul-Christian
2021). Poisson regression for linguists: A tutorial introduction to modeling count data with brms. Language and Linguistics Compass, e12439.
Winter, Bodo & Grawunder, Sven
(2012) The phonetic profile of Korean formal and informal speech registers. Journal of Phonetics,
40
(6), 808–815.
Withey, Alun
(2015) Technology, self-fashioning and politeness in eighteenth-century Britain: Refined bodies. Basingstoke, Hampshire & New York, NY: Palgrave Macmillan.
Woodin, Greg, Winter, Bodo, Perlman, Marcus, Littlemore, Jeannette, & Matlock, Teenie
(2020) “Tiny numbers” are actually tiny: Evidence from gestures in the TV News Archive. Plos One,
15
(11), e0242142.