Article published In:
GestureVol. 17:1 (2018) ► pp.98–127
Some pragmatic functions of conversational facial gestures [1] 1
Conversational facial gestures are not emotional expressions (Ekman, 1997). Facial gestures are co-speech gestures – configurations of the face, eyes, and/or head that are synchronized with words and other co-speech gestures. Facial gestures are the most frequent facial actions in dialogue, and the majority serve pragmatic (meta-communicative) rather than referential functions. A qualitative microanalysis of a close-call story illustrates three pragmatic facial gestures in their macro- and micro-context: (a) The narrator’s thinking faces (Goodwin & Goodwin, 1986) occurred as the narrator was getting started, and they accompanied verbal collateral signals of delay, such as “uh” or “um”. (b) The narrator pointed at his hand gestures with his head and eyes (Streeck, 1993), drawing the addressee’s attention to depictions that would later be crucial to the close call. (c) The meta-communicative functions of smiles included marking the narrator’s description of danger as ironic or humorous, hinting at key elements, and acknowledging errors.
Keywords: conversational facial gestures, pragmatics of gestures, face-to-face dialogue, smiles, thinking faces, gaze, emotional expressions, collateral signals
Article outline
- Distinguishing between facial gestures and emotional expressions
- Ekman’s position
- A survey of faces in dialogue
- Referential functions
- Experimental studies
- Pragmatic functions
- Experimental evidence
- Summary
- Facial gestures with pragmatic functions: A narrative example
- Thinking faces as collateral signals
- Summary
- Pointing with gaze and head
- Summary
- Smiles have many functions
- Summary
- Conclusions
- Notes
-
References
References
References
Bavelas, Janet
(2007) Face-to-face dialogue as a micro-social context. The example of motor mimicry. In Susan D. Duncan, Justine Cassell, & Elena Terry Levy (Eds.), Gesture and the dynamic dimension of language. Essays in honor of David McNeill (pp. 127–146). Amsterdam, NL: John Benjamins. 
Bavelas, Janet, Alex Black, Charles Lemery, & Jennifer Mullett
(1986) “I show how you feel.” Motor mimicry as a communicative act. Journal of Personality and Social Psychology, 50 (2), 322–329.
Bavelas, Janet & Nicole Chovil
(1997) Faces in dialogue. In James A. Russell & José-Miguel Fernandez-Dols (Eds.), The psychology of facial expression (pp. 334–346). Cambridge, UK: Cambridge University Press.
Bavelas, Janet, Nicole Chovil, Linda Coates, & Lori Roe
(1995) Gestures specialized for dialogue. Personality and Social Psychology Bulletin, 21 (4), 394–405.
Bavelas, Janet, Nicole Chovil, Douglas A. Lawrie, & Allan Wade
(1992) Interactive gestures. Discourse Processes, 151, 469–489.
Bavelas, Janet, Linda Coates, & Trudy Johnson
(2002) Listener responses as a collaborative process: The role of gaze. Journal of Communication, 52 (3), 566–580.
Bavelas, Janet, Jennifer Gerwing, & Sara Healing
(2014a) Effect of dialogue on demonstrations: Direct quotations, facial portrayals, hand gestures, and figurative language. Discourse Processes, 52 (8), 619–655.
(2014b) Hand gestures and facial displays in conversational interaction. In Thomas M. Holtgraves (Ed.), Oxford handbook of language and social psychology (pp. 111–130). New York: Oxford University Press.
(2014c) Including facial gestures in gesture-speech ensembles. In Mandana Seyfeddinipur & Marianne Gullberg (Eds.), From gesture in conversation to visible action as utterance: Essays in honour of Adam Kendon (pp. 15–34). Amsterdam, NL: John Benjamins.
Birdwhistell, Ray
(1952) Introduction to kinesics: An annotation system for the analysis of body motion and gesture. Louisville, KE: University of Louisville.
(1970) Kinesics and context: Essays on body motion communication. Philadelphia: University of Philadelphia Press.
Bolinger, Dwight L.
(1946) Thoughts on ‘Yep’ and ‘Nope’. American Speech, 21 (2), 90–95.
Brunner, Lawrence J.
(1977) Smiling and laughter in two four-person conversations. Unpublished doctoral dissertation. Department of Psychology, University of Chicago.
(1979) Smiles can be back channels. Journal of Personality and Social Psychology, 37 (5), 728–734.
Chovil, Nicole
(1989) Communicative functions of facial displays in conversation. Unpublished PhD dissertation. University of Victoria, Victoria, British Columbia, Canada. [Dissertation Abstracts International, 51-04B, 2111]
(1991a) Discourse-oriented facial displays in conversation. Research on Language and Social Interaction, 25 (1–4), 163–194.
(1991b) Social determinants of facial displays. Journal of Nonverbal Behavior, 15 (3), 141–154.
Clark, Herbert H.
(1996) Using language. Cambridge, UK: Cambridge University Press.
Clark, Herbert H. & Jean E. Fox Tree
(2002) Using uh and um in spontaneous speaking. Cognition, 84 (1), 83–111.
Crivelli, Carlos, James A. Russell, Sergio Jarillo, & José-Miguel Fernández-Dols
(2017) Recognizing spontaneous facial expressions of emotion in a small-scale society of Papua New Guinea. Emotion, 17 (2), 337–347.
Darwin, Charles
(1955) The expression of the emotions in man and animals. New York, NY: Philosophical Library, 1955 (Original work published 1872).
DiGirolamo, Marissa A. & James A. Russell
(2017) The emotion seen in a face can be a methodological artifact: The process of elimination hypothesis. Emotion, 17 (3), 538–546.
Dolgin, Kim Gale & John Sabini
(1982) Experimental manipulation of a human non-verbal display: The tongue-show affects an observer’s willingness to interact. Animal Behavior, 30 (3), 935–936.
Duncan, Starkey, Jr.
(1974) On the structure of speaker-auditor interaction during speaking turns. Language in Society, 21, 161–180.
Ekman, Paul
(1979) About brows: emotional and conversational signals. In Michael von Cranach, Klaus Foppa, Wolf Lepenies, & Detlev Ploog (Eds.), Human ethology (pp. 169–249). Cambridge, UK: Cambridge University Press.
(1997) Should we call it expression or communication? Innovation: The European Journal of Social Science Research, 10 (4), 333–344.
(1985) Telling lies. New York, NY: Berkeley Books.
Ekman, Paul & Wallace V. Friesen
(1969) The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 11, 49–98.
(1978) Facial Action Coding System: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press.
Ekman, Paul, Wallace V. Friesen, & Sonia Ancoli
(1980) Facial signs of emotional experience. Journal of Personality and Social Psychology, 39 (6), 1125–1134.
Flecha-García, María Luisa
(2010) Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English. Speech Communication, 52 (6), 542–554.
Fridlund, Alan J., Paul Ekman, & Harriet Oster
(1987) Facial expressions of emotion: Review of literature, 1970–1983. In Aron W. Siegman & Stanley Feldstein (Eds.), Nonverbal behavior and communication (pp. 143–224). Hillsdale, NJ: Lawrence Erlbaum Associates.
Goodwin, Marjorie H., Asta Cekaite, & Charles Goodwin
(2012) Emotion as stance. In Marja-Leena Sorjonen & Anssi Perakyla (Eds.), Emotion in interaction (pp. 16–41). Oxford, UK: Oxford University Press.
Goodwin, Marjorie H. & Charles Goodwin
(1986) Gesture and coparticipation in the activity of searching for a word. Semiotica, 62 (1/2), 51–75.
Gullberg, Marianne & Sotaro Kita
(2009) Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behavioral, 33 (4), 251–277.
Kendon, Adam
(1975/1990) Some functions of the face in a kissing round. Semiotica, 15 (4), 299–334. Reprinted in Adam Kendon, Conducting interaction. Patterns of behavior in focused encounters (pp. 117–152). Cambridge, UK: Cambridge University Press.
(2004) Gesture. Visible action as utterance. Cambridge, UK: Cambridge University Press.
Kleck, Robert E., Robert C. Vaughan, Jeffrey Cartwright-Smith, Katherine Burns Vaughan, Carl Z. Colby, & John T. Lanzetta
(1976) Effects of being observed on expressive, subjective, and physiological responses to painful stimuli. Journal of Personality and Social Psychology, 34 (6), 1211–1218.
Kraut, Robert E. & Robert E. Johnston
(1979) Social and emotional messages of smiling: An ethological approach. Journal of Personality and Social Psychology, 37 (9), 1539–1553.
Smith, W. John, Julia Chase, & Anna Katz Lieblich
(1974) Tongue-showing: A facial display of humans and other primate species. Semiotica, 111, 201–246.
Smith, Vicki L. & Herbert H. Clark
(1993) On the course of answering questions. Journal of Memory and Language, 32 (1), 25–38.
Streeck, Jürgen
(1993) Gesture as communication I: Its coordination with gaze and speech. Communication Monographs, 60 (4), 275–299.
Streeck, Jürgen & Ulrike Hartge
(1992) Previews: Gestures at the transition place. In Peter Auer & Aldo Di Luzio (Eds.), The contextualization of language (pp. 135–158). Amsterdam, NL: Benjamins.
Cited by
Cited by 27 other publications
Alviar, Camila, Christopher T. Kello & Rick Dale
2023. Multimodal coordination and pragmatic modes in conversation. Language Sciences 97 ► pp. 101524 ff. 
Bavelas, Janet Beavin
2021. Pragmatics of Human Communication50 Years Later. Journal of Systemic Therapies 40:2 ► pp. 3 ff.
Bavelas, Janet Beavin
2022. De pragmatische aspecten van de menselijke communicatie 50 jaar later. Gezinstherapie Wereldwijd 33:4 ► pp. 360 ff.
Chou, Mu-Hsuan
2023. Strategies for interactive listening in modern foreign language learning. Language Awareness 32:1 ► pp. 169 ff.
Clift, Rebecca
2021. Embodiment in Dissent: The Eye Roll as an Interactional Practice. Research on Language and Social Interaction 54:3 ► pp. 261 ff.
Debras, Camille
2020. Informing language training with multimodal analysis: insights from the use of gesture in tandem interactions. In Language learning and professionalization in higher education: pathways to preparing learners and teachers in/for the 21st century, ► pp. 199 ff.
Duan, Xu, Jie Zhang, Yi Zhang, Yuan Liang, Yingying Huang & Hao Yan
2023. The effect of speech–gesture asynchrony on the neural coupling of interlocutors in interpreter-mediated communication. Social Cognitive and Affective Neuroscience 18:1
Dumouchel, Paul
2022. Making Faces. Topoi 41:4 ► pp. 631 ff.
Gast, Volker
2023. The Temporal Alignment of Speech-Accompanying Eyebrow Movement and Voice Pitch: A Study Based on Late Night Show Interviews. Behavioral Sciences 13:1 ► pp. 52 ff.
Heller, Vivien
2021. Embodied Displays of “Doing Thinking.” Epistemic and Interactive Functions of Thinking Displays in Children's Argumentative Activities. Frontiers in Psychology 12
Holler, Judith
2022. Visual bodily signals as core devices for coordinating minds in interaction. Philosophical Transactions of the Royal Society B: Biological Sciences 377:1859
Holler, Judith & Stephen C. Levinson
2019. Multimodal Language Processing in Human Communication. Trends in Cognitive Sciences 23:8 ► pp. 639 ff.
Hsu, Chun-Ting, Wataru Sato, Takanori Kochiyama, Ryusuke Nakai, Kohei Asano, Nobuhito Abe & Sakiko Yoshikawa
2022. Enhanced mirror neuron network activity and effective connectivity during live interaction among female subjects. NeuroImage 263 ► pp. 119655 ff.
Namba, Shushi, Wataru Sato & Hiroshi Matsui
2022. Spatio-Temporal Properties of Amused, Embarrassed, and Pained Smiles. Journal of Nonverbal Behavior 46:4 ► pp. 467 ff.
Namba, Shushi, Wataru Sato & Sakiko Yoshikawa
2021. Viewpoint Robustness of Automated Facial Action Unit Detection Systems. Applied Sciences 11:23 ► pp. 11171 ff.
Nota, Naomi, James P. Trujillo & Judith Holler
2021. Facial Signals and Social Actions in Multimodal Face-to-Face Interaction. Brain Sciences 11:8 ► pp. 1017 ff.
Nota, Naomi, James P. Trujillo & Judith Holler
2023. Conversational Eyebrow Frowns Facilitate Question Identification: An Online Study Using Virtual Avatars. Cognitive Science 47:12
Nota, Naomi, James P. Trujillo, Judith Holler & Celia Andreu-Sánchez
2023. Specific facial signals associate with categories of social actions conveyed through questions. PLOS ONE 18:7 ► pp. e0288104 ff.
Nota, Naomi, James P. Trujillo, Vere Jacobs & Judith Holler
2023. Facilitating question identification through natural intensity eyebrow movements in virtual avatars. Scientific Reports 13:1
Pronina, Mariia, Jelena Grofulovic, Eva Castillo, Pilar Prieto & Alfonso Igualada
2023. Narrative Abilities at Age 3 Are Associated Positively With Gesture Accuracy but Negatively With Gesture Rate. Journal of Speech, Language, and Hearing Research ► pp. 1 ff.
Rasing, Nathaniël B., Willianne van de Geest-Buit, On Ying A. Chan, Karlien Mul, Anke Lanser, Corrie E. Erasmus, Jan T. Groothuis, Judith Holler, Koen J. A. O. Ingels, Bart Post, Ietske Siemann & Nicol C. Voermans
2023. Psychosocial functioning in patients with altered facial expression: a scoping review in five neurological diseases. Disability and Rehabilitation ► pp. 1 ff.
Scotto, Silvia Carolina
2022. A Pragmatics-First Approach to Faces. Topoi 41:4 ► pp. 641 ff.
Tang, Mengmeng, Bingfei Chen, Xiufeng Zhao & Lun Zhao
2023. Semantic and syntactic processing of emojis in sentential intermediate positions. Cognitive Neurodynamics
Trujillo, James P. & Judith Holler
2023. Interactionally Embedded Gestalt Principles of Multimodal Human Communication. Perspectives on Psychological Science 18:5 ► pp. 1136 ff.
Trujillo, James P. & Judith Holler
2024. Conversational facial signals combine into compositional meanings that change the interpretation of speaker intentions. Scientific Reports 14:1
[no author supplied]
[no author supplied]
This list is based on CrossRef data as of 30 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.