Cover not available

Article In: Gesture: Online-First Articles

Commitment beyond words

Comparing pointing and verbal reference in ambiguous contexts

ORCiD logo with link | Julius-Maximilians-Universität Würzburg
 | Goethe University Frankfurt
 | Julius-Maximilians-Universität Würzburg
 | TU Dortmund University
This content is being prepared for publication; it may be subject to changes.
Abstract
Commitment is pivotal in communication, as speakers are held accountable for what they convey and may suffer reputational consequences after false statements. While commitment has traditionally been associated with verbal assertions, everyday communication often also involves gestures. We investigated whether commitment attribution differs between purely verbal reference and reference established through the combination of speech and pointing under conditions of referential ambiguity. In two experiments, participants were asked to select objects to which an avatar was either pointing or referring verbally. Across both experiments, pointing gestures elicited similar commitment-related judgements than verbal reference, regardless of the ambiguity or correctness of gesture and speech. Furthermore, the results revealed that verbal reference and pointing gestures triggered similar pragmatic inferences in partly ambiguous contexts. These findings show that commitment maybe attributed to speakers as much as to gesturers and highlight the importance of integrating gestures into theories of commitment, assertion, and pragmatic inference.
Article outline
  • Introduction
    • Research question and outline
    • Gestures and speech
    • Referential ambiguity of pointing gesture
    • Semantic and pragmatic ambiguity
    • Theoretical predictions
  • Experiment 1
    • Methods
      • Participants
      • Stimulus and apparatus
      • Procedure
      • Data analysis
    • Results
      • Choices
      • Ratings
    • Short discussion
  • Experiment 2
    • Method
      • Participants
      • Stimulus and procedure
      • Data analysis
    • Results
      • Choices
      • Ratings
    • Short discussion
  • General discussion
    • Limitations
    • Relation to previous experimental and theoretical work
    • Conclusion
  • Acknowledgements
  • Author queries
  • References
References (30)
References
Balantani, A., & Lázaro, S. (2021). Joint attention and reference construction: The role of pointing and “so”. Language & Communication, 79, 33–52. Google Scholar logo with link to Google Scholar
Bates, D., Mächler, M., Bolker, B., & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. Google Scholar logo with link to Google Scholar
Bavelas, J., Kenwood, C., Johnson, T., & Phillips, B. (2002). An experimental study of when and how speakers use gestures to communicate. Gesture, 2(1), 1–17. Google Scholar logo with link to Google Scholar
Bavelas, J. B., & Chovil, N. (2006). Nonverbal and verbal communication: Hand gestures and facial displays as part of language use in face-to-face dialogue. In V. Manusov & M. L. Patterson (Eds.), The Sage handbook of nonverbal communication. (pp. 97–115). Sage Publications. Google Scholar logo with link to Google Scholar
Behne, T., Carpenter, M., & Tomasello, M. (2005). One-year-olds comprehend the communicative intentions behind gestures in a hiding game. Developmental Science 8(6), 492–499. Google Scholar logo with link to Google Scholar
Butterworth, G., & Itakura, S. (2000). How the eyes, head and hand serve definite reference. British Journal of Developmental Psychology, 18(1), 25–50. Google Scholar logo with link to Google Scholar
Cooperrider, K. (2023). Fifteen ways of looking at a pointing gesture. Public Journal of Semiotics, 10(2), 40–84. Google Scholar logo with link to Google Scholar
Davies, C., & Katsos, N. (2016). Reference and informativeness as cognitive processes in verbal communication. In A. Rocci & L. D. Saussure (Eds.), Verbal communication (Vol. 3, pp. 123–140). De Gruyter Mouton. Google Scholar logo with link to Google Scholar
de Ruiter, J. P., Bangerter, A., & Dings, P. (2012). The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4, 232–248. Google Scholar logo with link to Google Scholar
Dobrich, W., & Scarborough, H. S. (1984). Form and function in early communication: Language and pointing gestures. Journal of Experimental Child Psychology, 38(3), 475–490. Google Scholar logo with link to Google Scholar
Ebert, C., Ebert, C., & Hörnig, R. (2020). Demonstratives as dimension shifters. Proceedings of Sinn und Bedeutung, 24(1), 161–178. Google Scholar logo with link to Google Scholar
Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3(11), 419–429. Google Scholar logo with link to Google Scholar
Henninger, F., Shevchenko, Y., Mertens, U. K., Kieslich, P. J., & Hilbig, B. E. (2022). lab.js: A free, open, online study builder. Behavior Research Methods, 54(2), 556–573. Google Scholar logo with link to Google Scholar
Herbort, O., Ebert, C., Krause, L.-M., Hinterwimmer, S., & Walter, S. (2026). Shifted interpretation of pointing gestures in speech reports. Proceedings of the Annual Meeting of the Cognitive Science Society, 48. [URL]
Herbort, O., Krause, L.-M., Rassbach, P., & Kunde, W. (2025). How pointing informs visual search. Journal of Experimental Psychology-Human Perception and Performance, 51(11), 1560–1575. Google Scholar logo with link to Google Scholar
Herbort, O., & Kunde, W. (2016). Spatial (mis-)interpretation of pointing gestures to distal referents. Journal of Experimental Psychology: Human Perception & Performance, 42(1), 78–89. Google Scholar logo with link to Google Scholar
Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge University Press. Google Scholar logo with link to Google Scholar
Kobayashi, H., & Yasuda, T. (2015). Pointing to an invisible object behind a wall: Comprehension of pointing with a bent index finger. Proceedings of the EuroAsianPacific Joint Conference on Cognitive Science 2015, 477–481.Google Scholar logo with link to Google Scholar
Koolen, R., Gatt, A., Goudbeek, M., & Krahmer, E. (2011). Factors causing overspecification in definite descriptions. Journal of Pragmatics, 43(13), 3231–3250. Google Scholar logo with link to Google Scholar
Kranstedt, A., Lücking, A., Pfeiffer, T., Rieser, H., & Wachsmuth, I. (2006, 2005). Deixis: How to determine demonstrated objects using a pointing cone. Gesture in Human-Computer Interaction and Simulation, 6th International Gesture Workshop, GW 2005 May 18–20, 2005, Berder Island, France.Google Scholar logo with link to Google Scholar
Krause, L. M., & Herbort, O. (2021). The observer’s perspective determines which cues are used when interpreting pointing gestures. Journal of Experimental Psychology-Human Perception and Performance, 47(9), 1209–1225. Google Scholar logo with link to Google Scholar
Liebal, K., Behne, T., Carpenter, M., & Tomasello, M. (2009). Infants use shared experience to interpret pointing gestures. Developmental Science 12(2), 264–271. Google Scholar logo with link to Google Scholar
McNeill, D., & Duncan, S. D. (2000). Growth points in thinking-for-speaking. In D. McNeill (Ed.), Language and gesture (pp. 141–161). Cambridge University Press. Google Scholar logo with link to Google Scholar
Morey, R. D., & Rouder, J. (2025). Computation of Bayes Factors for Common Designs. [URL]
Ooms, J. (2014). The jsonlite package: A practical and consistent mapping between JSON data and R objects. In.Google Scholar logo with link to Google Scholar
R Core Team. (2024). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. [URL]
So, W. C., Kita, S., & Goldin-Meadow, S. (2009). Using the hands to identify who does what to whom: Gesture and speech go hand-in-hand. Cognitive Science, 33(1), 115–125. Google Scholar logo with link to Google Scholar
van der Sluis, I., & Krahmer, E. (2007). Generating multimodal references. Discourse Processes, 44(3), 145–174. Google Scholar logo with link to Google Scholar
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L. D., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., Kuhn, M., Pedersen, T. L., Miller, E., Bache, S. M., Müller, K., Ooms, J., Robinson, D., Seidel, D. P., Spinu, V., Takahashi, K., Vaughan, D., Wilke, C., Woo, K., & Yutani, H. (2019). Welcome to the Tidyverse. Journal of Open Source Software, 4(43), 1686. Google Scholar logo with link to Google Scholar
Wu, Z., & Gros-Louis, J. (2015). Contingent labeling after infants’ pointing helps infants learn words. Proceeding of the 37th Annual Conference of the Cognitive Science Society, 2679–2684–2679–2684.Google Scholar logo with link to Google Scholar
Mobile Menu Logo with link to supplementary files background Layer 1 jbe-platform.quadraat-sans-bold jbe-platform.quadraat-sans-bold-dark jbe-platform.quadraat-sans-bold-light jbe-platform.quadraat-sans-bold prag Twitter_Logo_Blue