Article In: Pragmatics and Society: Online-First Articles
Speakers’ responsibility for evidential claims
Believe me, I saw it!
This content is being prepared for publication; it may be subject to changes.
Abstract
People are vigilant toward the risk of misinformation and assess speakers’ trustworthiness to calibrate their trust accordingly. This assessment can target speakers’ epistemic commitments, conveyed through evidential claims. Speakers may take responsibility for the truth of a proposition by reporting first-hand evidence (“I saw that p”) or defer responsibility by referring to second-hand evidence (“somebody told me that p”). This pre-registered study experimentally investigates whether trust calibration is sensitive to the accuracy of these evidential claims. Our findings show that when a speaker shared accurate information p but provided an inaccurate evidential claim, the negative impact on perceived trustworthiness was greater for the strong perceptual evidential claim than the weak hearsay claim. These results provide new evidence that overcommitting by claiming direct visual evidence for information acquired second-hand is more reputationally damaging than appealing to hearsay despite having direct evidence. We discuss the implications for designing more trustworthy artificial agents.
Keywords: commitment, reputation, epistemic vigilance, trust, evidentiality
Article outline
- 1.Introduction
- 1.1Evaluation of speakers’ epistemic commitments
- 1.2Speakers’ evidential claims as commitment signals
- 1.3The accountability for speakers’ evidential claims
- 2.Experiment
- 2.1Method
- 2.1.1Participants
- 2.1.2Materials and design
- 2.2Results
- 2.1Method
- 3.Discussion
- 3.1Limitations and future directions
- 3.2Implications for artificial agents
- 4.Conclusion
- Notes
- Author queries
References
References (45)
Altay, Sacha, Nicolas Claidière, and Hugo Mercier. 2020. “It Happened to a Friend of a Friend: Inaccurate Source Reporting in Rumour Diffusion.” Evolutionary Human Sciences 2: e49.
Bendezú-Araujo, Raúl. 2023. “Evidentiality, Assertional Force and Common Ground Management in Conchucos Quechua.” Indiana — Anthropological Studies on Latin America and the Caribbean 40(1): 75–96.
Bergqvist, Henrik, and Karolina Grzech. 2023. “The Role of Pragmatics in the Definition of Evidentiality.” STUF — Language Typology and Universals 76 (1): 1–30.
Bonalumi, Francesca, Johannes B. Mahr, Pauline Marie, and Nausicaa Pouscoulous. 2023. “Beyond the Implicit/Explicit Dichotomy: The Pragmatics of Plausible Deniability.” Review of Philosophy and Psychology 15(4): 1399–1421.
Boulat, Kira, and Didier Maillat. 2017. “She Said You Said I Saw It with My Own Eyes: A Pragmatic Account of Commitment.” In Formal Models in the Study of Language, ed. by Joanna Blochowiak, Cristina Grisot, Stephanie Durrleman, and Christopher Laenzlinger, 261–279. Cham: Springer International Publishing.
Boye, Kasper. 2012. Epistemic Meaning: A Crosslinguistic and Functional-Cognitive Study. Empirical Studies to Language Typology 43. Berlin: Walter de Gruyter.
Brodsky, Stanley L., Michael P. Griffin, and Robert J. Cramer. 2010. “The Witness Credibility Scale: An Outcome Measure for Expert Witness Research.” Behavioral Sciences & the Law 28 (6): 892–907.
de Villiers, Jill G., Jay Garfield, Harper Gernet-Girard, Tom Roeper, and Margaret Speas. 2009. “Evidentials in Tibetan: Acquisition, Semantics, and Cognitive Development.” New Directions for Child and Adolescent Development 2009 (125): 29–47.
Emsley, Robin. 2023. “ChatGPT: These Are Not Hallucinations — They’re Fabrications and Falsifications.” Schizophrenia 9 (1): 52.
Faller, Martina. 2002. “Remarks on Evidential Hierarchies.” In The Construction of Meaning, ed. by David I. Beaver, Luis D. Casillas Martínez, Brady Z. Clark, and Stefan Kaufmann, 89–111. Stanford: CSLI Publications.
Faye, Jan. 2023. “Social Knowledge, Agreements, and Testimonies.” In The Biological and Social Dimensions of Human Knowledge, ed. by Jan Faye, 201–229. Cham: Springer Nature Switzerland.
Freiman, Ori, and Boaz Miller. 2020. “Can Artificial Entities Assert?” In The Oxford Handbook of Assertion, ed. by Sanford Goldberg, 415–436. Oxford: Oxford University Press.
Grice, Herbert Paul. 1975. “Logic and Conversation.” In Speech Acts, ed. by Peter Cole, and Jerry L. Morgan, 41–58. Leiden: Brill.
Hall, Alison, and Diana Mazzarella. 2023. “Pragmatic Inference, Levels of Meaning and Speaker Accountability.” Journal of Pragmatics 205: 92–110.
Harris, Paul L., Melissa A. Koenig, Kathleen H. Corriveau, and Vikram K. Jaswal. 2018. “Cognitive Foundations of Learning from Testimony.” Annual Review of Psychology 69 (1): 251–73.
Ifantidou, Elly. 2001. Evidentials and Relevance. Amsterdam: John Benjamins Publishing.
Koenig, Melissa A., Fabrice Clément, and Paul L. Harris. 2004. “Trust in Testimony: Children’s Use of True and False Statements.” Psychological Science 15 (10): 694–698.
Koenig, Melissa A., and Vikram K. Jaswal. 2011. “Characterizing Children’s Expectations About Expertise and Incompetence: Halo or Pitchfork Effects?” Child Development 82 (5): 1634–1647.
Kotwica, Dorota. 2020. “Mitigation and Reinforcement in General Knowledge Expressions.” Journal of Pragmatics 169: 219–230.
Liew, Tze Wei, and Su-Mae Tan. 2021. “Social Cues and Implications for Designing Expert and Competent Artificial Agents: A Systematic Review.” Telematics and Informatics 65: 101721.
Mahr, Johannes B., and Gergely Csibra. 2021. “The Effect of Source Claims on Statement Believability and Speaker Accountability.” Memory & Cognition 49 (8): 1505–1525.
Mazzarella, Diana, Robert Reinecke, Ira Noveck, and Hugo Mercier. 2018. “Saying, Presupposing and Implicating: How Pragmatics Modulates Commitment.” Journal of Pragmatics 133 (: 15–27.
Niebuhr, Olivier, and Vered Silber-Varod. 2026. “Building Trust with Prosodic Constructions: The Role of Phrase-Final Pitch and Tempo Dynamics.” Pragmatics and Society.
Papafragou, Anna, Peggy Li, Youngon Choi, and Chung-hye Han. 2007. “Evidentiality in Language and Cognition.” Cognition 103 (2): 253–299.
Parsons, Simon, Katie Atkinson, Zimi Li, Peter McBurney, Elizabeth Sklar, Munindar Singh, Karen Haigh, Karl Levitt, and Jeff Rowe. 2014. “Argument Schemes for Reasoning about Trust.” Argument & Computation 5 (2–3): 160–190.
Pozzi, Mélinda, and Diana Mazzarella. 2023. “What’s Your Evidence? The Psychological Foundations of the Evaluation of Testimony.” Ars Interpretandi 28 (2): 113–128.
. 2024. “Speaker Trustworthiness: Shall Confidence Match Evidence?” Philosophical Psychology 37 (1): 102–125.
Rocci, Andrea. 2017. Modality in Argumentation: A Semantic Investigation of the Role of Modalities in the Structure of Arguments with an Application to Italian Modal Expressions. Argumentation Library 29. Dordrecht: Springer.
Sabbagh, Mark A., and Dare A. Baldwin. 2001. “Learning Words from Knowledgeable versus Ignorant Speakers: Links Between Preschoolers’ Theory of Mind and Semantic Development.” Child Development 72 (4): 1054–1070.
Sassoon, Isabel K., Nadin Kökciyan, Simon D. Parsons, and Elizabeth I. Sklar. 2018. “Towards the Use of Commitments in Multi-Agent Decision Support Systems.” In Workshop on Dialogue, Explanation and Argumentation at Human Agent Interaction (DEXAHAI). Southampton, United Kingdom.
Schlicker, Nadine, Kevin Baum, Alarith Uhde, Sarah Sterz, Martin C. Hirsch, and Markus Langer. 2022. “How Do We Assess the Trustworthiness of AI? Introducing the Trustworthiness Assessment Model (TrAM).”
Solan, Lawrence M. 2021. “Linguistic Evidentials and the Law of Hearsay.” In Philosophical Foundations of Evidence Law, ed. by Lawrence M. Solan, 157–168. Oxford: Oxford University Press.
Sperber, Dan, Fabrice Clément, Christophe Heintz, Olivier Mascaro, Hugo Mercier, Gloria Origgi, and Deirdre Wilson. 2010. “Epistemic Vigilance.” Mind & Language 25 (4): 359–393.
Stivers, Tanya, Lorenza Mondada, and Jakob Steensig. 2011. “Knowledge, Morality and Affiliation in Social Interaction.” In The Morality of Knowledge in Conversation, ed. by Tanya Stivers, Lorenza Mondada, and Jakob Steensig, 3–24. Studies in Interactional Sociolinguistics. Cambridge: Cambridge University Press.
Tenney, Elizabeth R., Barbara A. Spellman, and Robert J. MacCoun. 2008. “The Benefits of Knowing What You Know (and What You Don’t): How Calibration Affects Credibility.” Journal of Experimental Social Psychology 44 (5): 1368–1375.
Ünal, Ercenur, and Anna Papafragou. 2020. “Relations Between Language and Cognition: Evidentiality and Sources of Knowledge.” Topics in Cognitive Science 12 (1): 115–135.
Vullioud, Colin, Fabrice Clément, Thom Scott-Phillips, and Hugo Mercier. 2017. “Confidence as an Expression of Commitment: Why Misplaced Expressions of Confidence Backfire.” Evolution and Human Behavior 38 (1): 9–17.
Walton, Douglas. 2007. Witness Testimony Evidence: Argumentation and the Law. Cambridge: Cambridge University Press.
Walton, Douglas, and Erik C. W. Krabbe. 1995. Commitment in Dialogue: Basic Concepts of Interpersonal Reasoning. Albany: State University of New York Press.
Wang, Ning, David V. Pynadath, Ericka Rovira, Michael J. Barnes, and Susan G. Hill. 2018. “Is It My Looks? Or Something I Said? The Impact of Explanations, Embodiment, and Expectations on Trust and Performance in Human-Robot Teams.” In Persuasive Technology, ed. by Jaap Ham, Evangelos Karapanos, Plinio P. Morita, and Catherine M. Burns, 10809: 56–69. Lecture Notes in Computer Science. Cham: Springer International Publishing.