Cover not available
Article published In:
Interaction Studies
Vol. 16:1 (2015) ► pp.89–117

Towards robots that trust

Human subject validation of the situational conditions for trust

| Georgia Tech Research Institute |
| Georgia Tech Research Institute |

This article investigates the challenge of developing a robot capable of determining if a social situation demands trust. Solving this challenge may allow a robot to react when a person over or under trusts the system. Prior work in this area has focused on understanding the factors that influence a person’s trust of a robot (Hancock, et al., 2011). In contrast, by using game-theoretic representations to frame the problem, we are able to develop a set of conditions for determining if an interactive situation demands trust. In two separate experiments, human subjects were asked to evaluate either written narratives or mazes in terms of whether or not they require trust. The results indicate a Φ 1= +0.592 and Φ 2 = +0.406 correlation respectively between the subjects’ evaluations and the condition’s predictions. This is a strong correlation for a study involving human subjects.

Keywords: trust, game theory, autonomous system, social robot, human-robot interaction
Article outline
  • 1.Introduction
  • 2.Related work
  • 3.Representing interaction
  • 4.Recognizing situations that demand trust
  • 5.Experimental hypotheses
  • 6.Methodology
    • 6.1Trust versus no-trust matrices
  • 7.The narrative experiment
    • 7.1Results
  • 8.Robot guidance experiment
    • 8.1Results
  • 9.Discussion
  • 10.Conclusion
  • Acknowledgment
  • References
Published online: 17 August 2015
DOI logo
https://doi.org/10.1075/is.16.1.05wag
References
Adolphs, R., Tranel, D., & Damasio, A.R
(1998) The human amygdala in social judgment. Nature, 3931, 470–474. DOI logoGoogle Scholar
Barber, B
(1983) The logic and limits of trust. New Brunswick, New Jersey: Rutgers University Press.Google Scholar
Castelfranch, C., & Falcone, R
(2010) Trust theory: A socio-cognitive and computational model. New York, NY: Wiley Publishers. DOI logoGoogle Scholar
Cooper, J.C., Kreps, T.A., Wiebe, T., Pirkl, T., & Knutson, B
(2010) When giving is good: Ventromedial prefrontal cortex activation for others’ intentions. Neuron, 67(3), 511–521. DOI logoGoogle Scholar
Desai, M., Kaniarasu, P., Medvedev, M., Steinfeld, A., & Yanco, H
(2013) Impact of robot failures and feedback on real-time trust. Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction , (pp. 251–258). Tokyo, Japan. DOI logo
Deutsch, M
(1962) Cooperation and trust: Some theoretical notes. In M.R. Jones (Ed.), Nebraska symposium on motivation (pp. 275–315). Lincoln, NB: University of Nebraska.Google Scholar
(1973) The resolution of conflict: Constructive and destructive processes. New Haven, CT: Yale University Press. DOI logoGoogle Scholar
Economist
(2006) Trust me, I’m a robot. The Economist, 18–19.Google Scholar
Engle-Warnick, J., & Slonim, R.L
(2006) Learning to trust in indefinitely repeated games. Games and Economic Behavior, 95–114. DOI logoGoogle Scholar
Fisher, R.J
(1993) Social desirability bias and the validity of indirect questioning. Journal of Consumer Research, 20(2), 303–315. DOI logoGoogle Scholar
Gambetta, D
(1990) Can we trust trust? In D. Gambetta (Ed.), Trust, making and breaking cooperative relationships (pp. 213–237). Oxford England: Basil Blackwell.Google Scholar
Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y., Visser, E.J., & Parasuraman, R
(2011) A meta-analysis of factors affecting trust in human-robot interaction. Human Factors: The Journal of the Human Factors and Ergonomics Society, 53(5), 517–527. DOI logoGoogle Scholar
Hemphill, J.F
(2003) Interpreting the magnitudes of correlation coefficients. American Psychologist, 58(1), 78–80. DOI logoGoogle Scholar
Hung, Y.C., Dennis, A.R., & Robert, L
(2004) Trust in virtual teams: Towards an Integrative model of trust formation. International Conference on System Sciences . Hawaii. DOI logo
Josang, A., & Pope, S
(2005) Semantic constraints for trust transitivity. Second Asia-Pacific conference on conceptual modeling . Newcastle, Australia.
Kelley, H.H., & Thibaut, J.W
(1978) Interpersonal relations: A theory of interdependence. New York, NY: John Wiley & Sons.Google Scholar
Kelley, H.H., Holmes, J.G., Kerr, N.L., Reis, H.T., Rusbult, C.E., & Lange, P.A
(2003) An atlas of interpersonal situations. New York, NY: Cambridge University Press. DOI logoGoogle Scholar
King-Casas, B., Tomlin, D., Anen, C., Camerer, C.F., Quartz, S.R., & Montague, P.R
(2005) Getting to know you: Reputation and trust in two-person economic exchange. Science (3081), 78–83. DOI logoGoogle Scholar
Lee, J.D., & See, K.A
(2004) Trust in automation: Designing for appropriate reliance. Human Factors, 50–80. DOI logoGoogle Scholar
Luhmann, N
(1979) Trust and power. Chichester: Wiley Publishers.Google Scholar
Luna-Reyes, L., Cresswell, A.M., & Richardson, G.P
(2004) Knowledge and the development of interpersonal trust: A dynamic model. International conference on system science . Hawai. DOI logo
Mitchell, M., & Jolley, J
(1992) Research design explained (2nd ed.). Orlando, FL: Harcourt Brace Jovanovich.Google Scholar
Osborne, M.J., & Rubinstein, A
(1994) A course in game theory. Cambridge, MA: MIT Press. DOI logoGoogle Scholar
Paolacci, G., Chandler, J., & Ipeirotis, P.G
(2010) Running experiments on Amazon Mechanical Turk. Judgment and Decision Making, 5(5), 411–419.Google Scholar
Prietula, M.J., & Carley, K.M
(2001) Boundedly rational and emotional agents. In C. Castelfranchi & Y.-H. Tan (Eds.), Trust and deception in virtual society (pp. 169–194). Kluwer Academic Publishers. DOI logoGoogle Scholar
Rilling, J.K., Gutman, D.A., Zeh, T.R., Pagnoni, G., Berns, G.S., & Kilts, C.D
(2002) A neural basis for social cooperation. Neuron, 395–405. DOI logoGoogle Scholar
Robinette, P., Wagner, A.R., & Howard, A
(2013) Building and maintaining trust between humans and guidance robots in an emergency. AAAI Spring Symposium, Stanford University, (pp. 78–83). Palo Alto.Google Scholar
(2014) Assessment of robot guidance modalities conveying instructions to humans in emergency situations. Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 14) . Edinburgh, UK. DOI logo
(2014) The effect of robot performance on human-robot trust in time-critical situation. Human Factors, under review.Google Scholar
Rousseau, D.M., Sitkin, S.B., Burt, R.S., & Camerer, C
(1998) Not so different after all: A cross-discipline view of trust. Academy of Management Review, 231, 393–404. DOI logoGoogle Scholar
Runyon, R.P., & Audrey, H
(1991) Fundamentals of behavioral statistics. New York, NY: McGraw Hill.Google Scholar
Sabater, J., & Sierra, C
(2005) Review of computational trust and reputation models. Artificial Intelligence Review, 241, 33–60. DOI logoGoogle Scholar
Schillo, M., Funk, P., & Rovatsos, M
(2000) Using trust for detecting deceitful agents in artificial societies. Applied Artificial Intelligence Journal, Special Issue on Trust, Deception and Fraud in Agent Societies. DOI logoGoogle Scholar
Sears, D.O., Peplau, L.A., & Taylor, S.E
(1991) Social psychology. Englewood Cliffs, New Jersey: Prentice Hall. DOI logoGoogle Scholar
Shafir, E., & LeBoeuf, R.A
(2002) Rationality. Annual Review of Psychology, 491–517. DOI logoGoogle Scholar
Tversky, A., & Kahneman, D
(1974) Judgment under uncertainty: Heuristics and biases. Science, 1851, 1124–1130. DOI logoGoogle Scholar
Wagner, A.R
(2009) Creating and using matrix representations of social interaction. Proceedings of the 4th International conference on human-robot interaction (HRI 2009) . San Diego, CA. DOI logo
(2009) The role of trust and relationships in human-robot social interaction. Ph.D. diss., School of Interactive Computing, Georgia Institute of Technology, Atlanta, GA.
(2012) Using cluster-based stereotyping to foster human-robot cooperation. Proceedings of IEEE International conference on intelligent robots and systems (IROS 2012) , (pp. 1615–1622). Villamura, Portugal. DOI logo
(2013) Developing robots that recognize when they are being trusted. AAAI Spring Symposium . Stanford CA.
Wagner, A.R., & Arkin, R.C
(2011) Acting deceptively: Providing robots with the capacity for deception. The International Journal of Social Robotics, 31, 5–26. DOI logoGoogle Scholar
Winston, J.S., Strange, B.A., O’Doherty, J., & Dolan, R.J
(2002) Automatic and intentional brain responses during evaluation of trustworthiness of faces. Nature Neuroscience 51, 277–283. DOI logoGoogle Scholar
Yamagishi, T
(2001) Trust as a form of social intelligence. In K.S. Cook (Ed.), Trust in society. New York, NY: Russell Sage Foundation. DOI logoGoogle Scholar
Cited by

Cited by 10 other publications

Hois, Joana, Dimitra Theofanou-Fuelbier & Alischa Janine Junk
2019. How to Achieve Explainability and Transparency in Human AI Interaction. In HCI International 2019 - Posters [Communications in Computer and Information Science, 1033], ► pp. 177 ff. DOI logo
Huang, Hanjing, Pei-Luen Patrick Rau & Liang Ma
2021. Will you listen to a robot? Effects of robot ability, task complexity, and risk on human decision-making. Advanced Robotics 35:19 ► pp. 1156 ff. DOI logo
Jung, Minjoo, May Jorella S. Lazaro & Myung Hwan Yun
2021. Evaluation of Methodologies and Measures on the Usability of Social Robots: A Systematic Review. Applied Sciences 11:4 ► pp. 1388 ff. DOI logo
Kordoni, Anastasia, Carlos Gavidia-Calderon, Mark Levine, Amel Bennaceur & Bashar Nuseibeh
2023. “Are we in this together?”: embedding social identity detection in drones improves emergency coordination. Frontiers in Psychology 14 DOI logo
Loghmani, Mohammad Reza, Clara Haider, Yegor Chebotarev, Christiana Tsiourti & Markus Vincze
2019. 2019 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), ► pp. 172 ff. DOI logo
Robinette, Paul, Ayanna Howard & Alan R. Wagner
2017. Conceptualizing Overtrust in Robots: Why Do People Trust a Robot That Previously Failed?. In Autonomy and Artificial Intelligence: A Threat or Savior?, ► pp. 129 ff. DOI logo
Robinette, Paul, Ayanna M. Howard & Alan R. Wagner
2017. Effect of Robot Performance on Human–Robot Trust in Time-Critical Situations. IEEE Transactions on Human-Machine Systems 47:4 ► pp. 425 ff. DOI logo
Robinette, Paul, Wenchen Li, Robert Allen, Ayanna M. Howard & Alan R. Wagner
2016. 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI), ► pp. 101 ff. DOI logo
Robinette, Paul, Alan R. Wagner & Ayanna M. Howard
2016. Investigating Human-Robot Trust in Emergency Scenarios: Methodological Lessons Learned. In Robust Intelligence and Trust in Autonomous Systems, ► pp. 143 ff. DOI logo
Wagner, Alan R., Paul Robinette & Ayanna Howard
2018. Modeling the Human-Robot Trust Phenomenon. ACM Transactions on Interactive Intelligent Systems 8:4 ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 31 march 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.