Long-term evaluation of a social robot in real homes
Maartje M. A. de Graaf | University of Twente, The Netherlands
Somaya Ben Allouch | Saxion University of Applied Sciences, The Netherlands
Jan A. G. M. van Dijk | University of Twente, The Netherlands
This study aims to contribute to emerging human-robot interaction research by adding longitudinal findings to a limited number of long-term social robotics home studies. We placed 70 robots in users’ homes for a period of up to six months, and used questionnaires and interviews to collect data at six points during this period. Results indicate that users’ evaluations of the robot dropped initially, but later rose after the robot had been used for a longer period of time. This is congruent with the so-called mere-exposure effect, which shows an increasing positive evaluation of a novel stimulus once people become familiar with it. Before adoption, users focus on control beliefs showing that previous experiences with robots or other technologies allows to create a mental image of what having and using a robot in the home would entail. After adoption, users focus on utilitarian and hedonic attitudes showing that especially usefulness, social presence, enjoyment and attractiveness are important factors for long-term acceptance.
Keywords: domestic environment, human-robot interaction, long-term study, social robots, user acceptance
Published online: 30 March 2017
https://doi.org/10.1075/is.17.3.08deg
https://doi.org/10.1075/is.17.3.08deg
References
References
Aarts, H., Verplanken, B., & van Knippenberg, A.
(1998) Predicting Behavior From Actions in the Past: Repeated Decision Making or a Matter of Habit? Journal of Applied Social Psychology, 28(15), 1355–1374. 
Backer, T.E.
(2000) Finding the balance: Program fidelity and adaptation in substance use prevention. Centre for Substance Abuse Prevention, Washington D.C., USA.
Bijker, W.E.
(1993) Do not despair: There is life after constructivism. Science Technology Human Values, 18(1), 113–138.[ p. 488 ]
Brown, S.A., & Venkatesh, V.
(2005) Model of adoption of technology in households: A baseline model test and extension incorporating household life cycle. MIS Quarterly, 29(3), 399–426.
Davis, F.D., Bagozzi, R.P., & Warshaw, P.R.
(1992) Extrinsic and intrinsic motivation to use computers in the workplace. Journal of Applied Social Psychology, 22(11), 1111–1132.
Demiris, G., Parker Oliver, D., Dickey, G., Skubic, M. and Rantz, M.
(2008) Findings from a participatory evaluation of a smart home application for older adults. Technology and Health Care, 16(2), 111–118.
Fernaeus, Y., Håkansson, M., Jacobsson, M., & Ljungblad, S.
(2010) How do you play with a robotic toy animal?: A long-term study of pleo. Paper presented at the International Conference on Interaction Design and Children (IDC 2010), Barcelona, Spain.
Festinger, L.
(1957) A theory of cognitive dissonance. Stanford, CA, USA: Stanford University Press.
Fink, J., Bauwens, V., Kaplan, F., & Dillenbourg, P.
(2013) Living with a vacuum cleaning robot: A 6-month ethnographic study. International Journal of Social Robotics, 5(3), 389–408.
Forlizzi, J., & DiSalvo, C.
(2006) Service robots in the domestic environment: A study of the Roomba vacuum in the home. Paper presented at the Conference on Human-Robot Interaction, Salt Lake City, Utah.
Fulk, J.
(1993) Social construction of communication technology. Academy of Management Journal, 36(5), 921–950.
de Graaf, M.M.A., & Ben Allouch, S.
(2013) Exploring influencing variables for the acceptance of social robots. Robotics and Autonomous Systems, 16, 1476–1486.
de Graaf, M.M.A., Ben Allouch, S., & Klamer, T.
(2015) Sharing a life with Harvey: Exploring the acceptance of and relationship building with a social robot. Computers in Human Behavior, 43, 1–14.
Hackbarth, G., Grover, V., & Yi, M.Y.
(2003) Computer playfulness and anxiety: positive and negative mediators of the system experience effect on perceived ease of use. Information & Management, 40(3), 221–232.
Hancock, P.A., Billings, D.R., Schaefer, K.E., Chen, J.Y.C., de Visser, E.J., & Parasuraman, R.
(2011) A meta-analysis of factors affecting trust in human-robot interaction. The Journal of the Human Factors and Ergonomics, 53(5), 517–527.
Hedeker, D., & Gibbons, R.D.
(1997) Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychological Methods, 2, 64–78.
Heerink, M., Kröse, B., Evers, V., & Wielinga, B.
(2010) Assessing acceptance of assistive social agent technology by older adults: The Almere model. International Journal of Social Robotics, 2(4), 361–375.
Kahn, P. H., Friedman, B., Perez-Granados, D.R., & Freier, N.G.
(2006) Robotic pets in the lives of preschool children. Interaction Studies, 7(3), 405–436.
Kanda, T., Sato, R., Saiwaki, N., Ishiguro, H.
(2007) A two-month field trial in an elementary school for long-term human – robot interaction. IEEE Transactions on Robotics, 23(5), 962–971.
Karahanna, E., Straub, D.W., Chervany, N.L.
(1999) Information technology adoption across time: A cross-sectional comparison of pre-adoption and post-adoption beliefs. MIS Quarterly, 23(2), 183–213.
Karahanna, E., & Limayem, M.
(2000) E-mail and V-mail usage: Generalizing across technologies. Journal of Organizational Computing and Electronic Commerce, 10(1), 49–66.[ p. 489 ]
Karapanos, E., Zimmermann, J., Forlizzi, J., & Martens, J.B.
(2009) User experience over time: An initial framework. Paper presented at the International Conference on Human Factors in Computing Systems (CHI 2009). Boston, Massachusetts, USA.
Kidd, C.D., & Breazeal, C.
(2008) Robots at home: Understanding long-term human-robot interaction. International Conference on Intelligent Robots and Systems (IROS 2008), Nice, France.
Komatsu, T., Kurosawa, R., & Yamada, S.
(2012) How does the difference between users’ expectations and perceptions about a robotic agent affect their behavior? International Journal of Social Robotics, 4(2), 109–116.
Lally, P., Jaarsveld, C.H.M. van, Potts, H.W.W., & Wardle, J.
(2009) How are habits formed: Modelling habit formation in the real world. European Journal of Social Psychology, 40(6), 998–1009.
Landis, J.R., & Koch, G.G.
(1977) The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.
LaRose, R., & Eastin, M.S.
(1994) A social cognitive theory of internet uses and gratifications: Toward a new model of media attendance. Journal of Broadcasting & Electronic Media, 48(3), 358–377.
LaRose, R., Lin, C. A., & Eastin, M. S.
(2003) Unregulated internet usage: Addiction, habit, or deficient self-regulation? Media Psychology, 5(3), 225–253.
Leite, I., Martinho, C., & Paiva, A.
(2013) Social Robots for Long-Term Interaction: A Survey. International Journal of Social Robotics, 5(2), 291–308.
Lohse, M.
(2011) Bridging the gap between users’ expectations and system evaluations. Paper presented at the International Symposium on Robot and Human Interactive Communication (RO-MAN 2011). Atlanta, GA, USA.
McCroskey, J.C., & Teven, J.J.
(1999) Goodwill: A reexamination of the construct and its measurement. Communication Monographs, 66, 90–103.
Mirlacher, T., Buchner, R., Förster, F., Weiss, A., & Tscheligi, M.
(2009) Ambient rabbits likeability of embodied ambient displays. Paper presented at the European Conference of Ambient Intelligence, Salzburg, Austria.
Moon, J. W., & Kim, J.G.
(2001) Extending the TAM for a world-wide-web context. Information & Management, 38(4), 217–230.
Nunnally, J.C.
(1978) Psychometric theory. New York, NY, USA: McGraw-Hill.
Paepcke, S., & Takayama, L.
(2010) Judging a bot by its cover: An experiment on expectation setting for personal robots. Paper presented at the International Conference on Human-Robot Interaction (HRI 2010). Osaka, Japan.
Peters, O., & Ben Allouch, S.
(2005) Always connected: A longitudinal field study of mible communication. Telematics and Informatics, 22, 239–256.
von der Pütten, A.M., Krämer, N.C., & Eimler, S.C.
(2011) Living with a robot companion: Empirical study on the interaction with an artificial health Advisor. Paper presented at the International Conference on Multimodal Interfaces (ICMI 2011). Alicante, Spain.P.L.P.
Li, D., Rau, P. P., & Li, Y.
(2010) A cross-cultural study: Effect of robot appearance and task. International Journal of Social Robotics, 2(2), 175–186.
Rogers, E.M.
(2003) Diffusion of innovations (5th edition). New York, NJ, USA: The Free Press.
Silverstone, R., & Haddon, L.
(1996) Design and the domestication of ICTs: Technical change and everyday life. In R. Silverstone, & R. Mansell (Eds.). Communication by design. The politics of information and communication technologies (pp. 44–74). Oxford: Oxford press.[ p. 490 ]
Sung, J.Y., Christensen, H.I., & Grinter, R.E.
(2009) Robots in the wild: Understanding long-term use. Paper presented at the International Conference on Human Robot Interaction (HRI 2009). La Jolla, California, USA.
Sung, J.Y., Grinter, R.E., & Christensen, H.I.
(2010) Domestic robot ecology: An initial framework to unpack long-term acceptance of robots at home. International Journal of Social Robotics, 2(4), 417–429.
Taylor, S., & Todd, P.A.
(1995) Understanding information technology usage: A test of competing models. Information Systems Research, 6(2), 144–176.
Thompson, R. L., Higgins, C., & Howell, J.M.
(1991) Personal Computing: Toward a Conceptual Model of Utilization. MIS Quarterly, 15(1), 125–143.
Venkatesh, V.
(2000) Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Information Systems Research, 11(4), 342–365.
Venkatesh, V., & Davis, F.D.
(2000) A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186–204.
Zanna, M.P., & Rempel, J.K.
(1988) Attitudes: A New Look at an Old Concept. In D. Bar-Tal, & A.W. Kruglanski (Ed.). The Social Psychology of Knowledge (pp. 315–334). New York, NY, USA: Cambridge University Press.[ p. 491 ]
Cited by
Cited by 34 other publications
Allan, D. D., Andrew J. Vonasch & Christoph Bartneck
2021. The Doors of Social Robot Perception: The Influence of Implicit Self-theories.
International Journal of Social Robotics
Almahameed, Ala, Dana AlShwayat, Mario Arias-Oliva & Jorge Pelegrín-Borondo
2020. ROBOTS IN EDUCATION: A JORDANIAN UNIVERSITY CASE STUDY.
Journal of Management and Business Education 3:2 ► pp. 164 ff.
Aoyagi, Saizo, Satoshi Fukumori & Michiya Yamamoto
2020.
In Human Interface and the Management of Information. Interacting with Information [Lecture Notes in Computer Science, 12185],
► pp. 131 ff.
Banks, Jamie & Maartje de Graaf
2020. Toward an Agent-Agnostic Transmission Model: Synthesizing Anthropocentric and Technocentric Paradigms in Communication.
Human-Machine Communication 1 ► pp. 19 ff.
Blond, Lasse
2019. Studying robots outside the lab: HRI as ethnography.
Paladyn, Journal of Behavioral Robotics 10:1 ► pp. 117 ff.
Chung, Kyungjin, Young Hoon Oh & Da Young Ju
2019.
In Proceedings of the 7th International Conference on Human-Agent Interaction,
► pp. 277 ff.
Davison, Daniel P., Frances M. Wijnen, Vicky Charisi, Jan van der Meij, Vanessa Evers & Dennis Reidsma
2020.
In Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction,
► pp. 63 ff.
de Graaf, Maartje M. A.
2016. An Ethical Evaluation of Human–Robot Relationships.
International Journal of Social Robotics 8:4 ► pp. 589 ff.
de Graaf, Maartje M. A., Somaya Ben Allouch & Jan A. G. M. van Dijk
2019. Why Would I Use This in My Home? A Model of Domestic Social Robot Acceptance.
Human–Computer Interaction 34:2 ► pp. 115 ff.
de Jong, Chiara, Jochen Peter, Rinaldo Kuhne, Caroline van Straten & Alex Barco
2021.
In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN),
► pp. 598 ff.
de Jong, Chiara, Jochen Peter, Rinaldo Kühne & Alex Barco
2019. Children’s acceptance of social robots.
Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 20:3 ► pp. 393 ff.
de la Puente, Paloma, Markus Bajones, Christian Reuther, Daniel Wolf, David Fischinger & Markus Vincze
2019. Robot Navigation in Domestic Environments: Experiences Using RGB-D Sensors in Real Homes.
Journal of Intelligent & Robotic Systems 94:2 ► pp. 455 ff.
Dereshev, Dmitry, David Kirk, Kohei Matsumura & Toshiyuki Maeda
2019.
In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.
Dudek, Melanie, Stefanie Baisch, Monika Knopf & Thorsten Kolling
2020. “THIS ISN’T ME!”: The Role of Age-Related Self- and User Images for Robot Acceptance by Elders.
International Journal of Social Robotics
Edwards, Chad, Autumn Edwards, Jihyun Kim, Patric R. Spence, Maartje de Graaf, Seungahn Nah & Astrid Rosenthal-von der Putten
2019.
In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI),
► pp. 673 ff.
Fu, Changzeng, Yuichiro Yoshikawa, Takamasa Iio & Hiroshi Ishiguro
2021. Sharing Experiences to Help a Robot Present Its Mind and Sociability.
International Journal of Social Robotics 13:2 ► pp. 341 ff.
Gomez-Donoso, Francisco, Félix Escalona, Francisco Miguel Rivas, Jose Maria Cañas & Miguel Cazorla
2019. Enhancing the Ambient Assisted Living Capabilities with a Mobile Robot.
Computational Intelligence and Neuroscience 2019 ► pp. 1 ff.
Gracia, Luis, J. Ernesto Solanes, Pau Muñoz-Benavent, Jaime Valls Miro, Carlos Perez-Vidal & Josep Tornero
2019. Human-robot collaboration for surface treatment tasks.
Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 20:1 ► pp. 148 ff.
Hoorn, Johan F.
2020. Theory of Robot Communication: II. Befriending a Robot Over Time.
International Journal of Humanoid Robotics 17:06 ► pp. 2050027 ff.
Jaeger, Christopher Brett, Alicia M. Hymel, Daniel T. Levin, Gautam Biswas, Natalie Paul & John Kinnebrew
2019. The interrelationship between concepts about agency and students’ use of teachable-agent learning technology.
Cognitive Research: Principles and Implications 4:1
Jaschinski, Christina, Somaya Ben Allouch, Oscar Peters, Ricardo Cachucho & Jan A G M van Dijk
2021. Acceptance of Technologies for Aging in Place: A Conceptual Model.
Journal of Medical Internet Research 23:3 ► pp. e22613 ff.
Jung, Minjoo, May Jorella S. Lazaro & Myung Hwan Yun
2021. Evaluation of Methodologies and Measures on the Usability of Social Robots: A Systematic Review.
Applied Sciences 11:4 ► pp. 1388 ff.
Michaelis, Joseph E. & Bilge Mutlu
2019.
In Proceedings of the 18th ACM International Conference on Interaction Design and Children,
► pp. 71 ff.
Montaño-Serrano, Victor Manuel, Juan Manuel Jacinto-Villegas, Adriana Herlinda Vilchis-González & Otniel Portillo-Rodríguez
2021. Artificial Vision Algorithms for Socially Assistive Robot Applications: A Review of the Literature.
Sensors 21:17 ► pp. 5728 ff.
Oh, Young Hoon & Da Young Ju
2020. Age-Related Differences in Fixation Pattern on a Companion Robot.
Sensors 20:13 ► pp. 3807 ff.
Paldán, Katrin, Andreas Künz, Walter Ritter & Daire O. Broin
2021.
In Human-Computer Interaction. Interaction Techniques and Novel Applications [Lecture Notes in Computer Science, 12763],
► pp. 446 ff.
Peek, S. T. M., K. G. Luijkx, H. J. M. Vrijhoef, M. E. Nieboer, S. Aarts, C. S. van der Voort, M. D. Rijnaard & E. J. M. Wouters
2019. Understanding changes and stability in the long-term use of technologies by seniors who are aging in place: a dynamical framework.
BMC Geriatrics 19:1
Randall, Natasha, Selma Šabanović, Staša Milojević & Apurva Gupta
2021. Top of the Class: Mining Product Characteristics Associated with Crowdfunding Success and Failure of Home Robots.
International Journal of Social Robotics
Reinhardt, Delphine, Monisha Khurana & Luca Hernández Acosta
2021. “I still need my privacy”: Exploring the level of comfort and privacy preferences of German-speaking older adults in the case of mobile assistant robots.
Pervasive and Mobile Computing 74 ► pp. 101397 ff.
Rossi, Alessandra, Kerstin Dautenhahn, Kheng Lee Koay, Michael L. Walters & Patrick Holthaus
2020.
In Social Robotics [Lecture Notes in Computer Science, 12483],
► pp. 453 ff.
Rossi, Silvia, Alessandra Rossi & Kerstin Dautenhahn
2020. The Secret Life of Robots: Perspectives and Challenges for Robot’s Behaviours During Non-interactive Tasks.
International Journal of Social Robotics 12:6 ► pp. 1265 ff.
Simão, Hugo & Tiago Guerreiro
2019.
In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems,
► pp. 1 ff.
Spatola, Nicolas
2019. L’interaction Homme-Robot, de l’anthropomorphisme à l’humanisation.
L’Année psychologique 119:4 ► pp. 515 ff.
Tobis, Slawomir, Agnieszka Neumann-Podczaska, Sylwia Kropinska & Aleksandra Suwalska
2021. UNRAQ—A Questionnaire for the Use of a Social Robot in Care for Older Persons. A Multi-Stakeholder Study and Psychometric Properties.
International Journal of Environmental Research and Public Health 18:11 ► pp. 6157 ff.
This list is based on CrossRef data as of 14 september 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.