Article published in:
Interaction Studies
Vol. 17:3 (2016) ► pp. 408–437

Robots Showing Emotions

Emotion Representation with no bio-inspired body

| Politecnico di Milano
Robots should be able to represent emotional states to interact with people as social agents. There are cases where robots cannot have bio-inspired bodies, for instance because the task to be performed requires a special shape, as in the case of home cleaners, package carriers, and many others. In these cases, emotional states have to be represented by exploiting movements of the body. In this paper, we present a set of case studies aimed at identifying specific values to convey emotion trough changes in linear and angular velocities, which might be applied on different non-anthropomorphic bodies. This work originates from some of the most considered emotion expression theories and from emotion coding for people. We show that people can recognize some emotional expressions better than others, and we propose some directions to express emotions exploiting only bio-neutral movement.
Keywords: Emotion expression, human-robot interaction, social robotics, case studies, nonantropomorphic platform, emotion expression with non-antropmorphic platform
Article outline
  • Introduction
  • Related work
  • System
    • Robotic platform
  • Case studies
  • First case study: Empirical emotion parameters
    • Experimental design
    • Emotion description
    • Experimental setup
    • Results
  • Second case study: Addition of context
    • Experimental design
    • Experimental setup
    • Results
  • Third case study: Literature emotional parameters
    • Experimental design
    • Emotion description
    • Experimental setup
    • Results
  • Fourth case study: Experiment cross-validation
    • Experimental design
    • Emotion descriptions
    • Experimental setup
    • Results
  • Conclusions and further work
  • Note
  • References
Published online: 30 March 2017
https://doi.org/10.1075/is.17.3.06ang
References
Angel-Fernandez, J. M., & Bonarini, A.
(2016) Identifying values to express emotions with a non-anthropomorphic platform. (Manuscript in preparation)Google Scholar
Barakova, E. I., & Lourens, T.
(2010) Expressing and interpreting emotional movements in social games with robots. Personal and Ubiquitous Computing, 14(5), 457–467. CrossrefGoogle Scholar
Beck, A., Cañamero, L., & Bard, K.
(2010) Towards an affect space for robots to display emotional body language. In Ieee roman conference.Google Scholar
Beck, A., Hiolle, A., Mazel, A., & Cañamero, L.
(2010) Interpretation of emotional body language displayed by robots. In 3rd acm workshop on affective interaction in natural environments (p. 37–42). CrossrefGoogle Scholar
Breazeal, C.
(2002) Designing sociable robots. Cambridge, MA, USA: MIT Press.Google Scholar
Brown, L., & Howard, A. M.
(2014, Aug). Gestural behavioral implementation on a humanoid robotic platform for effective social interaction. In Robot and human interactive communication, 2014 ro-man: The 23rd ieee international symposium on robot and human interactive communication (p. 471–476). CrossrefGoogle Scholar
Cacioppo, J., Tassinary, L., & Berntson, G.
(2000) Handbook of psychophysiology. University Press.Google Scholar
Crane, E., & Gross, M.
(2013) Effort-shape characteristics of emotion-related body movement. Journal of Nonverbal Behavior, 37(2), 91–105. CrossrefGoogle Scholar
Destephe, M., Zecca, M., Hashimoto, K., & Takanishi, A.
(2013, Dec). Perception of emotion and emotional intensity in humanoid robots gait. In Robotics and biomimetics (robio), 2013 ieee international conference on (p. 1276–1281). CrossrefGoogle Scholar
Ekman, P.
(2004) Emotions Revealed: Recognizing Faces and Feelings to Improve Communication and Emotional Life. Owl Books. CrossrefGoogle Scholar
Embgen, S., Luber, M., Becker-Asano, C., Ragni, M., Evers, V., & Arras, K. O.
(2012, September). Robot-specific social cues in emotional body language. In Robot and human interactive communication, 2012 ro-man: The 21st ieee international symposium on robot and human interactive communication (pp. 1019–1025). USA: IEEE Computer Society. CrossrefGoogle Scholar
from Jed Wing, M. K. C., Weston, S., Williams, A., Keefer, C., & Engelhardt, A. (2012) caret: Classification and regression training [Computer software manual]. Retrieved from http://​CRAN​.R​-project​.org​/package​=caret (R package version 51.15–044)
Hayes, A. F., & Krippendorff, K.
(2007) Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1(1), 77–89. CrossrefGoogle Scholar
Hiah, L., Beursgens, L., Haex, R., Romero, L. P., Teh, Y., ten Bhömer, M., … Barakova, E. I.
(2013) Abstract robots with an attitude: Applying interpersonal relation models to human-robot interaction. In Robot and human interactive communication, 2013 ro-man: The 22nd ieee international symposium on robot and human interactive communication, gyeongju, korea (south), august 26–29, 2013 (pp. 37–44). CrossrefGoogle Scholar
Kaya, N., & Epps, H. H.
(2004, September 01). Relationship between color and emotion: a study of college students. College student journal, 38(3). Retrieved from http://​eab​.sagepub​.com​/search​?fulltext​=environment\%20psychology\​&\#38;sortspec​=date\​&\#38;submit​=Submit\​&\#38;andorexactfulltext​=phrase\​&\#38;src​=selected\​&\#38;journal\​_set​=speab
Kleinsmith, A., & Bianchi-Berthouze, N.
(2013) Affective body expression perception and recognition: A survey. IEEE Transactions on Affective Computing, 4(1), 15–33. CrossrefGoogle Scholar
Laban, R., & Ullmann, L.
(1968) Modern educational dance (2d ed., rev. by Lisa Ullmann. ed.) [Book]. Praeger New York.Google Scholar
Lakatos, G., Gacsi, M., Konok, V., Bruder, I., Berczky, B., Korondi, P., & Miklosi, A.
(2014, December). Emotion attribution to a non-humanoid robot in different social situations. PLos ONE. CrossrefGoogle Scholar
Lang, P. J., Bradley, M. M., & Cuthbert, B. N.
(2008) International affective picture system (IAPS): Affective ratings of pictures and instruction manual (Tech. Rep. No. A-8). Gainesville, FL: The Center for Research in Psychophysiology, University of Florida. Retrieved from http://​csea​.phhp​.ufl​.edu​/Media​.html
Li, J., & Chignell, M. H.
(2011) Communication of emotion in social robots through simple head and arm movements. I. J. Social Robotics, 3(2), 125–142. CrossrefGoogle Scholar
Marsella, S., Gratch, J., & Petta, P.
(2010) A blueprint for affective computing. In (p. 21–46). Oxford University Press.Google Scholar
Nam, T.-J., Lee, J.-H., Park, S., & Suk, H.-J.
(2014) Understanding the relation between emotion and physical movements. International Journal of Affective Engineering, 13(3), 217–226. CrossrefGoogle Scholar
Novikova, J., & Watts, L.
(2015) Towards artificial emotions to assist social coordination in hri. International Journal of Social Robotics, 7(1), 77–88. CrossrefGoogle Scholar
Plutchik, R.
(2001) The Nature of Emotions. American Scientist, 89(4), 344+. CrossrefGoogle Scholar
Pratto, F., Sidanius, J., Stallworth, L. M., & Malle, B. F.
(1994) Social dominance orientation: A personality variable predicting social and political attitudes. Journal of personality and social psychology, 67(4), 741. CrossrefGoogle Scholar
Roether, C. L., Omlor, L., Christensen, A., & Giese, M. A.
(2009) Critical features for the perception of emotion from gait. Journal of Vision, 9(6), 15. CrossrefGoogle Scholar
Russell, J. A., Bachorowski, J. A., & Dols, J. M. F.
(2003) Facial and Vocal Expressions of Emotion. Annual Review of Psychology, 54(1), 329–349. Retrieved from CrossrefGoogle Scholar
Saerbeck, M., & Bartneck, C.
(2010) Perception of affect elicited by robot motion. In Proceedings of the 5th acm/ieee international conference on human-robot interaction (pp. 53–60). Piscataway, NJ, USA: IEEE Press.Google Scholar
Saerbeck, M., & van Breemen, A. J. N.
(2007) Design guidelines and tools for creating believable motion for personal robots. In Ro-man (p. 386–391).Google Scholar
Sharma, M., Hildebrandt, D., Newman, G., Young, J. E., & Eskicioglu, R.
(2013) Communicating affect via flight path: Exploring use of the laban effort system for designing affective locomotion paths. In Proceedings of the 8th acm/ieee international conference on human-robot interaction (pp. 293–300). Piscataway, NJ, USA: IEEE Press.Google Scholar
Venture, G., Kadone, H., Zhang, T., Grèzes, J., Berthoz, A., & Hicheur, H.
(2014) Recognizing emotions conveyed by human gait. International Journal of Social Robotics, 6(4), 621–632. CrossrefGoogle Scholar
Watson, D., Clark, L. A., & Tellegen, A.
(1988) Development and validation of brief measures of positive and negative affect: the panas scales. Journal of Personality and Social Psychology, 541, 1063–1070. CrossrefGoogle Scholar
Cited by

Cited by 6 other publications

Angel-Fernandez, Julian M. & Andrea Bonarini
2017.  In 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), ► pp. 424 ff. Crossref logo
Gracia, Luis, J. Ernesto Solanes, Pau Muñoz-Benavent, Jaime Valls Miro, Carlos Perez-Vidal & Josep Tornero
2019. Human-robot collaboration for surface treatment tasks. Interaction Studies. Social Behaviour and Communication in Biological and Artificial Systems 20:1 ► pp. 148 ff. Crossref logo
Hoggenmueller, Marius, Jiahao Chen & Luke Hespanhol
2020.  In Proceedings of the 9TH ACM International Symposium on Pervasive Displays, ► pp. 87 ff. Crossref logo
Marmpena, Mina, Angelica Lim & Torbjørn S. Dahl
2018. How does the robot feel? Perception of valence and arousal in emotional body language. Paladyn, Journal of Behavioral Robotics 9:1 ► pp. 168 ff. Crossref logo
Park, Soomi, Patrick G. T. Healey & Antonios Kaniadakis
2021.  In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff. Crossref logo
Rincon, Liz, Enrique Coronado, Hansen Hendra, Julyando Phan, Zur Zainalkefli & Gentiane Venture
2018.  In 2018 3rd International Conference on Control and Robotics Engineering (ICCRE), ► pp. 11 ff. Crossref logo

This list is based on CrossRef data as of 15 april 2022. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.