Groups in human-agent interaction
Robots as an interactive-social medium in storytelling to multiple children
Masahiro Shiomi | Interaction Science Labs., ATR
Katsunori Shimohara | Doshisha University
Norihiro Hagita | Interaction Science Labs., ATR
This paper investigates the effects of group interaction in a storytelling situation for children using two robots: a reader robot and a listener robot as a side-participant. We developed a storytelling system that consists of a reader robot, a listener robot, a display, a gaze model, a depth sensor, and a human operator who responds and provides easily understandable answers to the children’s questions. We experimentally investigated the effects of using a listener robot and either one or two children during a storytelling situation on the children’s preferences and their speech activities. Our experimental results showed that the children preferred storytelling with the listener robot. Although two children obviously produced more speech than one child, the listener robot discouraged the children’s speech regardless of whether one or two were listening.
Article outline
- 1.Introduction
- 2.Related work
- 2.1Robot as an information-providing medium
- 2.2Interactive storytelling-robot systems for children
- 3.System overview
- 3.1Human-tracking system
- 3.2Gaze model
- 3.3Robot
- 3.4Details of implemented behavior
- 3.5Operator
- 4.Experiment
- 4.1Hypotheses and predictions about children’s speech activities and the number of robots
- 4.2Participants
- 4.3Conditions
- 4.4Environment
- 4.5Procedure
- 4.6Measurements
- 5.Results
- 5.1Observations
- 5.2Verification of prediction: Speech activities based on the number of children and robots
- 5.3Additional analysis of subjective impressions
- 5.4Children’s behaviors analysis
- 5.4.1Behavior category of children
- 5.4.2Conversation topics of children
- 5.4.3Touch behaviors between robots and children
- 6.Discussion
- 6.1Implications of experiment results
- 6.2Design implications for application perspective
- 6.3Toward (semi-) autonomous storytelling
- 6.4Limitations
- 7.Conclusion
- Conflict of interest
- Acknowledgements
-
References
Published online: 17 September 2021
https://doi.org/10.1075/is.18033.tam
https://doi.org/10.1075/is.18033.tam
References
Alborzi, H., A. Druin, J. Montemayor, M. Platner, J. Porteous, L. Sherman, A. Boltman, G. Taxén, J. Best, and J. Hammer
Arai, H., M. Kimoto, T. Iio, K. Shimohara, R. Matsumura, and M. Shiomi
Bers, M. U., and J. Cassell
Cohen, J.
Collins, F.
Dahlbäck, N., A. Jönsson, and L. Ahrenberg
Fails, J. A., A. Druin, and M. L. Guha
Fourati, N., A. Richard, S. Caillou, N. Sabouret, J.-C. Martin, E. Chanoni, and C. Clavel
(2016) “Facial Expressions of Appraisals Displayed by a Virtual Storyteller for Children,” Intelligent Virtual Agents: 16th International Conference, IVA 2016, Los Angeles, CA, USA, September 20–23, 2016, Proceedings, D. Traum, W. Swartout, P. Khooshabeh et al., eds., pp. 234–244, Cham: Springer International Publishing. 

Fridin, M.
Gharbi, M., P. V. Paubel, A. Clodic, O. Carreras, R. Alami, and J. M. Cellier
Glas, D. F., T. Kanda, H. Ishiguro, and N. Hagita
Gordon, G., S. Spaulding, J. Kory Westlund, J. J. Lee, L. Plummer, M. Martinez, M. Das, and C. Breazeal
Gross, H.-M., H. Boehme, C. Schroeter, S. Müller, A. König, E. Einhorn, C. Martin, M. Merten, and A. Bley
Hato, Y., S. Satake, T. Kanda, M. Imai, and N. Hagita
Huisman, G.
Iio, T., Y. Yoshikawa, and H. Ishiguro
Isbell, R., J. Sobol, L. Lindauer, and A. Lowrance
Kanda, T., H. Ishiguro, T. Ono, M. Imai, and K. Mase
Karatas, N., S. Yoshikawa, P. R. S. De Silva, and M. Okada
(2015) “Namida: Multiparty conversation based driving agents in futuristic vehicle,” in International Conference on Human-Computer Interaction, pp. 198–207.
Kennedy, J., V. Lemaignan, C. Montassier, P. Lavalade, B. Irfan, F. Papadopoulos, E. Senft, and T. Belpaeme
Komatsubara, T., M. Shiomi, T. Kanda, and H. Ishiguro
Komatsubara, T., M. Shiomi, T. Kanda, H. Ishiguro, and N. Hagita
Kory, J., and C. Breazeal
(2014) “Storytelling with robots: Learning companions for preschool children’s language development,” in Robot and Human Interactive Communication, 2014 RO-MAN: The 23rd IEEE International Symposium on, pp. 643–648.
Lee, M. K., S. Kiesler, and J. Forlizzi
Leite, I., M. McCoy, M. Lohani, D. Ullman, N. Salomons, C. Stokes, S. Rivers, and B. Scassellati
Lombard, M., J. Snyder-Duch, and C. C. Bracken
Matsuyama, Y., I. Akiba, A. Saito, and T. Kobayashi
(2013) “A Four-Participant Group Facilitation Framework for Conversational Robots,” in Proceedings of the SIGDIAL 2013 Conference, pp. 284–293.
Matsumura, R., M. Shiomi, T. Miyashita, H. Ishiguro, and N. Hagita
Mutlu, B., J. Forlizzi, and J. Hodgins
(2006) “A storytelling robot: Modeling and evaluation of human-like gaze behavior,” in The 6th IEEE-RAS international conference on Humanoid robots, pp. 518–523.
Mutlu, B., T. Kanda, J. Forlizzi, J. Hodgins, and H. Ishiguro
Mutlu, B., T. Shiwa, T. Kanda, H. Ishiguro, and N. Hagita
Nourbakhsh, I. R., C. Kunz, and T. Willeke
(2003) “The mobot museum robot installations: A five year experiment,” in IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003.(IROS 2003). pp. 3636–3641.
Park, H. W., M. Gelsomini, J. J. Lee, and C. Breazeal
Powers, A., S. Kiesler, S. Fussell, and C. Torrey
Roussou, M.
Sakamoto, D., K. Hayashi, T. Kanda, M. Shiomi, S. Koizumi, H. Ishiguro, T. Ogasawara, and N. Hagita
Satake, S., K. Hayashi, K. Nakatani, and T. Kanda
Satake, S., T. Kanda, D. F. Glas, M. Imai, H. Ishiguro, and N. Hagita
Shi, C., M. Shiomi, T. Kanda, H. Ishiguro, and N. Hagita
Shi, C., M. Shiomi, C. Smith, T. Kanda, and H. Ishiguro
Shinozawa, K., F. Naya, J. Yamato, and K. Kogure
Shiomi, M., T. Kanda, I. Howley, K. Hayashi, and N. Hagita
Shiomi, M., T. Kanda, H. Ishiguro, and N. Hagita
Shiomi, M., D. Sakamoto, T. Kanda, C. T. Ishi, H. Ishiguro, and N. Hagita
Shiomi, M., K. Shinozawa, Y. Nakagawa, T. Miyashita, T. Sakamoto, T. Terakubo, H. Ishiguro, and N. Hagita
Short, E. S., K. Swift-Spong, H. Shim, K. M. Wisniewski, D. K. Zak, S. Wu, E. Zelinski, and M. J. Matarić
Tamura, Y., M. Kimoto, M. Shiomi, T. Iio, K. Shimohara, and N. Hagita
Toh, L. P. E., A. Causo, P. W. Tzuo, I.-M. Chen, and S. H. Yeo
Van Gils, F.
(2005) “Potential applications of digital storytelling in education,” in 3rd Twente student conference on IT.
Vázquez, M., A. Steinfeld, S. E. Hudson, and J. Forlizzi
Wada, K., D. F. Glas, M. Shiomi, T. Kanda, H. Ishiguro, and N. Hagita
Yamaoka, F., T. Kanda, H. Ishiguro, and N. Hagita
Yamazaki, A., K. Yamazaki, Y. Kuno, M. Burdelski, M. Kawashima, and H. Kuzuoka