“Talk to you later”
Doing social robotics with conversation analysis. Towards the development of an automatic system for the prediction of disengagement
This article presents an applied discussion of the possibility of integrating conversation analysis (CA) methodology into that of machine learning. The aim is to improve the detection of that which resembles disengagement in the interaction between a robot and a human. We offer a novel analytical assemblage at the heart of the two disciplines, and namely on the level of the annotation schemes provided by conversation analysis transcription methods. First, we demonstrate that the need for a stable structure in establishing an interaction scenario and in designing robot behaviours does not prevent the emergence of ordinariness or creativity among the participants engaged in this interaction. Secondly, based on an actual case, we emphasize the possibility of systematicness in CA transcription to support the choice (a) of the categories targeted by prediction methods and defined by the annotation scheme, and (b) of the verbal and non-verbal features used to create prediction models.
Keywords: social robotics, engagement, machine learning, multimodal features, annotation schemes, conversation analysis, transcription, closings
Published online: 20 May 2020
Bartneck, C., Belpaeme, T., Eyssel, F., Kanda, T., Keijsers, M., & Šabanović, S.
Beach, W. A.
Ben-Youssef, A., Clavel, C., Essid, S., Bilac, M., Chamoux, M., & Lim, A.
(2017) UE- HRI: a new dataset for the study of user engagement in spontaneous human- robot interactions. Paper presented at the 19th ACM International Conference on Multimodal Interaction, Glasgow, UK.
Campano, S., Clavel, C., & Pélachaud, C.
(2015) “I like this painting too”: when an ECA shares appreciations to engage users. Paper presented at the 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS’15), Istanbul, Turkey.
Cassell, J., Torres, O., & Prevost, S.
Clavel, C., Vasilescu, I., & Devillers, L.
Clavel, C., Cafaro, A., Campano, S., & Pelachaud, C.
Clavel, C., & Callejas, Z.
Cowie, R., & Cornelius, R. R.
Dickerson, P., Robins, B., & Dautenhahn, K.
Duranti, A., & Goodwin, C.
Fong, T., Nourbakhsh, I., & Dautenhahn, K.
Ford, C., & Thompson, S.
Langlet, C., & Clavel, C.
(2014) Modelling user’s attitudinal reactions to the agent utterances: focus on the verbal content. Paper presented at the 5th International Workshop on Corpora for Research on Emotion, Sentiment & Social Signals (ES3 2014), Reykjavik, Iceland.
Licoppe, C., & Figeac, J.
Licoppe, C., & Rollet, N.
Pelachaud, C., & Glas, N.
(2015a) Definitions of Engagement in Human-Agent Interaction. Paper presented at the International Workshop on Engagement in Human Computer Interaction (ENHANCE), Xi’an, China.
(2015b) Topic transition strategies for an information-giving agent. Paper presented at the 15th European Workshop on natural Language Generation, Brighton, UK.
Pelikan, H. R. M., & Broth, M.
Pitsch, K., Kuzuoka, H., Suzuki, Y., Süssenbach, L., Luff, P., & Heath, C.
(2009) “The first five seconds”: Contingent stepwise entry into an interaction as a means to secure sustained engagement in Human-Robot-Interaction. Paper presented at the IEEE International Symposium on Robot and Human Interactive Communication ROMAN 2009, Toyama, Japan.
Porcheron, M., Fischer, J. E., Reeves, S., & Sharples, S.
Rollet, N., Jain, V., Licoppe, C., & Devillers, L.
(2017) Towards Interactional Symbiosis: Epistemic Balance and Co-presence in a Quantified Self Experiment. In L. Gamberini, A. Spagnolli, G. Jacucci, B. Blankertz, & J. Freeman (Eds.), Symbiotic Interaction: 5th International Workshop, Symbiotic 2016, Padua, Italy, September 29–30, 2016, Revised Selected Papers (pp. 143–154). Cham: Springer International Publishing.
Sacks, H., Schegloff, E. A., & Jefferson, G.
Sadazuka, K., Kuno, Y., Kawashima, M., & Yamazaki, K.
Sidner, C. L., & Dzikovska, M.
(2002 16–16 Oct. 2002) Human-robot interaction: engagement between humans and robots for hosting activities. Paper presented at the 4th IEEE International Conference on Multimodal Interfaces, Pittsburgh, USA.
Sidner, C. L., Lee, C., Kidd, C. D., & Rich, C.
Šabanović, S., & Chang, W.-L.
Yu, Z., Scherer, S., Devault, D., Gratch, J., Stratou, G., Morency, L., & Cassell, J.
(2013) Multimodal Prediction of Psychological Disorder: Learning Verbal and Nonverbal Commonality in Adjacency Pairs. Paper presented at the 17th Workshop Series on the Semantics and Pragmatics of Dialogue, Amsterdam, Netherland.
(2006) How closing matters in emergency telephone calls. Paper presented at the Annual meeting of the American Sociology Association, Montréal, Canada.
Cited by 1 other publications
Kopp, Stefan & Nicole Krämer
This list is based on CrossRef data as of 28 october 2021. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.