Revisiting the DARPA communicator data using conversation analysis
Peter Wallis | The University of Sheffield, Department of Computer Science, UK
The state of the art in human computer conversation leaves something to be desired and, indeed, talking to a computer can be down-right annoying. This paper describes an approach to identifying “opportunities for improvement” in these systems by looking for abuse in the form of swear words. The premise is that humans swear at computers as a sanction and, as such, swear words represent a point of failure where the system did not behave as it should. Having identified where things went wrong, we can work backward through the transcripts and, using conversation analysis (CA) work out how things went wrong. Conversation analysis is a qualitative methodology and can appear quite alien — indeed unscientific — to those of us from a quantitative background. The paper starts with a description of Conversation analysis in its modern form, and then goes on to apply the methodology to transcripts of frustrated and annoyed users in the DARPA Communicator project. The conclusion is that there is at least one species of failure caused by the inability of the Communicator systems to handle mixed initiative at the discourse structure level. Along the way, I hope to demonstrate that there is an alternative future for computational linguistics that does not rely on larger and larger text corpora.
Mlynář, Jakub, Lynn de Rijk, Andreas Liesenfeld, Wyke Stommel & Saul Albert
2024. AI in situated action: a scoping review of ethnomethodological and conversation analytic studies. AI & SOCIETY
Payr, Sabine
2013. Virtual Butlers and Real People: Styles and Practices in Long-Term Use of a Companion. In Your Virtual Butler [Lecture Notes in Computer Science, 7407], ► pp. 134 ff.
Payr, Sabine
2015. Towards Human–Robot Interaction Ethics. In A Construction Manual for Robots' Ethical Systems [Cognitive Technologies, ], ► pp. 31 ff.
Payr, Sabine & Peter Wallis
2011. Socially Situated Affective Systems. In Emotion-Oriented Systems [Cognitive Technologies, ], ► pp. 501 ff.
Wallis, Peter
2011. FROM DATA TO DESIGN. Applied Artificial Intelligence 25:6 ► pp. 530 ff.
Wallis, Peter
2022. An Enactivist Account of Mind Reading in Natural Language Understanding. Multimodal Technologies and Interaction 6:5 ► pp. 32 ff.
This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.