What’s to bullying a bot?
Correlates between chatbot humanlikeness and abuse
Merel Keijsers | University of Canterbury
Christoph Bartneck | University of Canterbury
Friederike Eyssel | Bielefeld University
In human-chatbot interaction, users casually and regularly offend and abuse the chatbot they are interacting with. The current paper explores the relationship between chatbot humanlikeness on the one hand and sexual advances and verbal aggression by the user on the other hand. 283 conversations between the Cleverbot chatbot and its users were harvested and analysed. Our results showed higher counts of user verbal aggression and sexual comments towards Cleverbot when Cleverbot appeared more humanlike in its behaviour. Caution is warranted with the interpretation of the results however as no experimental manipulation was conducted and causality can thus not be inferred. Nonetheless, the findings are relevant for both the research on the abuse of conversational agents, and the development of efficient approaches to discourage or prevent verbal aggression by chatbot users.
Article outline
- 1.Introduction
- 1.1Literature
- 1.1.1Incidence: Nonhuman conversation agents suffer more abuse than humans
- 1.1.2Ethical implications
- 1.1.3Need for a theoretical framework of chatbot abuse
- 1.2Current study
- 1.1Literature
- 2.Method
- 2.1Procedure
- 2.2Dataset
- 2.2.1Data collection
- 2.3Coding procedure
- 2.4Variables
- 2.4.1Coded variables
- Verbal aggression (Offence)
- Sexual references (SexRef)
- Nonsensical reply by Cleverbot (Nonsense)
- Insult by Cleverbot (Insult)
- Claiming to be (not) human (Humanity/Non-human user)
- Gender
- 2.4.2Other variables
- Turn count
- Approximate Loebner test (Loebner)
- 2.4.1Coded variables
- 3.Results
- 3.1Preliminary analyses
- 3.1.1Conversation descriptives
- 3.1.2Agreement
- 3.2Main analyses
- 3.2.1Verbal aggression
- 3.2.2Sexual comments
- 3.1Preliminary analyses
- 4.Discussion
- 4.1Limitations
- 4.2Conclusion
- Acknowledgements
- Notes
-
References
Published online: 17 September 2021
https://doi.org/10.1075/is.20002.kei
https://doi.org/10.1075/is.20002.kei
References
Ardissono, L., Boella, G., and Lesmo, L.
Bartneck, C., Reichenbach, J., and Carpenter, J.
Bozdogan, H.
Brahnam, S.
Brahnam, S. and De Angeli, A.
Brscić, D., Kidokoro, H., Suehiro, Y., and Kanda, T.
Burnham, K. P. and Anderson, D. R.
Chin, H. and Yi, M. Y.
Connolly, J.
Cowie, H. and Berdondini, L.
Curry, A. C. and Rieser, V.
Darling, K.
De Angeli, A.
De Angeli, A. and Brahnam, S.
De Angeli, A., Brahnam, S., Wallis, P., and Dix, A.
De Angeli, A. and Carpenter, R.
De Angeli, A., Johnson, G. I., and Coventry, L.
De Swert, K.
Dindia, K., Fitzpatrick, M. A., and Kenny, D. A.
Fessler, L.
(2017a) Apple and amazon are under fire for siri and alexas responses to sexual harassment. https://qz.com/work/1151282/siri-and-alexa-are-under-fire-for-their-replies-to-sexual-harassment/
(2017b) We tested bots like siri and alexa to see who would stand up to sexual harassment. https://qz.com/911681/we-tested-apples-siri-amazon-echos-alexa-microsofts-cortana-and-googles-google-home-to-see-which-personal-assistant-bots-stand-up-for-themselves-in-the-face-of-sexual-harassment/
Haslam, N.
Haslam, N., Loughnan, S., Kashima, Y., and Bain, P.
Hern, A.
(2010) Apple made siri deflect questions on feminism, leaked papers reveal. https://www.theguardian.com/technology/2019/sep/06/apple-rewrote-siri-to-deflect-questions-about-feminism. [Online; recovered 23 June 2020].
Hill, J., Ford, W. R., and Farreras, I. G.
Ho, A., Hancock, J., and Miner, A. S.
Hutchinson, M. K. and Holtman, M. C.
Jay, T.
Katsyri, J., Forger, K., Mäkäräinen, M., and Takala, T.
Keijsers, M. and Bartneck, C.
Keijsers, M., Bartneck, C., and Kazmi, H. S.
Krach, S., Hegel, F., Wrede, B., Sagerer, G., Binkofski, F., and Kircher, T.
Lee, M. K., Kiesler, S., and Forlizzi, J.
Lortie, C. L. and Guitton, M. J.
Lowry, P. B., Zhang, J., Wang, C., and Siponen, M.
MacDorman, K. F. and Chattopadhyay, D.
Mauldin, M. L.
Moore, S.
Nass, C., Steuer, J., and Tauber, E. R.
Nomura, T., Kanda, T., Kidokoro, H., Suehiro, Y., and Yamada, S.
Oberman, L. M., McCleery, J. P., Ramachandran, V. S., and Pineda, J. A.
Paetzel, M., Peters, C., Nyström, I., and Castellano, G.
Pennebaker, J. W., Booth, R. J., Boyd, R. L., and Francis, M. E.
Pennebaker, J. W., Boyd, R. L., Jordan, K., and Blackburn, K.
Reeves, B. and Nass, C.
Rehm, M. and Krogsager, A.
Slater, M., Antley, A., Davison, A., Swapp, D., Guger, C., Barker, C., Pistrang, N., and Sanchez-Vives, M. V.
Sokol, N., Bussey, K., and Rapee, R. M.
Strait, M., Contreras, V., and Vela, C. D.
Tan, X. Z., Vázquez, M., Carter, E. J., Morales, C. G., and Steinfeld, A.
Veletsianos, G., Scharber, C., and Doering, A.
Whitby, B.