Article published In:
International Journal of Corpus LinguisticsVol. 10:4 (2005) ► pp.489–516
Using corpora in machine-learning chatbot systems
A chatbot is a machine conversation system which interacts with human users via natural conversational language. Software to machine-learn conversational patterns from a transcribed dialogue corpus has been used to generate a range of chatbots speaking various languages and sublanguages including varieties of English, as well as French, Arabic and Afrikaans. This paper presents a program to learn from spoken transcripts of the Dialogue Diversity Corpus of English, the Minnesota French Corpus, the Corpus of Spoken Afrikaans, the Qur'an Arabic-English parallel corpus, and the British National Corpus of English; we discuss the problems which arose during learning and testing. Two main goals were achieved from the automation process. One was the ability to generate different versions of the chatbot in different languages, bringing chatbot technology to languages with few if any NLP resources: the corpus-based learning techniques transferred straightforwardly to develop chatbots for Afrikaans and Qur'anic Arabic. The second achievement was the ability to learn a very large number of categories within a short time, saving effort and errors in doing such work manually: we generated more than one million AIML categories or conversation-rules from the BNC corpus, 20 times the size of existing AIML rule-sets, and probably the biggest AI Knowledge-Base ever.
Cited by
Cited by 79 other publications
Abashev, Almir, Ruslan Grigoryev, Karen Grigorian & Vladislav Boyko
2017. Programming Tools for Messenger-Based Chatbot System Organization: Implication for Outpatient and Translational Medicines. BioNanoScience 7:2 ► pp. 403 ff. 
Abbas, Noorhan, Thomas Pickard, Eric Atwell & Aisha Walker
2021. University Student Surveys Using Chatbots: Artificial Intelligence Conversational Agents. In Learning and Collaboration Technologies: Games and Virtual Environments for Learning [Lecture Notes in Computer Science, 12785], ► pp. 155 ff.
Abdulla, Hussam, Asim Mohammed Eltahir, Saleh Alwahaishi, Khalifa Saghair, Jan Platos & Vaclav Snasel
2022. 2022 26th International Conference on Circuits, Systems, Communications and Computers (CSCC), ► pp. 122 ff.
Adamopoulou, Eleni & Lefteris Moussiades
2020. Chatbots: History, technology, and applications. Machine Learning with Applications 2 ► pp. 100006 ff.
Addanki, Mounika, Priyanka Patra & Prameela Kandra
2022. Recent advances and applications of artificial intelligence and related technologies in the food industry. Applied Food Research 2:2 ► pp. 100126 ff.
Aoyon, Rifat Sarker, Yamin Ara, Tahsin Anzum Baptee, Md Sabbir Hossain, Mehrin Afroz, Humaion Kabir Mehedi & Annajiat Alim Rasel
2022. 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), ► pp. 598 ff.
Ashfaq, Muhammad, Jiang Yun, Shubin Yu & Sandra Maria Correia Loureiro
2020. I, Chatbot: Modeling the determinants of users’ satisfaction and continuance intention of AI-powered service agents. Telematics and Informatics 54 ► pp. 101473 ff.
Atwell, Eric Steven
2018. Classical and modern Arabic corpora. In Diachronic Corpora, Genre, and Language Change [Studies in Corpus Linguistics, 85], ► pp. 65 ff.
Baabdullah, Abdullah M., Ali Abdallah Alalwan, Raed S. Algharabat, Bhimaraya Metri & Nripendra P. Rana
2022. Virtual agents and flow experience: An empirical examination of AI-powered chatbots. Technological Forecasting and Social Change 181 ► pp. 121772 ff.
Belair-Gagnon, Valerie, Seth C Lewis & Colin Agur
2020. Failure to Launch: Competing Institutional Logics, Intrapreneurship, and the Case of Chatbots. Journal of Computer-Mediated Communication 25:4 ► pp. 291 ff.
Benotti, Luciana & Alexandre Denis
2012. Building Virtual Guides for Virtual Worlds. In Human-Computer Interaction, Tourism and Cultural Heritage [Lecture Notes in Computer Science, 7546], ► pp. 144 ff.
Berezina, Katerina, Olena Ciftci & Cihan Cobanoglu
2019. Robots, Artificial Intelligence, and Service Automation in Restaurants. In Robots, Artificial Intelligence, and Service Automation in Travel, Tourism and Hospitality, ► pp. 185 ff.
Bozic, Josip, Oliver A. Tazl & Franz Wotawa
2019. 2019 IEEE International Conference On Artificial Intelligence Testing (AITest), ► pp. 37 ff.
Bozic, Josip & Franz Wotawa
2018. Security Testing for Chatbots. In Testing Software and Systems [Lecture Notes in Computer Science, 11146], ► pp. 33 ff.
2019. Testing Chatbots Using Metamorphic Relations. In Testing Software and Systems [Lecture Notes in Computer Science, 11812], ► pp. 41 ff.
Cascón-Katchadourian, Jesús-Daniel
2020. Tecnologías para luchar contra la pandemia Covid-19: geolocalización, rastreo, big data, SIG, inteligencia artificial y privacidad. El profesional de la información
Catania, Vincenzo, Salvatore Monteleone, Maurizio Palesi & Davide Patti
2020. Impact of Users’ Beliefs in Text-Based Linguistic Interaction. IEEE Access 8 ► pp. 46861 ff.
Catania, Vincenzo, Davide Patti & Mariagrazia Sciacca
2014. Introducing Consciousnet : Internet Content as an Environment for Human-Machine Interaction. In Human-Computer Interaction. Advanced Interaction Modalities and Techniques [Lecture Notes in Computer Science, 8511], ► pp. 382 ff.
Cheng, Xusen, Ying Bao, Alex Zarifis, Wankun Gong & Jian Mou
2022. Exploring consumers' response to text-based chatbots in e-commerce: the moderating role of task complexity and chatbot disclosure. Internet Research 32:2 ► pp. 496 ff.
Corral, Janet
2021. Artificially intelligent chatbots for health professions education. In Digital Innovations in Healthcare Education and Training, ► pp. 127 ff.
Denecke, Kerstin, Alaa Abd-Alrazaq & Mowafa Househ
2021. Artificial Intelligence for Chatbots in Mental Health: Opportunities and Challenges. In Multiple Perspectives on Artificial Intelligence in Healthcare [Lecture Notes in Bioengineering, ], ► pp. 115 ff.
Dsouza, Rebecca, Shubham Sahu, Ragini Patil & Dhananjay R Kalbande
2019. 2019 International Conference on Advances in Computing, Communication and Control (ICAC3), ► pp. 1 ff.
Fornalczyk, Kacper, Kamil Bortko & Jarosław Jankowski
2021. Improving User Attention to Chatbots through a Controlled Intensity of Changes within the Interface. Procedia Computer Science 192 ► pp. 5112 ff.
Franzoni Velázquez, Ana Lidia
2020. Chateando con Mitsuku. Revista Digital Universitaria 21:1
Grotenhermen, Jan-Gerrit, Nicholas Schönberg & Gerhard Schewe
2021. Wahrnehmungen und Vertrauen gegenüber Conversational Agents im Kundenservice von Finanzdienstleistern – Eine vergleichende Analyse. In Künstliche Intelligenz im Dienstleistungsmanagement [Forum Dienstleistungsmanagement, ], ► pp. 289 ff.
Hai-Jew, Shalin
2017. Finding Automated (Bot, Sensor) or Semi-Automated (Cyborg) Social Media Accounts Using Network Analysis and NodeXL Basic. In Social Media Listening and Monitoring for Business Applications [Advances in E-Business Research, ], ► pp. 383 ff.
2020. Finding Automated (Bot, Sensor) or Semi-Automated (Cyborg) Social Media Accounts Using Network Analysis and NodeXL Basic. In Robotic Systems, ► pp. 1250 ff.
Heryandi, A
2020. Developing Chatbot For Academic Record Monitoring in Higher Education Institution. IOP Conference Series: Materials Science and Engineering 879:1 ► pp. 012049 ff.
Hill, Jennifer, W. Randolph Ford & Ingrid G. Farreras
2015. Real conversations with artificial intelligence: A comparison between human–human online conversations and human–chatbot conversations. Computers in Human Behavior 49 ► pp. 245 ff.
Hsiao, Yu-Ting, Edwinn Gamborino & Li-Chen Fu
2020. A Hybrid Conversational Agent with Semantic Association of Autobiographic Memories for the Elderly. In Cross-Cultural Design. Applications in Health, Learning, Communication, and Creativity [Lecture Notes in Computer Science, 12193], ► pp. 53 ff.
Håvik, Robin, Jo Dugstad Wake, Eivind Flobak, Astri Lundervold & Frode Guribye
2019. A Conversational Interface for Self-screening for ADHD in Adults. In Internet Science [Lecture Notes in Computer Science, 11551], ► pp. 133 ff.
Jang, Moonkyoung, Yoonhyuk Jung & Seongcheol Kim
2021. Investigating managers' understanding of chatbots in the Korean financial industry. Computers in Human Behavior 120 ► pp. 106747 ff.
Jiang, Yi, Xiangcheng Yang & Tianqi Zheng
2023. Make chatbots more adaptive: Dual pathways linking human-like cues and tailored response to trust in interactions with chatbots. Computers in Human Behavior 138 ► pp. 107485 ff.
Johari, Nurul Muizzah, Halimah Badioze Zaman & Puteri N. E. Nohuddin
2019. Ascertain Quality Attributes for Design and Development of New Improved Chatbots to Assess Customer Satisfaction Index (CSI): A Preliminary Study. In Advances in Visual Informatics [Lecture Notes in Computer Science, 11870], ► pp. 135 ff.
Kaburuan, Emil Robert, Adrianus Kelvin & Jery
2020. 2020 8th International Conference on Orange Technology (ICOT), ► pp. 1 ff.
Kim, Jihie & Jeon-Hyung Kang
2014. Towards identifying unresolved discussions in student online forums. Applied Intelligence 40:4 ► pp. 601 ff.
Kloeckner, K., C. M. Adam, N. Anerousis, N. Ayachitula, M. F. Bulut, G. Dasgupta, Y. Deng, Y. Diao, N. Fuller, S. Gopisetty, M. Hernandez, J. Hwang, P. Iannucci, A. K. Kalia, G. Lanfranchi, D. Lanyi, H. Ludwig, A. Mahamuni, R. Mahindru, F. J. Meng, H. R. Motahari Nezhad, K. Murthy, T. Nakamura, A. Paradkar, D. Perpetua, B. Pfitzmann, D. Rosu, L. Shwartz, Z. Su, M. Surendra, S. Tao, H. Volzer, M. Vukovic, D. Wiesmann, S. Wozniak, G. Wright, J. Xiao & S. Zeng
2018. Building a cognitive platform for the managed IT services lifecycle. IBM Journal of Research and Development 62:1 ► pp. 8:1 ff.
Koponen, Jonna Pauliina & Saara Rytsy
2020. Social presence and e-commerce B2B chat functions. European Journal of Marketing 54:6 ► pp. 1205 ff.
Kuboň, David, Eleni Metheniti & Barbora Hladká
2018. Politician – An Imitation Game. In Internet Science [Lecture Notes in Computer Science, 10750], ► pp. 201 ff.
Kugathasan, Kumaran & Uthayasanker Thayasivam
2021. 2021 5th International Conference on Natural Language Processing and Information Retrieval (NLPIR), ► pp. 141 ff.
Lei, Sut Ieng, Haili Shen & Shun Ye
2021. A comparison between chatbot and human service: customer perception and reuse intention. International Journal of Contemporary Hospitality Management 33:11 ► pp. 3977 ff.
Leung, Xi Yu & Han Wen
2020. Chatbot usage in restaurant takeout orders: A comparison study of three ordering methods. Journal of Hospitality and Tourism Management 45 ► pp. 377 ff.
Liebrecht, Christine & Charlotte van Hooijdonk
2020. Creating Humanlike Chatbots: What Chatbot Developers Could Learn from Webcare Employees in Adopting a Conversational Human Voice. In Chatbot Research and Design [Lecture Notes in Computer Science, 11970], ► pp. 51 ff.
Lim, Weng Marc, Satish Kumar, Sanjeev Verma & Rijul Chaturvedi
2022. Alexa, what do we know about conversational commerce? Insights from a systematic literature review. Psychology & Marketing 39:6 ► pp. 1129 ff.
Lopez-Rodriguez, Victor & Hector G. Ceballos
2022. Retrieval-based Statistical Chatbot in a Scientometric Domain. In Advances in Computational Intelligence [Lecture Notes in Computer Science, 13613], ► pp. 303 ff.
Majumder, Soumi & Atreyee Mondal
2021. Are chatbots really useful for human resource management?. International Journal of Speech Technology 24:4 ► pp. 969 ff.
McTear, Michael F.
2017. The Rise of the Conversational Interface: A New Kid on the Block?. In Future and Emerging Trends in Language Technology. Machine Learning and Big Data [Lecture Notes in Computer Science, 10341], ► pp. 38 ff.
Minhas, Rashid, Camilla Elphick & Julia Shaw
2022. Protecting victim and witness statement: examining the effectiveness of a chatbot that uses artificial intelligence and a cognitive interview. AI & SOCIETY 37:1 ► pp. 265 ff.
Mou, Yi, Kun Xu & Kai Xia
2019. Unpacking the black box: Examining the (de)Gender categorization effect in human-machine communication. Computers in Human Behavior 90 ► pp. 380 ff.
Murtarelli, Grazia, Anne Gregory & Stefania Romenti
2021. A conversation-based perspective for shaping ethical human–machine interactions: The particular challenge of chatbots. Journal of Business Research 129 ► pp. 927 ff.
Neururer, Mario, Stephan Schlögl, Luisa Brinkschulte & Aleksander Groth
2018. Perceptions on Authenticity in Chat Bots. Multimodal Technologies and Interaction 2:3 ► pp. 60 ff.
Nichol, Leana, Sarah J. Wallace, Rachelle Pitt, Amy D. Rodriguez, Zhi Zhi Diong & Annie J. Hill
2022. People with aphasia share their views on self-management and the role of technology to support self-management of aphasia. Disability and Rehabilitation 44:24 ► pp. 7399 ff.
Paikari, Elahe & André van der Hoek
2018. Proceedings of the 11th International Workshop on Cooperative and Human Aspects of Software Engineering, ► pp. 13 ff.
Peng, Minjing, Yanwei Qin, Chenxin Tang & Xiangming Deng
2018. An E-Commerce Customer Service Robot Based on Intention Recognition Model. In Mobile Commerce, ► pp. 328 ff.
Przegalinska, Aleksandra, Leon Ciechanowski, Anna Stroz, Peter Gloor & Grzegorz Mazurek
2019. In bot we trust: A new methodology of chatbot performance measures. Business Horizons 62:6 ► pp. 785 ff.
Purohit, Jitendra, Aditya Bagwe, Rishabh Mehta, Ojaswini Mangaonkar & Elizabeth George
2019. 2019 3rd International Conference on Computing Methodologies and Communication (ICCMC), ► pp. 134 ff.
Qin, Min, Wei Zhu, Shiyue Zhao & Yu Zhao
2022. Is Artificial Intelligence Better than Manpower? The Effects of Different Types of Online Customer Services on Customer Purchase Intentions. Sustainability 14:7 ► pp. 3974 ff.
Rajaobelina, Lova, Isabelle Brun & Line Ricard
2019. A classification of live chat service users in the banking industry. International Journal of Bank Marketing 37:3 ► pp. 838 ff.
Rathore, Abhiraj Singh, Adarsh Sharma & Massoud Massoudi
2021. 2021 6th International Conference on Computing, Communication and Security (ICCCS), ► pp. 1 ff.
Schmitt, Anuschka, Thiemo Wambsganss & Jan Marco Leimeister
2022. Conversational Agents for Information Retrieval in the Education Domain. Proceedings of the ACM on Human-Computer Interaction 6:CSCW2 ► pp. 1 ff.
Tandon, Urvashi
2023. Chatbots, virtual-try-on (VTO), e-WOM: modeling the determinants of attitude’ and continued intention with PEEIM as moderator in online shopping. Global Knowledge, Memory and Communication
Tazl, Oliver A. & Franz Wotawa
2019. Using Model-Based Reasoning for Enhanced Chatbot Communication. In Advances and Trends in Artificial Intelligence. From Theory to Practice [Lecture Notes in Computer Science, 11606], ► pp. 791 ff.
Tsai, Meng-Han, James Chen & Shih-Chung Kang
2019. Ask Diana: A Keyword-Based Chatbot System for Water-Related Disaster Management. Water 11:2 ► pp. 234 ff.
Tsai, Meng-Han, Cheng-Hsuan Yang, Chen-Hsuan Wang, I.-Tung Yang & Shih-Chung Kang
2022. SEMA: A Site Equipment Management Assistant for Construction Management. KSCE Journal of Civil Engineering 26:3 ► pp. 1144 ff.
Villegas-Ch, William, Adrián Arias-Navarrete & Xavier Palacios-Pacheco
2020. Proposal of an Architecture for the Integration of a Chatbot with Artificial Intelligence in a Smart Campus for the Improvement of Learning. Sustainability 12:4 ► pp. 1500 ff.
Villegas-Ch, William, Joselin García-Ortiz, Karen Mullo-Ca, Santiago Sánchez-Viteri & Milton Roman-Cañizares
2021. Implementation of a Virtual Assistant for the Academic Management of a University with the Use of Artificial Intelligence. Future Internet 13:4 ► pp. 97 ff.
Villegas-Ch, William & Xavier Palacios-Pacheco
2021. Integration of Artificial Intelligence as a Tool for an Online Education Model. In Innovation and Research [Advances in Intelligent Systems and Computing, 1277], ► pp. 94 ff.
Villegas-Ch, William, Milton Román-Cañizares & Xavier Palacios-Pacheco
2020. Improvement of an Online Education Model with the Integration of Machine Learning and Data Analysis in an LMS. Applied Sciences 10:15 ► pp. 5371 ff.
Wambsganss, Thiemo, Sebastian Guggisberg & Matthias Söllner
2021. ArgueBot: A Conversational Agent for Adaptive Argumentation Feedback. In Innovation Through Information Systems [Lecture Notes in Information Systems and Organisation, 47], ► pp. 267 ff.
Wambsganss, Thiemo, Anne Höch, Naim Zierau & Matthias Söllner
2021. Ethical Design of Conversational Agents: Towards Principles for a Value-Sensitive Design. In Innovation Through Information Systems [Lecture Notes in Information Systems and Organisation, 46], ► pp. 539 ff.
Wambsganss, Thiemo, Tobias Kueng, Matthias Soellner & Jan Marco Leimeister
2021. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff.
Wambsganss, Thiemo, Rainer Winkler, Matthias Söllner & Jan Marco Leimeister
2020. Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, ► pp. 1 ff.
Wambsganss, Thiemo, Naim Zierau, Matthias Söllner, Tanja Käser, Kenneth R. Koedinger & Jan Marco Leimeister
2022. Designing Conversational Evaluation Tools. Proceedings of the ACM on Human-Computer Interaction 6:CSCW2 ► pp. 1 ff.
Wang, Jinping & Zeynep Tanes-Ehle
2023. Examining the Effects of Conversational Chatbots on Changing Conspiracy Beliefs about Science: The Paradox of Interactivity. Journal of Broadcasting & Electronic Media 67:1 ► pp. 68 ff.
Wei, Zhengde, Ying Chen, Qian Zhao, Pengyu Zhang, Longxi Zhou, Jiecheng Ren, Yi Piao, Bensheng Qiu, Xing Xie, Suiping Wang, Jia Liu, Daren Zhang, Roi Cohen Kadosh & Xiaochu Zhang
2023. Implicit Perception of Differences between NLP‐Produced and Human‐Produced Language in the Mentalizing Network. Advanced Science ► pp. 2203990 ff.
Xu, Yizhou (Joe)
2018. Programmatic Dreams: Technographic Inquiry into Censorship of Chinese Chatbots. Social Media + Society 4:4 ► pp. 205630511880878 ff.
Yadav, Sargam & Abhishek Kaushik
2022. Do You Ever Get Off Track in a Conversation? The Conversational System’s Anatomy and Evaluation Metrics. Knowledge 2:1 ► pp. 55 ff.
Yun, Jeewoo & Jungkun Park
2022. The Effects of Chatbot Service Recovery With Emotion Words on Customer Satisfaction, Repurchase Intention, and Positive Word-Of-Mouth. Frontiers in Psychology 13
[no author supplied]
2021. Conversational AI [Synthesis Lectures on Human Language Technologies, ],
This list is based on CrossRef data as of 21 march 2023. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.