Cover not available
Part of
Interpreting Technologies – Current and Future Trends
Edited by Gloria Corpas Pastor and Bart Defrancq
[IVITRA Research in Linguistics and Literature 37] 2023
► pp. 46–71

Chapter 3
Towards AI-enhanced computer-assisted interpreting

| Johannes Gutenberg University Mainz , Germany | KUDO Inc. |

Over the last 20 years, digital tools for interpreters have evolved from easy-to-use glossary creation and management solutions to complex workstations that cover most stages of the interpreter workflow, from assignment preparation to terminology lookup during interpretation. Currently, computer-aided interpretation (CAI) tools are starting to offer advanced features based on recent developments in artificial intelligence, such as automatic speech recognition, machine translation, etc., sometimes becoming part of integrated platforms, for example for the provision of remote interpretation.

This chapter provides a historical overview of CAI tools focusing on current technological developments in the artificial intelligence (AI) space. It begins by discussing the rationale for creating tailor-made interpreter support tools in the light of interpreters’ specific needs. Against this background, the author offers a chronological overview of the development of CAI technology and a comparison and categorization of the available tools. Previous research on computer-assisted interpreting is briefly presented. It follows a general introduction to key AI topics as applied to the field of interpreting technology. The conclusions address potential avenues for future developments and challenges.

Keywords: computer-assisted interpreting (CAI), artificial intelligence, machine learning, interpreting, simultaneous interpreting
Article outline
  • 1.Introduction
  • 2.Interpreting workflow and CAI tools
    • 2.1Preparation
    • 2.2In-process
    • 2.3Post-event
  • 3.History of computer-assited interpreting tools
    • 3.1First-generation
    • 3.2Second-generation
    • 3.3Third-generation
  • 4.Language technologies and artificial intelligence
    • 4.1Artificial intelligence and machine learning
    • 4.2Natural language processing, understanding and generation
    • 4.3Automatic speech recogintion
    • 4.4Machine translation
    • 4.5Machine interpreting
    • 4.6Summarisation
  • 5.AI-enhanced CAI tools
    • 5.1Automatic glossary creation
      • 5.1.1Corpus creation
      • 5.1.2Term extraction
      • 5.1.3Term translation
      • 5.1.4Glossary review
    • 5.2Artificial boothmate
    • 5.3Artificial notepad
    • 5.4Underexplored use of AI
  • 6.Interpreter management systems
  • 7.Ehtics of AI use in interpreting
  • 8.Conclusions
  • Notes
  • References
Published online: 9 October 2023
DOI logo
https://doi.org/10.1075/ivitra.37.03fan
References
Amodei, Dario, Anubhai, Rishita, Battenberg, Eric, Case, Carl, Jared, Casper, Catanzaro, Bryan, Chen, Jingdong, Chrzanowski, Mike, Coates, Adam, Diamos, Greg, Elsen, Erich, Engel, Jesse, Fan, Linxi, Fougner, Christopher, Han, Tony, Hannun, Awni, Jun, Billy, LeGresley, Patrick, Lin, Libby, Narang, Sharan, Ng, Andrew, Ozair, Sherjil, Prenger, Ryan, Raiman, Jonathan, Satheesh, Sanjeev, Seetapun, David, Sengupta, Shubho, Wang, Yi, Wang, Zhiqian, Wang, Chong, Xiao, Bo, Yogatama, Dani, Zhan, Jun, and Zhenyao Zhu
(2016) Deep Speech 2: End-to-End Speech Recognition in English and Mandarin. Proceedings of The 33rd International Conference on Machine Learning Research 48: 173–182 Available from [URL].
Anastasopoulos, Antonios, Bojar, Ondřej, Bremerman, Jacob, Cattoni, Roldano, Elbayad, Maha, Federico, Marcello, Ma, Xutai, Nakamura, Satoshi, Negri, Matteo, Niehues, Jan, Pino, Juan, Salesky, Elizabeth, Stüker, Sebastian, Sudoh, Katsuhito, Turchi, Marco, Waibel, Alexander, Wang, Changhan, and Matthew Wiesner
2021 “Findings of the IWSLT 2021 evaluation campaign.” In Proceedings of the 18th International Conference on Spoken Language Translation (IWSLT 2021), 1–29. Bangkok, Thailand (online): Association for Computational Linguistics 2021 DOI logo
Baroni, Marco, and Silvia Bernardini
2004 “BootCaT: Bootstrapping corpora and terms from the web”. In Proceedings of LREC 2004, 1313–1316. Lisbon: ELDA. Google Scholar
Behr, Martina
2013 “Zur Einbeziehung kommunikationswissenschaftlicher Erkenntnisse bei der Evaluation von Dolmetschleistungen.” In Quality in interpreting: Widening the scope. Volume 1, edited by Olalla García Becerra, E. Macarena Pradas Macías and Rafael Barranco-Droege, 83–100. Granada: Comares.Google Scholar
Bender, Emily M., and Alexander Koller
2020 “Climbing towards NLU: On Meaning, Form, and Understanding in the Age of Data.” In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, 5185–5198. Online: Association for Computational Linguistics. DOI logoGoogle Scholar
Brkic Bakaric, Marija, Babic, Nikola, and Maja Matetic
2021 “Application-Based Evaluation of Automatic Terminology Extraction.” International Journal of Advanced Computer Science and Applications 12 (1): 18–27. DOI logoGoogle Scholar
Braun, Sabine, and Andrea Clarici
1996 “Inaccuracy for Numerals in Simultaneous Interpretation: Neurolinguistic and Neuropsychological Perspectives.” The Interpreters’ Newsletter 7: 85–102.Google Scholar
Brown, Tom B., Mann, Benjamin, Ryder, Nick, Subbiah, Melanie, Kaplan, Jared, Dhariwal, Prafulla, and Arvind Neelakantan
2020 “Language Models Are Few-Shot Learners.” ArXiv:2005.14165 [Cs], July 22 2020.Google Scholar
Corpas Pastor, Gloria
2022 “Technology Solutions for Interpreters: The VIP System.” Hermēneus. Revista de Traducción e Interpretación 23: 91–123. DOI logoGoogle Scholar
Corpas Pastor, Gloria, and Mahmoud Gaber
2021 “Extracción de fraseología para intérpretes a partir de corpus comparables compilados mediante reconocimiento automático del habla”. In Sistemas fraseológicos en contraste: Enfoques computacionales y de corpus, edited by Gloria Corpas Pastor, Rosario Bautista Zambrana and Carlos Hidalgo-Ternero, 271–291. Granada: Comares.Google Scholar
Costa, Hernani, Corpas Pastor, Gloria, and Isabel Durán Muñoz
2016 “A Comparative User Evaluation of Terminology Management Tools for Interpreters.” In Proceedings of the Workshop on Computational Terminology (CompuTerm’14), 68–76 2014 DOI logo
Defrancq, Bart, and Claudio Fantinuoli
2020 “Automatic Speech Recognition in the Booth: Assessment of System Performance, Interpreters’ Performances and Interactions in the Context of Numbers.” Target. International Journal of Translation Studies 33 (1): 73–102. DOI logoGoogle Scholar
Desmet, Bart, Vandierendonck, Mieke, and Bart Defrancq
2018 “Simultaneous interpretation of numbers and the impact of technological support”. In Interpreting and Technology, edited by Claudio Fantinuoli, 13–27. Berlin: Language Science Press.Google Scholar
Devlin, Jacob, Chang, Ming-Wei, Lee, Kenton, and Kristina Toutanova
2019 “BERT: Pre-Training of Deep Bidirectional Transformers for Language Understanding.” ArXiv:1810.04805 [Cs], May 24.Google Scholar
Fantinuoli, Claudio
2006 “Specialized Corpora from the Web for Simultaneous Interpreters.” In Wacky! Working Papers on the Web as Corpus, edited by Marco Baroni and Silvia Bernardini, 173–90. Bologna: GEDIT.Google Scholar
2017a “Computer-Assisted Preparation in Conference Interpreting.” Translation & Interpreting 9 (2): 24–37. DOI logoGoogle Scholar
2017b “Computerlinguistik in Der Dolmetschpraxis Unter Besonderer Berücksichtigung Der Korpusanalyse.” In Annotation, Exploitation and Evaluation of Parallel Corpora, edited by Oliver Čulo, Silvia Hansen-Schirra and Stella Neumann, 111–46. Berlin: Language Science Press.Google Scholar
2017c “Speech Recognition in the Interpreter Workstation.” In Proceedings of the Translating and the Computer 39 Conference, London, 367–377. Geneva: Editions Tradulex.
2018a “Computer-Assisted Interpreting: Challenges and Future Perspectives.” In Trends in E-Tools and Resources for Translators and Interpreters, edited by Gloria Corpas Pastor and Isabel Durán Muñoz, 153–174. Leiden: Brill.Google Scholar
2018b “The use of comparable corpora in interpreting practice and training. ” The Interpreters’ Newsletter 23: 133–149.Google Scholar
Fantinuoli, Claudio, and Bianca Prandi
2021 “Towards the Evaluation of Automatic Simultaneous Speech Translation from a Communicative Perspective.” In Proceedings of the 18th International Conference on Spoken Language Translation (IWSLT 2021), 245–54. Bangkok, Thailand (online): Association for Computational Linguistics. DOI logo
Fantinuoli, Claudio, Marchesini, Giulia, Landan, David, and Lukas Horak
2022 “KUDO Interpreter Assist: Automated Real-Time Support for Remote Interpretation.” ArXiv:2201.01800 [Cs], January 5 2022 [Online] Available at [URL].
Fantinuoli, Claudio, and Maddalena Montecchio
2022 “Defining Maximum Acceptable Latency of AI-Enhanced CAI Tools.” ArXiv:2201.02792 [Cs], January 8 2022 [Online] Available at [URL].
Feng, Siyuan, Kudina, Olya, Halpern, Bence Mark, and Odette Scharenborg
2021 “Quantifying Bias in Automatic Speech Recognition.” ArXiv:2103.15122 [Cs, Eess], April 1 2021 [Online] Available at [URL].
Filippidou, Foteini, and Lefteris Moussiades
2020 “A Benchmarking of IBM, Google and Wit Automatic Speech Recognition Systems.” Artificial Intelligence Applications and Innovations 583: 73–82. DOI logoGoogle Scholar
Floridi, Luciano
2014 The Fourth Revolution How the Infosphere Is Reshaping Human Reality. Oxford: Oxford University Press.Google Scholar
Gile, Daniel
2009 Basic Concepts and Models for Interpreter and Translator Training: Revised Edition. 2nd ed. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Goldsmith, Joshua
2018 “Tablet Interpreting: Consecutive Interpreting 2.0.” Translation and Interpreting Studies 13 (3): 342–65. DOI logoGoogle Scholar
Haque, Rejwanul, Penkale, Sergio, and Andy Way
2014 “Bilingual termbank creation via log-likelihood comparison and phrase-based statistical machine translation”. In Proceedings of the 4th International Workshop on Computational Terminology (Computerm): 42–51. DOI logo
Haque, Rejwanul, Hasanuzzaman, Mohammed, and Andy Way
2019 “TermEval: an automatic metric for evaluating terminology translation in MT”. In: CICLing 2019: the 20th International Conference on Computational Linguistics and Intelligent Text Processing, 7–13 Apr 2019, La Rochelle, France.
Jia, Hao, Gu, Shuqin, Shi, Yangbin, Duan, Xiangyu, Hu, Zhongkai, Zhang Yuqi, and Weihua Luo
. “Bilingual Terminology Extraction from Non-Parallel E-Commerce Corpora.” ArXiv:2104.07398 [Cs], April 15 2021 [Online] Available at [URL].
Jia, Ye, Tadmor Ramanovich, Michelle, Remez, Tal, and Roi Pomerantz
2021 “Translatotron 2: Robust Direct Speech-to-Speech Translation.” ArXiv:2107.08661 [Cs, Eess], December 3 2021 [Online] Available at [URL].
Jia, Ye, Weiss, Ron J., Biadsy, Fadi, Macherey, Wolfgang, Johnson, Melvin, Chen, Zhifeng, and Yonghui Wu
2019 “Direct Speech-to-Speech Translation with a Sequence-to-Sequence Model.” ArXiv:1904.06037 [Cs, Eess], June 25 2019 [Online] Available at [URL]. DOI logo
Kalina, Sylvia
2007 “Microphone Off’ – Application of the Process Model of Interpreting to the Classroom.” Kalbotyra 57 (3): 111–21. DOI logoGoogle Scholar
2020 “Quality in Interpreting.” Handbook of Translation Studies Online. John Benjamins. Accessed March 12, 2022. [Online] Available at [URL].
Karakanta, Alina, Papi, Sara, Negri, Matteo, and Marco Turchi
2021 “Simultaneous Speech Translation for Live Subtitling: From Delay to Display.” In Proceedings of the 1st Workshop on Automatic Spoken Language Translation in Real-World Settings (ASLTRW), 35–48. Virtual: Association for Machine Translation in the Americas 2021 [Online] Available at [URL].
Koenecke, Allison, Nam, Andrew, Lake, Emily, Nudell, Joe, Quartey, Minnie, Mengesha, Zion, Toups, Connor, Rickford, John, Jurafsky, Dan, and Sharad Goel
2020 “Racial Disparities in Automated Speech Recognition.” Proceedings of the National Academy of Sciences 117 (14): 7684–89. [Online] Available at DOI logoGoogle Scholar
Kucharska, Anna
2009 Simultandolmetschen in Defizitären Situationen. Strategien Der Translatorischen Optimierung. Leipzig: Frank & Timme.Google Scholar
Lu, Xiaolei, and Chao Han
2022 “Automatic assessment of spoken-language interpreting based on machine-translation evaluation metrics A multi-scenario exploratory study.” Interpreting. (Online first article). [Online] Available at [URL]
Mengesha, Zion, Heldreth, Courtney, Lahav, Michal, Sublewski, Juliana, and Elyse Tuennerman
2021 “ ‘I Don’t Think These Devices Are Very Culturally Sensitive.’ – Impact of Automated Speech Recognition Errors on African Americans.” Frontiers in Artificial Intelligence 4: 725911. DOI logoGoogle Scholar
Mujtaba, Dena F., and Nihar R. Mahapatra
2019 “Ethical Considerations in AI-Based Recruitment.” In 2019 IEEE International Symposium on Technology and Society (ISTAS), 1–7. Medford, MA, USA: IEEE 2019 DOI logo
Pisani, Elisabetta, and Claudio Fantinuoli
2021 “Measuring the Impact of Automatic Speech Recognition on Interpreter’s Performances in Simultaneous Interpreting.” In Empirical Studies of Translation and Interpreting: The Post-Structuralist Approach, edited by Caiwen Wang and Binghan Zheng, 181–197. New York: Routledge. DOI logoGoogle Scholar
Pöchhacker, Franz
2002 “Quality Assessment in Conference and Community Interpreting.” Meta 46 (2): 410–25. DOI logoGoogle Scholar
2016 Introducing Interpreting Studies. Manchester: Routledge. DOI logoGoogle Scholar
Prandi, Bianca
2017 “Designing a Multimethod Study on the Use of CAI Tools during Simultaneous Interpreting.” In Proceedings of the 39th Conference Translating and the Computer, 76–88. Geneva: Tradulex.
2022 Computer-Assisted Simultaneous Interpreting: A cognitive-experimental study on terminology”. PhD thesis University of Mainz.
Romero-Fresco, Pablo, and Franz Pöchhacker
2017 “Quality assessment in interlingual live subtitling: The NTR model.” Linguistica Antverpiensia, New Series: Themes in Translation Studies, 16, 149–167.Google Scholar
Rütten, Anja
2003 “Computer-Based Information Management for Conference Interpreters Or How Will I Make My Computer Act Like an Infallible Information Butler?” In Proceedings of the International Conference Translating and the Computer. London 2003 [Online] Available at [URL].
2007 Informations- Und Wissensmanagement Im Konferenzdolmetschen. Frankfurt am Main: Peter Lang.Google Scholar
Schild Ortiz, Luís Eduardo, and Patrizia Cavalli
2018 “Computer-Assisted Interpreting Tools (CAI) and Options for Automation with Automatic Speech Recognition.” TradTerm 32: 9–31. DOI logoGoogle Scholar
Setton, Robin, and Andrew Dawrant
2016 Conference Interpreting: A Complete Course. Amsterdam and Philadelphia: John Benjamins. DOI logoGoogle Scholar
Sperber, Matthias, and Matthias Paulik
2020 “Speech Translation and the End-to-End Promise: Taking Stock of Where We Are.” ArXiv:2004.06358 [Cs], April 14 2020 [Online] Available at [URL]. DOI logo
Steurs, Frieda, and Katarzyna Tryczynska
2021 “European Labour Law and its Challenges in Multilingual Terminology and Translation: A Case Study.” Sendebar 32: 219–237. DOI logoGoogle Scholar
Stoll, Christoph
2009 Jenseits Simultanfähiger Terminologiesysteme. Trier: Wvt Wissenschaftlicher Verlag.Google Scholar
Sudoh, Katsuhito, Kano, Takatomo, Novitasari, Sashi, Yanagita, Tomoya, Sakti, Sakriani, and Satoshi Nakamura
2020 “Simultaneous Speech-to-Speech Translation System with Neural Incremental ASR, MT, and TTS.” ArXiv:2011.04845 [Cs], November 11 2020 [Online] Available at [URL].
Tiselius, Elisabet
2009 “Revisiting Carroll’s Scales.” In American Translators Association Scholarly Monograph Series, edited by Claudia V. Angelelli and Holly E. Jacobson, XIV: 95–121. Amsterdam: John Benjamins. DOI logoGoogle Scholar
Will, Martin
2009 Dolmetschorientierte Terminologiearbeit. Modelle Und Methode. Tübingen: Gunter Narr Verlag.Google Scholar
Xu, Ran
2018 “Corpus-Based Terminological Preparation for Simultaneous Interpreting.” Interpreting 20 (1): 29–58. DOI logoGoogle Scholar