Automatic speech recognition in the booth: Assessment of system performance, interpreters’ performances and interactions in the context of numbers
BartDefrancq and ClaudioFantinuoli
Ghent University | Johannes Gutenberg University Mainz
Abstract
Automatic Speech Recognition (ASR) has been proposed as a means to enhance state-of-the-art computer-assisted interpreting
(CAI) tools and to allow machine-learning techniques to enter the workflow of professional interpreters. In this article, we test the
usefulness of real-time transcription with number highlighting of a source speech for simultaneous interpreting using InterpretBank ASR. The
system’s precision is high (96%) and its latency low enough to fit interpreters’ ear–voice span (EVS). We evaluate the potential benefits
among first-time users of this technology by applying an error matrix and by investigating the users’ subjective perceptions through a
questionnaire. The results show that the ASR provision improves overall performance for almost all number types. Interaction with the ASR
support is varied and participants consult it for just over half of the stimuli. The study also provides some evidence of the psychological
benefits of ASR availability and of overreliance on ASR support.
This study reports on a small-scale experiment with in-booth computer-assisted interpreting (CAI). While technological support systems have been widely used in translation for decades, the first modest attempts at technological support for interpreting have only recently been made. The sheer complexity of the interpretation process – with its acoustic input and output, contextual dependence and, in the case of simultaneous interpreting, short parsing window – is one reason why technological support has, until recently, fallen short of interpreters’ expectations (Corpas Pastor and Fern 2016; Fantinuoli 2018). Given the complexity of the interpreting task, it seems clear that interpreters could benefit considerably from technological support during interpretation.
References
Alessandrini, Maria Serena
1990 “Translating Numbers in Consecutive Interpretation: An Experimental Study.” The Interpreters’ Newsletter 3: 77–80.
Braun, Susanne, and Andrea Clarici
1996 “Inaccuracy for Numerals in Simultaneous Interpretation: Neurolinguistic and Neuropsychological Perspectives.” The Interpreters’ Newsletter 7: 85–102.
Brüsewitz, Nora
2019 “Simultandolmetschen 4.0: Ist automatische Spracherkennung der nächste Schritt? [Simultaneous interpreting 4.0: Is automatic speech recognition the next step?]” In Proceedings of Übersetzen und Dolmetschen 4.0. – Neue Wege im digitalen Zeitalter [Translation and Interpreting 4.0 – New Paths in the Digital Era], edited by Wolfram Bauer and Felix Mayer, 323–333. Berlin: BDÜ Fachverlag.
Christoffels, Ingrid K.
2004Cognitive Studies in Simultaneous Interpreting. PhD diss. University of Amsterdam.
Collard, Camille
2019A Corpus-based Study of Simultaneous Interpreting with Special Reference to Sex. PhD diss. Ghent University.
Corpas Pastor, Gloria, and Lily May Fern
2016A Survey of Interpreters’ Needs and Practices Related to Language Technology. Technical report [FFI2012-38881-MINECO/TI-DT-2016-1]. Málaga: University of Málaga.
Defrancq, Bart
2015 “Corpus-based Research into the Presumed Effects of Short EVS.” Interpreting 17 (1): 26–45.
Desmet, Bart, Mieke Vandierendonck, and Bart Defrancq
2018 “Simultaneous Interpretation of Numbers and the Impact of Technological Support.” In Interpreting and Technology, edited by Claudio Fantinuoli, 11–24. Berlin: Language Science Press.
Fantinuoli, Claudio
2017 “Speech Recognition in the Interpreter Workstation.” In Translating and the Computer 39: Proceedings, edited by João Esteves-Ferreira, Juliet Macan, Ruslan Mitkov, and Olaf-Michael Stefanov, 25–34. Geneva: Editions Tradulex.
Fantinuoli, Claudio
2018 “Interpreting and Technology: The Upcoming Technological Turn.” In Interpreting and Technology, edited by Claudio Fantinuoli, 1–12. Berlin: Language Science Press.
Frittella, Francesca Maria
2019 “ ‘70.6 Billion World Citizens’: Investigating the Difficulty of Interpreting Numbers.” Translation and Interpreting 11 (1): 79–99.
Gile, Daniel
1995Regards sur la recherche en interprétation de conférence [Views on Conference Interpreting Research]. Lille: Presses Universitaires de Lille.
Jones, Roderick
2002Conference Interpreting Explained. 2nd ed. Manchester: St Jerome Publishing.
Korpal, Paweł
2016Linguistic and Psychological Indicators of Stress in Simultaneous Interpreting. PhD diss. Adam Mickiewicz University.
Korpal, Paweł, and Katarzyna Stachowiak-Szymczak
2020 “Combined Problem Triggers in Simultaneous Interpreting: Exploring the Effect of Delivery Rate on Processing and Rendering Numbers.” Perspectives: Studies in Translation Theory and Practice 28 (1): 126–143.
Lamberger-Felber, Heike
2001 “Text-oriented Research into Interpreting – Examples from a Case-study.” Hermes 26: 39–64.
Mazza, Cristina
2001 “Numbers in Simultaneous Interpretation.” The Interpreters’ Newsletter 11: 87–104.
Mead, Peter
2015 “Numbers.” In Routledge Encyclopedia of Interpreting Studies, edited by Franz Pöchhacker, 286–288. Abingdon: Routledge.
Oléron, Pierre, and Hubert Nanpon
1965/2002 “Research into Simultaneous Translation.” In The Interpreting Studies Reader, edited by Franz Pöchhacker and Miriam Shlesinger, 42–51. London: Routledge.
Pinochi, Diletta
2009 “Simultaneous Interpretation of Numbers: Comparing German and English to Italian. An Experimental Study.” The Interpreters’ Newsletter 14: 33–57.
Prandi, Bianca
2018 “An Exploratory Study on CAI Tools in Simultaneous Interpreting: Theoretical Framework and Stimulus Validation.” In Interpreting and Technology, edited by Claudio Fantinuoli, 25–54. Berlin: Language Science Press.
Setton, Robin, and Andrew Dawrant
2016Conference Interpreting: A Complete Course. Amsterdam: John Benjamins.
Timarová, Sarka
2012Working Memory in Simultaneous Interpreting. PhD diss. KU Leuven.
Vogler, Nicolai, Craig Stewart, and Graham Neubig
2019 “Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation.” ArXiv:1904.00930 [Cs]. http://arxiv.org/abs/1904.00930