Article published In:
TargetVol. 33:1 (2021) ► pp.73–102
Automatic speech recognition in the booth
Assessment of system performance, interpreters’ performances and interactions in the context of numbers
Automatic Speech Recognition (ASR) has been proposed as a means to enhance state-of-the-art computer-assisted interpreting
(CAI) tools and to allow machine-learning techniques to enter the workflow of professional interpreters. In this article, we test the
usefulness of real-time transcription with number highlighting of a source speech for simultaneous interpreting using InterpretBank ASR. The
system’s precision is high (96%) and its latency low enough to fit interpreters’ ear–voice span (EVS). We evaluate the potential benefits
among first-time users of this technology by applying an error matrix and by investigating the users’ subjective perceptions through a
questionnaire. The results show that the ASR provision improves overall performance for almost all number types. Interaction with the ASR
support is varied and participants consult it for just over half of the stimuli. The study also provides some evidence of the psychological
benefits of ASR availability and of overreliance on ASR support.
Keywords: automatic speech recognition, simultaneous interpreting, rendition of numbers, computer-assisted interpreting
Article outline
- 1.Introduction
- 2.Interpreting numbers
- 3.Methodology
- 3.1InterpretBank
- 3.2Preliminary test
- 3.3Equipment
- 3.4Participants
- 3.5Speeches
- 3.6Procedure
- 3.7Data processing and analysis
- 4.Results
- 4.1Findings regarding ASR
- 4.1.1Ergonomics
- 4.1.2Latency
- 4.1.3ASR precision for numbers
- 4.2Findings regarding presumed use of the ASR
- 4.3Findings regarding performance
- 4.3.1Renditions, ASR availability and presumed use
- 4.3.2Results per interpreter
- 4.3.3Renditions and number type
- 4.1Findings regarding ASR
- 5.Discussion
- 6.Conclusions
- Acknowledgements
- Notes
-
References
References (24)
Alessandrini, Maria Serena. 1990. “Translating Numbers in Consecutive Interpretation: An Experimental Study.” The Interpreters’ Newsletter 31: 77–80.
Braun, Susanne, and Andrea Clarici. 1996. “Inaccuracy for Numerals in Simultaneous Interpretation: Neurolinguistic and Neuropsychological Perspectives.” The Interpreters’ Newsletter 71: 85–102.
Brüsewitz, Nora. 2019. “Simultandolmetschen 4.0: Ist automatische Spracherkennung der nächste Schritt? [Simultaneous interpreting 4.0: Is automatic speech recognition the next step?]” In Proceedings of Übersetzen und Dolmetschen 4.0. – Neue Wege im digitalen Zeitalter [Translation and Interpreting 4.0 – New Paths in the Digital Era], edited by Wolfram Bauer and Felix Mayer, 323–333. Berlin: BDÜ Fachverlag.
Christoffels, Ingrid K. 2004. Cognitive Studies in Simultaneous Interpreting. PhD diss. University of Amsterdam.
Collard, Camille. 2019. A Corpus-based Study of Simultaneous Interpreting with Special Reference to Sex. PhD diss. Ghent University.
Corpas Pastor, Gloria, and Lily May Fern. 2016. A Survey of Interpreters’ Needs and Practices Related to Language Technology. Technical report [FFI2012-38881-MINECO/TI-DT-2016-1]. Málaga: University of Málaga.
Defrancq, Bart. 2015. “Corpus-based Research into the Presumed Effects of Short EVS.” Interpreting 17 (1): 26–45. 
Desmet, Bart, Mieke Vandierendonck, and Bart Defrancq. 2018. “Simultaneous Interpretation of Numbers and the Impact of Technological Support.” In Interpreting and Technology, edited by Claudio Fantinuoli, 11–24. Berlin: Language Science Press.
Fantinuoli, Claudio. 2017. “Speech Recognition in the Interpreter Workstation.” In Translating and the Computer 39: Proceedings, edited by João Esteves-Ferreira, Juliet Macan, Ruslan Mitkov, and Olaf-Michael Stefanov, 25–34. Geneva: Editions Tradulex.
. 2018. “Interpreting and Technology: The Upcoming Technological Turn.” In Interpreting and Technology, edited by Claudio Fantinuoli, 1–12. Berlin: Language Science Press.
Frittella, Francesca Maria. 2019. “‘70.6 Billion World Citizens’: Investigating the Difficulty of Interpreting Numbers.” Translation and Interpreting 11 (1): 79–99.
Gile, Daniel. 1995. Regards sur la recherche en interprétation de conférence [Views on Conference Interpreting Research]. Lille: Presses Universitaires de Lille.
Jones, Roderick. 2002. Conference Interpreting Explained. 2nd ed. Manchester: St Jerome Publishing.
Korpal, Paweł. 2016. Linguistic and Psychological Indicators of Stress in Simultaneous Interpreting. PhD diss. Adam Mickiewicz University.
Korpal, Paweł, and Katarzyna Stachowiak-Szymczak. 2020. “Combined Problem Triggers in Simultaneous Interpreting: Exploring the Effect of Delivery Rate on Processing and Rendering Numbers.” Perspectives: Studies in Translation Theory and Practice 28 (1): 126–143.
Lamberger-Felber, Heike. 2001. “Text-oriented Research into Interpreting – Examples from a Case-study.” Hermes 261: 39–64.
Mazza, Cristina. 2001. “Numbers in Simultaneous Interpretation.” The Interpreters’ Newsletter 111: 87–104.
Mead, Peter. 2015. “Numbers.” In Routledge Encyclopedia of Interpreting Studies, edited by Franz Pöchhacker, 286–288. Abingdon: Routledge.
Oléron, Pierre, and Hubert Nanpon. 1965/2002. “Research into Simultaneous Translation.” In The Interpreting Studies Reader, edited by Franz Pöchhacker and Miriam Shlesinger, 42–51. London: Routledge.
Pinochi, Diletta. 2009. “Simultaneous Interpretation of Numbers: Comparing German and English to Italian. An Experimental Study.” The Interpreters’ Newsletter 141: 33–57.
Prandi, Bianca. 2018. “An Exploratory Study on CAI Tools in Simultaneous Interpreting: Theoretical Framework and Stimulus Validation.” In Interpreting and Technology, edited by Claudio Fantinuoli, 25–54. Berlin: Language Science Press.
Setton, Robin, and Andrew Dawrant. 2016. Conference Interpreting: A Complete Course. Amsterdam: John Benjamins.
Timarová, Sarka. 2012.
Working Memory in Simultaneous Interpreting
. PhD diss. KU Leuven.
Vogler, Nicolai, Craig Stewart, and Graham Neubig. 2019. “Lost in Interpretation: Predicting Untranslated Terminology in Simultaneous Interpretation.” ArXiv:1904.00930 [Cs]. [URL]
Cited by (27)
Cited by 27 other publications
Achkasov, Andrei Valentinovich
2024. Speech characteristics of consecutive interpreting involving speech recognition tools. Philology. Theory & Practice 17:9 ► pp. 3355 ff. 
Gieshoff, Anne Catherine, Martin Schuler & Zaniyar Jahany
2024. The augmented interpreter. Interpreting. International Journal of Research and Practice in Interpreting 26:2 ► pp. 282 ff.
Li, Tianyun & Agnieszka Chmiel
2024. Automatic subtitles increase accuracy and decrease cognitive load in simultaneous interpreting. Interpreting. International Journal of Research and Practice in Interpreting 26:2 ► pp. 253 ff.
Liu, Jichao, Chengpan Liu, Buzheng Shan & Ömer S. Ganiyusufoglu
2024. A Computer-Assisted Interpreting System for Multilingual Conferences Based on Automatic Speech Recognition. IEEE Access 12 ► pp. 67498 ff.
Liu, Yiguang & Junying Liang
2024. Multidimensional comparison of Chinese-English interpreting outputs from human and machine: Implications for interpreting education in the machine-translation age. Linguistics and Education 80 ► pp. 101273 ff.
Peng, Xuejiao, Xiangling Wang & Guangjiao Chen
2024. Text availability and the speaker’s visibility in simultaneous interpreting: effects on the process, product, and interpreters’ perceptions. Perspectives ► pp. 1 ff.
Pöchhacker, Franz
Tian, Sha & Wenjiao Yang
2024. Modeling the use behavior of interpreting technology for student interpreters: An extension of UTAUT model. Education and Information Technologies 29:9 ► pp. 10499 ff.
Chen, Sijia & Jan-Louis Kruger
2023. The effectiveness of computer-assisted interpreting. Translation and Interpreting Studies 18:3 ► pp. 399 ff.
Chen, Sijia & Jan-Louis Kruger
2024. Visual processing during computer-assisted consecutive interpreting. Interpreting. International Journal of Research and Practice in Interpreting 26:2 ► pp. 231 ff.
Chen, Sijia & Jan-Louis Kruger
2024. A computer-assisted consecutive interpreting workflow: training and evaluation. The Interpreter and Translator Trainer 18:3 ► pp. 380 ff.
Fantinuoli, Claudio
2023. Chapter 3. Towards AI-enhanced computer-assisted interpreting. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 46 ff.
G, Thimmaraja Yadava, Nagaraja B G, Jayanna H S & Shivakumar B R
2023. A spoken query system to access the real time agricultural commodity prices and weather information in Kannada language/dialects. Multimedia Tools and Applications 83:10 ► pp. 28675 ff.
Goldsmith, Joshua
2023. Chapter 2. Tablet interpreting. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 27 ff.
Mellinger, Christopher D.
2023. Chapter 8. Embedding, extending, and distributing interpreter cognition with technology. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 195 ff.
Yuan, Lu & Binhua Wang
2023. Cognitive processing of the extra visual layer of live captioning in simultaneous interpreting. Triangulation of eye-tracked process and performance data. Ampersand 11 ► pp. 100131 ff.
Yuan, Lu & Binhua Wang
2024. Eye-tracking the processing of visual input of live transcripts in
remote simultaneous interpreting. FORUM. Revue internationale d’interprétation et de traduction / International Journal of Interpretation and Translation 22:1 ► pp. 118 ff.
Zhang Xiaojun, Gloria Corpas Pastor & Jing Zhang
2023. Chapter 7. Videoconference interpreting goes multimodal. In Interpreting Technologies – Current and Future Trends [IVITRA Research in Linguistics and Literature, 37], ► pp. 169 ff.
Cheung, Andrew K. F.
2022. Remote Simultaneous Interpreting from Home or Hub: Accuracy of Numbers from English into Mandarin Chinese. In Translation and Interpreting in the Age of COVID-19 [Corpora and Intercultural Studies, 9], ► pp. 113 ff.
Cheung, Andrew K. F.
2024. Cognitive load in remote simultaneous interpreting: place name translation in two Mandarin variants. Humanities and Social Sciences Communications 11:1
Chmiel, Agnieszka & Nicoletta Spinolo
2022. Testing the impact of remote interpreting settings on interpreter experience and performance. Translation, Cognition & Behavior 5:2 ► pp. 250 ff.
Horváth, Ildikó
2022. AI in interpreting: Ethical considerations. Across Languages and Cultures 23:1 ► pp. 1 ff.
Maggi, Ludovica & Sarah Bordes
2022. Intelligences en jeu. FORUM. Revue internationale d’interprétation et de traduction / International Journal of Interpretation and Translation 20:2 ► pp. 177 ff.
Spinolo, Nicoletta & Ricardo Muñoz Martín
2022. Experiential learning for the remote interpreting classroom. In Re-Thinking Translator Education [Sprachen lehren – Sprachen lernen, ], ► pp. 193 ff.
Wang, Huashu & Zhi Li
2022. Constructing a competence framework for interpreting technologies, and related educational insights: an empirical study. The Interpreter and Translator Trainer 16:3 ► pp. 367 ff.
Zhao, Nan
2022. Use of Computer-Assisted Interpreting Tools in Conference Interpreting Training and Practice During COVID-19. In Translation and Interpreting in the Age of COVID-19 [Corpora and Intercultural Studies, 9], ► pp. 331 ff.
Čeňková, Ivana
2022. Umělá inteligence a tlumočníci – víme, co nás čeká?. AUC PHILOLOGICA 2021:2 ► pp. 105 ff.
This list is based on CrossRef data as of 7 november 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.