Cover not available
Article published In:
Fair MT: Towards ethical, sustainable Machine Translation
Edited by Joss Moorkens, Dorothy Kenny and Félix do Carmo
[Translation Spaces 9:1] 2020
► pp. 58–77

Risks in neural machine translation

 | Johannes Gutenberg-Universität Mainz
 | Die RisikoScouts GbR
The new paradigm of neural machine translation is leading to profound changes in the translation industry. Surprisingly good results have led to high expectations; however, there are substantial risks that have not yet been sufficiently taken into account. Risks exist on three levels: first, what kind of damage can clients and end users incur in safety-critical domains if the NMT result contains errors; second, who is liable for damage caused by the use of NMT; third, what cyber risks can the use of NMT entail, especially when free online engines are used. When establishing sustainable measures to reduce such risks, we also need to consider general principles of human behaviour if we want to make sure that all agents comply with provisions and requirements.
Keywords: neural machine translation, translation risks, risk management, sustainability, cognitive biases
Article outline
  • 1.Introduction
  • 2.Dimensions of NMT risks
    • 2.1Translation errors
    • 2.2Accountability – Liability – Responsibility
    • 2.3NMT cyber risks
  • 3.Sustainable workflows for NMT use
    • 3.1Non-technical measures (legislative and normative requirements)
    • 3.2Technical measures
  • 4.Conclusions
  • Notes
  • References
Published online: 17 August 2020
DOI logo
https://doi.org/10.1075/ts.00021.can
References (85)
References
Akerlof, George, and Rachel E. Kranton. 2010. Identity Economics: How Identities Shape Our Work, Wages, and Well-Being. New Jersey: Princeton University Press. DOI logoGoogle Scholar
Algorithmenethik. 2018. “Roboter sind auch nur Menschen!? [Robots are only Humans!?]“ Algorithmenethik Blog. Accessed 19 February 2020, [URL]
Allianz. 2019. “Allianz Risk Barometer. Top Business Risks for 2019.” Allianz Reports. Accessed 19 February 2020, [URL]
Arthur, Philip, Graham Neubig, and Satoshi Nakamura. 2016. “Incorporating Discrete Translation Lexicons into Neural Machine Translation.” Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1557–1567. DOI logoGoogle Scholar
BaFin (Bundesanstalt für Finanzdienstleistungsaufsicht [German Federal Financial Supervisory Authority]). 2018. “Big data meets artificial intelligence. Challenges and implications for the supervision and regulation of financial services.” Bafin – Publications & Data. Accessed 19 February 2020, [URL]
Balebako, Rebecca, Pedro Leon, Hazim Almuhimedi, Patrick Kelley, Jonathan Mugan, Alessandro Acquisti, Lorrie Cranor, and Norman Sadeh. 2011. “Nudging Users Towards Privacy on Mobile Devices.” Proceedings of the 2nd International Workshop on Persuasion, Influence, Nudge & Coercion Through Mobile Devices. Vancouver, Canada, May 8, 2011, 23–26. Accessed 19 February 2020, [URL]
Bowker, Lynne, and Jairo Buitrago Ciro. 2019. Machine Translation and Global Research: Towards Improved Machine Translation Literacy in the Scholarly Community. Bingley, UK: Emerald Publishing. DOI logoGoogle Scholar
Canfora, Carmen, and Angelika Ottmann. 2018. “Of Ostriches, Pyramids, and Swiss Cheese: Risks in Safety-Critical Translations.” Translation Spaces 7 (2): 167–201. DOI logoGoogle Scholar
. 2019. “Who’s Afraid of Translation Risks?” In Challenging Boundaries: New Approaches to Specialized Communication, edited by Heike Elisabeth Jüngst, Lisa Link, Klaus Schubert, and Christiane Zehrer. 73–92. Berlin: Frank & Timme.Google Scholar
Castilho, Sheila, Joss Moorkens, Federico Gaspari, Iacer Calixto, John Tinsley, and Andy Way. 2017. “Is Neural Machine Translation the New State of the Art?” The Prague Bulletin of Mathematical Linguistics 1081: 109–120. Accessed 19 February 2020, [URL]
Castilho, Sheila, Joss Moorkens, Federico Gaspari, Rico Sennrich, Vilelmini Sosoni, Panayota Georgakopoulou, Pintu Lohar, Andy Way, Antonio Valerio Miceli Barone, and Maria Gialama. 2017. “A Comparative Quality Evaluation of PBSMT and NMT using Professional Translators.” Proceedings of MT Summit XVI, vol. 1: Research Track. Nagoya, September 8–11, 2017, 116–131. Accessed 19 February 2020, [URL]
Cebula, James J., and Lisa R. Young. 2010. “A Taxonomy of Operational Cyber Security Risks.” Software Engineering Institute. Technical Note CMU/SEI-2010-TN-028.Google Scholar
Daems, Joke, and Lieve Macken. 2019. “Interactive adaptive SMT versus interactive NMT: a user experience evaluation.” Machine Translation 331: 117–134. DOI logoGoogle Scholar
Daems, Joke, Sonia Vandepitte, Robert J. Hartsuiker, and Lieve Macken. 2017. “Identifying the Machine Translation Errors with the Greatest Impact on Post-editing Effort.” Frontiers in Psychology 81: 282. DOI logoGoogle Scholar
Dannewitz Linder, Mats. 2018. “How (Un)Safe is Machine Translation?”. SDL Trados Studio. The Manual Blog. Accessed 19 February 2020, [URL]
DeepL Pro. n.d. “Allgemeine Geschäftsbedingungen [Terms of Service]”. Accessed 19 February 2020, [URL]
DeepL Translator. n.d. “Allgemeine Geschäftsbedingungen [Terms of Service]”. Accessed 19 February 2020, [URL]
DePalma, Don. 2014. “Free Machine Translation Can Leak Data.” tcworld e-magazine July 2014. Accessed 19 February 2020, [URL]
Downie, Jonathan, and Angela Dickson. 2019. “Unsound Evaluations of Medical Machine Translation Risk Patient Health and Confidentiality.” JAMA Internal Medicine 179 (7): 1001. Accessed 19 February 2020, [URL]
Elkington, John. 1998. Cannibals with Forks: The Triple Bottom Line of 21st Century Businesses. Gabriola Island, B.C., Canada: New Society Publishers.Google Scholar
European Commission. 2012. “Studies on Translation and Multilingualism. Language and Translation in International Law and EU Law.” Directorate-General for Translations (European Commission). DOI logoGoogle Scholar
. 2018. “Commission Staff Working Document: Liability for Emerging Digital Technologies.” Accessed 19 February 2020, [URL]
. 2019. “Ethics Guidelines for Trustworthy AI.” High-Level Expert Group on Artificial Intelligence. Accessed 19 February 2020, [URL]
European Parliament. 2001. Directive 2001/95/EC of the European Parliament and the Council of 3 December 2001 on General Product Safety.Google Scholar
. 2006. Directive 2006/42/EC of the European Parliament and the Council of 17 May 2006 on Machinery, and amending Directive 95/16/EC (recast).Google Scholar
. 2008. Decision 768/2008/EC of the European Parliament and of the Council of 9 July 2008 on a Common Framework for the Marketing of Products (New Legislative Framework). Accessed 19 February 2020, [URL]
. 2017. “Report with Recommendations to the Commission on Civil Law Rules on Robotics (2015/2103 [INL]).” Committee on Legal Affairs. Accessed 19 February 2020, [URL]
FDA (Food and Drug Administration). 2015. “Warning Letter – Smith & Nephew Inc. MARCS-CMS 457814 – April 30, 2015.” FDA Warning Letters. Accessed 19 February 2020, [URL]
Galai, Dan, and Orly Sade. 2005. “The Ostrich effect and the Relationship between the Liquidity and the Yields of Financial Assets.” The Journal of Business 79 (5): 2741–2759. DOI logoGoogle Scholar
Gartner. 2018. “5 Trends Emerge in the Gartner Hype Cycle for Emerging Technologies, 2018”. Gartner Blog. Accessed 19 February 2020, [URL]
Gigerenzer, Gerd. 2008. “Why Heuristics Work.” Perspectives on Psychological Science 3 (1): 20–29. DOI logoGoogle Scholar
Google. 2017. “Google Privacy & Terms – Terms of Service”. Accessed 19 February 2020, [URL]
Grizzo, Sara. 2018. “DeepL Pro – Pro Produktivität und Vertraulichkeit [DeepL Pro – Pro Productivity and Confidentiality].” MDÜ 2/2018: 33–35.Google Scholar
Hillson, David. 2006. “Integrated Risk Management as a Framework for Organisational Success.” Paper presented at PMI® Global Congress 2006, Seattle, WA. Accessed 19 February 2020, [URL]
Iansiti, Marco, and Karim R. Lakhani. 2017. “The Truth about Blockchain.” Harvard Business Review January February 2017: 118–127. Accessed 19 February 2020, [URL]
IEC (International Electrotechnical Committee). 2019. IEC 82079-1:2019 Preparation of Information for Use (Instructions for Use) of Products – Part 1: Principles and General Requirements. Paris: ISO.Google Scholar
IRM (Institute of Risk Management). 2018. “A Risk Practitioners Guide to ISO 31000:2018.” IRM Resource Centre. Accessed 19 February 2020, [URL]
ISO (International Standardization Organization). 2010. ISO 12100:2010 Safety of Machinery – General Principles for Design – Risk Assessment and Risk Reduction. Paris: ISO.Google Scholar
. 2013. ISO/IEC 27001:2013 Information technology – Security techniques – Information security management systems – Requirements. Paris: ISO.Google Scholar
. 2015. ISO 17100:2015 Translation Services – Requirements for Translation Services. Paris: ISO.Google Scholar
. 2016. ISO 13485:2016 Medical Devices – Quality Management Systems – Requirements for Regulatory Purposes. Paris: ISO.Google Scholar
. 2017. ISO 18587:2017 Translation Services – Post-Editing of Machine Translation Output – Requirements. Paris: ISO.Google Scholar
. 2019. ISO 20607 Safety of Machinery – Instruction Handbook – General Drafting Principles. Paris: ISO.Google Scholar
Joyce, William. 2006. “Accounting, Purchasing and Supply Chain Management”. Supply Chain Management: An International Journal 11 (3): 202–207. DOI logoGoogle Scholar
Kahneman, Daniel. 2011. Thinking, Fast and Slow. New York: Farrar, Straus and Giroux.Google Scholar
Kahneman, Daniel, and Amos Tversky. 1982. “The Psychology of Preferences.” Scientific American 246 (1): 160–173. Accessed 19 February 2020, [URL]
Karlsson, Niklas, George Loewenstein, and Duane Seppi. 2009. “The Ostrich Effect: Selective Attention to Information.” Journal of Risk and Uncertainty 38 (2): 95–115. DOI logoGoogle Scholar
Khoong, Elaine, Eric Steinbrook, Cortlyn Brown, and Alicia Fernandez. 2019. “Assessing the Use of Google Translate for Spanish and Chinese Translations of Emergency Department Discharge Instructions.” JAMA Internal Medicine 179 (4): 580–82. Accessed 19 February 2020, [URL]
Koehn, Phillip, and Rebecca Knowles. 2017. “Six Challenges for Neural Machine Translation.” Proceedings of the 1st Workshop on Neural Machine Translation, Vancouver, BC, Canada, 28–39. Accessed 19 February 2020, [URL]. DOI logo
Krüger, Ralph. 2019. “Augmented Translation – eine Bestandsaufnahme des rechnergestützten Fachübersetzungsprozesses [Augmented Translation – A Survey of Computer-aided Technical Translation Processes].” trans-kom 12 (1): 142–81. Accessed 19 February 2020, [URL]
Kwon, Ik-Whan G., and Taewon Suh. 2004. “Factors Affecting the Level of Trust and Commitment in Supply Chain Relationships.” Journal of Supply Chain Management 40 (1): 4–14. DOI logo DOI logoGoogle Scholar
Leite, Fernando Ochoa, Catarina Cochat, Henrique Salgado, Mariana Pinto da Costa, Marta Queirós, Olga Campos, and Paulo Carvalho. 2016. “Using Google Translate in the Hospital: A Case Report.” Technology and Health Care 24 (6): 965–968. DOI logoGoogle Scholar
Lenssen, Joris-Johann, Nikolay A. Dentchev, and Ludwig Roger. 2014. “Sustainability, Risk Management and Governance: Towards an Integrative Approach.” Corporate Governance International Journal of Business in Society 14 (5): 670–84. DOI logoGoogle Scholar
Moberly, Tom. 2018. “Doctors Choose Google Translate to Communicate with Patients Because of Easy Access.” British Medical Journal 2018 (362): k3974. DOI logoGoogle Scholar
Moorkens, Joss. 2017. “Under Pressure: Translation in Times of Austerity.” Perspectives Studies in Translation Theory and Practice 25 (3): 464–77. DOI logoGoogle Scholar
. 2019. “Human Factors in Neural Machine Translation.” Paper presented at Université Paris Diderot, 15 March 2019. Accessed 19 February 2020, [URL]
Moorkens, Joss, and Dave Lewis. 2019. “Research Questions and a Proposal for the Future Governance of Translation Data.” Jostrans – The Journal of Specialised Translation 321: 2–25. Accessed 19 February 2020, [URL]
. 2020. “Chapter 28. Copyright and the Reuse of Translation Data.” In The Routledge Handbook of Translation and Technology, edited by Minako O’Hagan. Abingdon: Routledge, 469–481.Google Scholar
Morgan, Robert M., and Shelby D. Hunt. 1994. “The Commitment-Trust Theory of Relationship Marketing.” Journal of Marketing 58 (3): 20–38. DOI logoGoogle Scholar
Nitzke, Jean, Silvia Hansen-Schirra, and Carmen Canfora. 2019. “Risk management and post-editing competence.” Jostrans – The Journal of Specialised Translation 311: 239–59. Accessed 19 February 2020, [URL]
Nunes Vieira, Lucas, and Elisa Alonso. 2019. “Translating Perceptions and Managing Expectations: An Analysis of Management and Production perspectives on Machine Translation.” Perspectives Studies in Translation Theory and Practice. DOI logoGoogle Scholar
Nurminen, Mary, and Maarit Koponen. 2018. “Governments, NGOs, MT and Accessibility.” Presentation held at Kites/ELRC Workshop, 24 October 2018, Helsinki, Finland. Accessed 19 February 2020, [URL]
Pairaphrase. 2019. “End User License Agreement.” Accessed 19 February 2020, [URL]
Proz.com. 2017. “Fate of crossTank and crossTerm Entries in Remote Client Mode.” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
. 2018. “Is Translation a Field I Can Work in Despite the Rise of MT?” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
. 2019. “Anyone Want to Go on STRIKE?” Proz.com Translation Industry Discussion Forums. Accessed 19 February 2020, [URL]
Reason, John. 1990. Human Error. New York, NY: Cambridge University Press. DOI logoGoogle Scholar
Sakamoto, Akiko. 2019. “Unintended Consequences of Translation Technologies: From Project Managers’ Perspectives.” Perspectives Studies in Translation Theory and Practice 271: 58–73. DOI logoGoogle Scholar
Sakamoto, Akiko, and Masaru Yamada. 2019. “Promoting Ethical and Sustainable Use of MT in the Translation Industry: A Case in Japan.” Paper presented at the Fair MT Workshop, MT Summit 2019, Dublin City University. Accessed 19 February 2020, [URL]
Sakamoto, Akiko, Begoña Rodríguez de Céspedes, Sarah Berthaud, and Jonathan Evans. 2017. “When Translation meets Technology. Language Service Providers (LSPs) in the Digital Age.” Focus Group Report (October 2017). Accessed 19 February 2020, [URL]
Skoglösa, Örjan. 2019. “Vad tycker vi översättare om maskinöversättning? [What Do We Translators Think about Machine Translation?]” Facköversättaren 11: 16–19. Accessed 19 February 2020, [URL]
Slator. 2017. “Translate.com Exposes Highly Sensitive Information in Massive Privacy Breach.” Slator.com Blog. Accessed 19 February 2020, [URL]
Sutcliffe, Laura, Anja Maier, James Moultrie, and John Clarkson. 2009. “Development of a Framework for Assessing Sustainability in New Product Development.” Proceedings of the International Conference on Engineering Design 58 (7): 24–27 August 2009, Palo Alto, CA, USA. Accessed 19 February 2020, [URL]
Systran. 2016. “Is Your Team Violating Data Compliance Laws with Online Translation Tools?” Systran Blog. Accessed 19 February 2020, [URL]
Toft, Yvonne, Prue Howard, and David Jorgensen. 2003. “Changing Paradigms for Professional Engineering Practice towards Safe Design – An Australian Perspective.” Safety Science 41 (2–3): 263–276. DOI logoGoogle Scholar
Tversky, Amos, and Daniel Kahneman. 1973. “Availability: A Heuristic for Judging Frequency and Probability.” Cognitive Psychology 5 (2): 207–232. DOI logo”.Google Scholar
. 1974. “Judgement under Uncertainty: Heuristics and Biases.” Science 185 (4157): 1124–1131. DOI logoGoogle Scholar
Vaezian, Helia, and Mahmoud Akbari. 2018. “Common Risks in the Translation Industry. A Sequential Exploratory Study.” The Journal of Internationalization and Localization 5 (2): 95–113. DOI logoGoogle Scholar
Van Brussel, Laura, Arda Tezcan, and Lieve Macken. 2018. “A Fine-Grained Error Analysis of NMT, PBMT and RBMT Output for English-to-Dutch.” Proceedings of the Eleventh International Conference on Language Resources and Evaluation, May 2018, Miyazaki, Japan, 3799–3804. Accessed 19 February 2020, [URL]
Vashee, Kirti. 2017. “Data Security Risks with Generic and Free Machine Translation.” Empty Pages Blog. Accessed 19 February 2020, [URL]
Way, Andy. 2019. “Chapter 14. Machine Translation: Where Are We at Today?” In The Bloomsbury Companion to Language Industry Studies, edited by Eric Angelone, Maureen Ehrensberger-Dow, and Gary Massey. London: Bloomsbury.Google Scholar
WBCSD (World Business Council for Sustainable Development). 2016. “Sustainability and Enterprise Risk Management: The First Step Towards Integration.” WBCSD Reports. Accessed 19 February 2020, [URL]
Weinmann, Markus, Christoph Schneider, and Jan vom Brocke. 2016. “Digital Nudging” Business & Information Systems Engineering 58 (6): 433–436. DOI logoGoogle Scholar
World Economic Forum. 2017. “Global Risks of Highest Concern for Doing Business.” World Economic Forum Reports. Accessed 19 February 2020, [URL]
Zajonc, Robert B. 2001. “Mere Exposure. A Gateway to the Subliminal.” Current Directions in Psychological Science 10 (6): 224–228. DOI logoGoogle Scholar
Cited by (23)

Cited by 23 other publications

Brewster, Ryan C.L., Priscilla Gonzalez, Rohan Khazanchi, Alex Butler, Raquel Selcer, Derrick Chu, Barbara Pontes Aires, Marcella Luercio & Jonathan D. Hron
2024. Performance of ChatGPT and Google Translate for Pediatric Discharge Instruction Translation. Pediatrics 154:1 DOI logo
Greenall, Annjo Klungervik & Inger Hesjevoll Schmidt-Melbye
2024. Perceptions and management of risk in the translation of a Norwegian-language health app into English. Babel. Revue internationale de la traduction / International Journal of Translation / Revista Internacional de Traducción DOI logo
Mohamed, Yasir Abdelgadir, Akbar Khanan, Mohamed Bashir, Abdul Hakim H. M. Mohamed, Mousab A. E. Adiel & Muawia A. Elsadig
2024. The Impact of Artificial Intelligence on Language Translation: A Review. IEEE Access 12 ► pp. 25553 ff. DOI logo
Quinci, Carla
2024. The impact of machine translation on the development of info-mining and thematic competences in legal translation trainees: a focus on time and external resources. The Interpreter and Translator Trainer 18:2 ► pp. 290 ff. DOI logo
Rico Pérez, Celia
2024. La traducción automática de los referentes culturales. Hikma 23:1 ► pp. 87 ff. DOI logo
González Vallejo, Rubén
2023. Metaverse and translation studies: analysis of machine translation. Metaverse Basic and Applied Research 2 ► pp. 38 ff. DOI logo
Guerberof-Arenas, Ana & Joss Moorkens
2023. Ethics and Machine Translation: The End User Perspective. In Towards Responsible Machine Translation [Machine Translation: Technologies and Applications, 4], ► pp. 113 ff. DOI logo
Ma, Yuwei & Yu Qian
2023. Methods of Improving Japanese-Chinese Machine Translation System through Machine Learning and Human-Computer Interaction. ACM Transactions on Asian and Low-Resource Language Information Processing DOI logo
Mezeg, Adriana
2023. Ali sploh še potrebujemo prevajalce?. Ars & Humanitas 17:1 ► pp. 139 ff. DOI logo
Mondal, Subrota Kumar, Haoxi Zhang, H. M. Dipu Kabir, Kan Ni & Hong-Ning Dai
2023. Machine translation and its evaluation: a study. Artificial Intelligence Review 56:9 ► pp. 10137 ff. DOI logo
Nunes Vieira, Lucas, Carol O’Sullivan, Xiaochun Zhang & Minako O’Hagan
2023. Privacy and everyday users of machine translation. Translation Spaces 12:1 ► pp. 21 ff. DOI logo
Vieira, Lucas Nunes, Carol O’Sullivan, Xiaochun Zhang & Minako O’Hagan
2023. Machine translation in society: insights from UK users. Language Resources and Evaluation 57:2 ► pp. 893 ff. DOI logo
Ramírez-Polo, Laura & Chelo Vargas-Sierra
2023. Translation Technology and Ethical Competence: An Analysis and Proposal for Translators’ Training. Languages 8:2 ► pp. 93 ff. DOI logo
Rico, Celia & María del Mar Sánchez Ramos
2023. The Ethics of Machine Translation Post-editing in the Translation Ecosystem. In Towards Responsible Machine Translation [Machine Translation: Technologies and Applications, 4], ► pp. 95 ff. DOI logo
Riemland, Matt
2023. Theorizing sustainable, low-resource MT in development settings. Translation Spaces 12:2 ► pp. 231 ff. DOI logo
Singh, Digvijay, Garvit Vijay, Akanksha Gupta, Manas Yadav, Atul Mishra & Kiran Khatter
2023. 2023 2nd Edition of IEEE Delhi Section Flagship Conference (DELCON), ► pp. 1 ff. DOI logo
Tahir, Madiha, Zahid Halim, Muhmmad Waqas & Shanshan Tu
2023. On the Effect of Emotion Identification from Limited Translated Text Samples Using Computational Intelligence. International Journal of Computational Intelligence Systems 16:1 DOI logo
Horváth, Ildikó
2022. AI in interpreting: Ethical considerations. Across Languages and Cultures 23:1 ► pp. 1 ff. DOI logo
Krüger, Ralph
2022. Integrating professional machine translation literacy and data literacy. Lebende Sprachen 67:2 ► pp. 247 ff. DOI logo
Rico, Celia
2022. Mind the gap. Babel. Revue internationale de la traduction / International Journal of Translation 68:5 ► pp. 697 ff. DOI logo
Fırat, Gökhan
2021. Uberization of translation. The Journal of Internationalization and Localization 8:1 ► pp. 48 ff. DOI logo
Kasperė, Ramunė, Jolita Horbačauskienė, Jurgita Motiejūnienė, Vilmantė Liubinienė, Irena Patašienė & Martynas Patašius
2021. Towards Sustainable Use of Machine Translation: Usability and Perceived Quality from the End-User Perspective. Sustainability 13:23 ► pp. 13430 ff. DOI logo
Matsushita, Kayo
2021. Risk in translation. In Handbook of Translation Studies [Handbook of Translation Studies, 5], ► pp. 199 ff. DOI logo

This list is based on CrossRef data as of 30 december 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.