Cover not available
Review article published In:
Digital Translation
Vol. 11:1 (2024) ► pp.73–84
Industry watch

The rise of large language models informed by not so large corpora of training data

ORCID logo | CSA Research
Article outline
  • “Magical” English performance may not translate
  • Limited training data has real-world effects
  • Multiple order-of-magnitude variation increases digital divides
  • Unclear criteria for usability cloud plans for improvement
  • An existential crisis for languages of lesser diffusion?
  • Implications for the language sector
  • References


This article is available free of charge.

Published online: 14 June 2024
DOI logo
https://doi.org/10.1075/dt.24006.lom
References (11)
References
Bavarian, Mohammad, Angela Jiang, Haewoo Jun, Henrique Pondé. 2022. “New GPT-3 capabilities: Edit & insert”. OpenAI blog, March 15, 2022. [URL]
Common Crawl. n.d. “Statistics of Common Crawl Monthly Archives”. [URL]. Accessed February 4, 2024.
Cooper, Kindra. 2023. “OpenAI GPT-3: Everything You Need to Know [Updated]”. Springboard, September 27, 2023. [URL]
DePalma, Donald A. & Arle Lommel. 2023. “Locales and Focused Large Language Models.” CSA Research, October 4, 2023. [URL]
Dickson, Ben. 2022. “Three key takeaways from Meta’s Galactica AI”. TechTalk, November 21, 2022. [URL]
Heaven, Will Douglas. 2023. “The insider story of how ChatGPT was built from the people who made it”. MIT Technology Review, March 3, 2023. [URL]
Lai, Viet Dac, Nghia Trung Ngo, Amir Pouran Ben Veyseh, Hieu Man, Franck Dernoncourt, Trung Bui, & Thien Huu Nguyen. 2023. “ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learning”. [URL]
Lommel, Arle. 2023. “Is Generative AI’s Translation Output Usable and for What?”. CSA Research, April 25, 2023. [URL]
Pareesh, Dave. 2023. “ChatGPT Is Cutting Non-English Languages Out of the AI Revolution”. Wired, May 31, 2023. [URL]
Thompson, Brian, Mehak Preet Dhaliwal, Peter Frisch, Tobias Domhan, & Marcello Federico. 2024. “A Shocking Amount of the Web is Machine Translated: Insights from Multi-Way Parallelism”. [URL]
Vaughn, Thom. 2023. “November/December 2023 Crawl Archive Now Available”. Common Crawl, December 15, 2023. [URL]