In:Approaches to Interlinguistics and Esperanto Studies
Edited by Ilona Koutny and Nicolau A. Dols Salas
[Studies in World Language Problems 12] 2027
► pp. 143–160
Chapter 10Generating constructed languages with artificial intelligence-based methods
An experimental approach
This content is being prepared for publication; it may be subject to changes.
Article outline
- 1.Introduction
- 2.Concepts and methodology
- 3.Defining the target language: The grammar
- 4.Material production
- 5.Features of Siñol
- 6.Final remarks
- Author queries
Acknowledgements Bibliography
References (29)
Besta, M., Blach, N., Kubicek, A., Gerstenberger, R., Podstawski, M., Gianinazzi, L., Gajda, J., Lehmann, T., Niewiadomski, H., Nyczyk, P., & Hoefler, T. 2024. “Graph of thoughts: Solving elaborate problems with large language models.” In Proceedings of the AAAI Conference on Artificial Intelligence, 38(16).
Rodríguez Betancourt, E., & Casasola Murillo, E. 2023, October 27. Generación de definiciones de palabras usando modelos de lenguaje generativos. In XI Coloquio Costarricense de Lexicografía, Instituto de Investigaciones Lingüísticas (INIL), University of Costa Rica. [Work in progress]. [URL]
Bingsheng Yao, Guiming Chen, Ruishi Zou, Yuxuan Lu, Jiachen Li, Shao Zhang, Yisi Sang, Sijia Liu, James Hendler, and Dakuo Wang. 2024. More Samples or More Prompts? Exploring Effective Few-Shot In-Context Learning for LLMs with In-Context Sampling. In Findings of the Association for Computational Linguistics: NAACL 2024: 1772–1790, Mexico City, Mexico. Association for Computational Linguistics.
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., ... & Amodei, D. 2020. Language Models are Few-Shot Learners. Advances in Neural Information Processing Systems 33: 1–75. (GPT-3 Paper). [URL]
Clark, Kevin; Urvashi Khandelwal; Omer Levy, and Christopher D. Manning. 2019. What Does BERT Look at? An Analysis of BERT’s Attention. In Proceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, 276–286, Florence, Italy. Association for Computational Linguistics.
Claude AI. 2024. Claude (versión Claude 3). [Large Language Model]. [URL]
Dai, Z., Zhao, V. Y., Ma, J., Luan, Y., Ni, J., Lu, J., Bakalov, A., Guu, K., Hall, K. B., & Chang, M.-W. 2022. Promptagator: Few-shot dense retrieval from 8 examples. arXiv. [URL]
Diamond, J. 2023. “Genlangs” and Zipf’s law: Do languages generated by ChatGPT statistically look human? arXiv.
Elhage, N., Nanda, N., Olsson, K., Henighan, T., Joseph, N., Mann, B., ... & Olah, C. 2021. A Mathematical Framework for Transformer Circuits. [URL]. (Circuit based visualization)
Gemini AI. 2023. Gemini (versión 2.0 Flash). [Large Language Model]. [URL]
Gonzalez-Rodriguez, D. & Hernandez-Carrion, J.-R. 2018. Artificial intelligence and constructed-language emergence: Overtaking synthetic conlangs with self-organized linguistic systems. In S. Barile, R. Espejo, I. Perko, & M. Saviano (Eds), Cybernetics and systems: Social and business decisions (1st ed.). Routledge.
Hackmann, S., Mahmoudian, H., Steadman, M., & Schmidt, M. 2024. Word importance explains how prompts affect language model outputs. arXiv. [URL]
Heyer, F. 2021. Generating immersive conlangs [Unpublished doctoral dissertation]. Christian-Albrecht University of Kiel.
Jabbar, H. 2023. MorphPiece: A Linguistic Tokenizer for Large Language Models. [URL]
Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. 2023. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing. ACM Comput. Surv. 55 (9), 1–35.
Mistral AI. 2023. Mistral (versión Mistral-7B-v0.1/Mistral 7B Base/Instruct v3/Mistral Small 25.01 (mistral-small-2501)). [Large Language Model]. [URL]
Novikov, P. N. 2022. Constructed languages as semantic and semiotic systems. RUDN Journal of Language Studies, Semiotics and Semantics, 13(2): 455–467.
Olsson, C., Elhage, N., Nanda, N., Joseph, N., DasSarma, N., Henighan, T., Mann, B., Askell, A., Bai, Y., Chen, A., Conerly, T., Drain, D., Ganguli, D., Hatfield-Dodds, Z., Hernandez, D., Johnston, S., Jones, A., Kernion, J., Lovitt, L., ... Olah, C. 2022. In-context learning and induction heads. arXiv. [URL]
Open AI. 2023. ChatGPT (versión GPT-4) [Large Language Model]. [URL]
Pranjić, Marko; Marko Robnik-Šikonja, and Senja Pollak. 2024. LLMSegm: Surface-level Morphological Segmentation Using Large Language Model. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024): 10665–10674, Torino, Italia. ELRA and ICCL. [URL].
Sel, B., Al-Tawaha, A., Khattar, V., Jia, R., & Jin, M. 2024. Algorithm of thoughts: Enhancing exploration of ideas in large language models. arXiv. [URL]
Taku Kudo. 2018. Subword Regularization: Improving Neural Network Translation Models with Multiple Subword Candidates. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 66–75, Melbourne, Australia. Association for Computational Linguistics.
Wei, J., Bosma, M., Zhao, V. Y., Guu, K., Yu, A. W., Lester, B., ... & Le, Q. 2021. Fine tuned Language Models Are Zero-Shot Learners. [URL]
Wei, J., Wang, X., Schuurmans, D., Bosma, M., Ichter, B., Le, Q. V. …, & Zhou, D. 2022. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models. Advances in Neural Information Processing Systems, 35: 24824–24837. [URL].
Wilcox Gotlieb, E., Futrell, R., & Levy, R. 2023. Using computational models to test syntactic learnability. Linguistic Inquiry.
Yao, S., Yu, D., Zhao, J., Shafran, I., Griffiths, T., Cao, Y., & Narasimhan, K. 2023. Tree of Thoughts: Deliberate Problem Solving with Large Language Models. arXiv preprint. [URL]
Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. 2023. Why Johnny Can’t Prompt: How Non-AI Experts Try (and Fail) to Design LLM Prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. P. 437. Association for Computing Machinery.
Zhao, T., Wallace, E., Feng, S., Klein, D., & Singh, S. 2021. Calibrate Before Use: Improving Few-Shot Performance of Language Models. Proceedings of the 38th International Conference on Machine Learning, 12697–12706. [URL]