Article In: International Journal of Corpus Linguistics: Online-First Articles
Individual language variation across discourse types
The 100 Idiolects corpus for authorship analysis research
This content is being prepared for publication; it may be subject to changes.
Abstract
The idea of identifying the authors of forensically relevant texts is based on the assumption that individuals have unique linguistic repertoires on which they draw to communicate. However, there is only limited empirical support for this assumption and where it does exist, it is typically provided by studies based on sociolinguistically homogeneous datasets, i.e. ones containing multiple language samples from individuals communicating in just one discourse type. This article presents a resource designed to facilitate research on individual variation across a heterogeneous dataset. We have collected English-language data in seven discourse types (interview, university coursework, email, text message, picture description, Google search, business memo) for 112 individuals and, additionally, handwritten essays for 67 of the 112 individuals. We describe the data collection process and the structure of the corpus, as well as its anonymisation procedures and database architecture, before outlining potential applications in forensic authorship analysis and beyond.
Article outline
- 1.Introduction
- 2.Empirically-driven studies of idiolects
- 3.Corpus design
- 3.1Participants
- 3.2Discourse types
- 4.Data collection
- 4.1Recruitment of participants
- 4.2Design of data collection sessions
- 4.3Issues encountered
- 5.Data format, interchange and access
- 5.1Data processing and exchange formats
- 5.2Anonymisation
- 6.Conclusion
- Acknowledgements
- Notes
References
References (36)
Barlow, M. (2013). Individual differences and usage-based grammar. International Journal of Corpus Linguistics, 18(4), 443–478.
Coulthard, M. (1997). A Failed appeal. International Journal of Speech, Language and the Law, 4(2), 287–302.
Coulthard, M., May, A., Kredens, K., & Woolls, D. (2010). Plagiarism: Four forensic linguists’ responses to suspected plagiarism. In M. Coulthard, & A. May (Eds.), The Routledge handbook of forensic linguistics (pp. 523–538). Routledge.
Coulthard, M., Grant, T. and Kredens, K. (2011). Forensic linguistics. In R. Wodak, B. Johnstone, & P. E. Kerswill (Eds.), The SAGE Handbook of Sociolinguistics (pp. 529–544). Sage.
Danu, J. (2025). Person vs. situation: Explorations of individual language use across discourse types and personality traits [Unpublished PhD dissertation]. Aston University.
Goldstein-Stewart, J., Winder, R., & Sabin, R. (2009). Person identification from text and speech genre samples. In A. Lascarides, C. Gardent, & J. Nivre (Eds.), Proceedings of the 12th conference of the European chapter of the ACL (EACL 2009), (pp. 336–344). Association for Computational Linguistics. [URL].
Grant, T. (2013). TXT 4n6: Method, consistency and distinctiveness in the analysis of SMS text messages. Journal of Law and Policy, 21(2), 467–494. [URL]
Grant, T., & Grieve, J. (2022). The Starbuck case: Methods for addressing confirmation bias in forensic authorship analysis. In I. Picornell, R. Perkins, & M. Coulthard (Eds.), Methodologies and challenges in forensic linguistic casework, (pp. 13–28). Wiley.
Grant, T., & MacLeod, N. (2018). Resources and constraints in linguistic identity performance — A theory of authorship. Language and Law=Linguagem e Direito, 5(1), 80–96. [URL]
Grieve, J. (2023). Register variation explains stylomteric authorship analysis. Corpus Linguistics and Linguistic Theory, 19(1), 47–77.
Heini, A., & Kredens, K. (2023). Remote data collection in sociolinguistics: Lessons from the COVID-19 pandemic. International Journal of Social Research Methodology, 27(6), 747–759.
Honnibal, M., Montani, I., Van Landeghem, S., & Boyd, A. (2020). spaCy: Industrial-strength Natural Language Processing in Python (Version 3.7.2). [Computer software].
Johnstone, B. (1996). The Linguistic individual: Self-expression in language and linguistics. Oxford University Press.
Kestemont, M., Luyckx, K., Daelemans, W., & Crombez, T. (2012). Cross-genre authorship verification using unmasking. English Studies, 93(3), 340–356.
Kredens, K. (2002). Towards a corpus-based methodology of forensic authorship attribution: A comparative study of two idiolects. In B. Lewandowska-Tomaszczyk (Ed.), PALC 2001: Practical Applications in Language Corpora, (pp. 405–437). Peter Lang.
Labov, W. (1966). The Social stratification of English in New York City. Center for Applied Linguistics.
Love, R., Dembry, C., Hardie, A., Brezina, V., & McEnery, T. (2017). The Spoken BNC2014: Designing and building a spoken corpus of everyday conversations. International Journal of Corpus Linguistics, 22(3), 319–344.
Marko, K., Reitbauer, M., & Pickl, G. (2022). Same person, different platform. Challenges and implications for forensic authorship analysis. Register Studies, 4(2), 202–231.
Mollin, S. (2009) “I entirely understand” is a Blairism: The methodology of identifying idiolectal collocations. International Journal of Corpus Linguistics, 14(3), 367–392.
Nini, A., & Grant, T. (2013). Bridging the gap between stylistic and cognitive approaches to authorship analysis using systemic functional linguistics and multidimensional analysis. The International Journal of Speech, Language and the Law, 20(2), 173–202.
Oomen, C. C., & Postma, A. (2001). Effects of divided attention on the production of filled pauses and repetitions. Journal of Speech, Language, and Hearing Research, 44(5), 997–1004.
Overdorf, R., & Greenstadt, R. (2016). Blogs, Twitter feeds, and Reddit comments: Cross-domain authorship attribution. Proceedings on Privacy Enhancing Technologies, 2016(3), 155–171.
Schilling-Estes, N. (2007). Sociolinguistic fieldwork. In R. Bayley, & C. Lucas (Eds.), Sociolinguistic variation: Theories, methods, and applications, (pp. 165–189). Cambridge University Press.
Sharma, D., & McCarthy, K. (2018). Attentional load and style control. Penn Working Papers in Linguistics, 24(2), 127–136.
Stamatatos, E. (2013). On the robustness of authorship attribution based on character n-gram features. Journal of Law and Policy, 21(2), 421–439. [URL]
Wright, D. (2013). Stylistic variation within genre conventions in the Enron email corpus: Developing a text-sensitive methodology for authorship research. International Journal of Speech, Language and the Law, 20(1), 45–75.
(2017). Using word n-grams to identify authors and idiolects: A corpus approach to a forensic linguistic problem. International Journal of Corpus Linguistics, 22(2), 212–241.