Cover not available
Article published In:
Journal of Second Language Studies
Vol. 5:1 (2022) ► pp.1–33

What do (some of) our association measures measure (most)? Association?

| University of California Santa Barbara, USA

This paper discusses the degree to which some of the most widely-used measures of association in corpus linguistics are not particularly valid in the sense of actually measuring association rather than some amalgam of a lot of frequency and a little association. The paper demonstrates these issues on the basis of hypothetical and actual corpus data and outlines implications of the findings. I then outline how to design an association measure that only measures association and show that its behavior supports the use of the log odds ratio as a true association-only measure but separately from frequency; in addition, this paper sets the stage for an analogous review of dispersion measures in corpus linguistics.

Keywords: association, frequency, dispersion, log-likelihood, t , MI , generalized additive modeling
Article outline
  • 1.Introduction
  • 2.The conflation of frequency and association
    • 2.1Hypothetical data and G 2’s behavior
      • 2.1.1A collocation/collostruction example
      • 2.1.2A keyness example
    • 2.2Actual data and G 2’s behavior
    • 2.3Actual data and t’s behavior
    • 2.4Actual data and MI’s behavior
  • 3.Interim discussion
    • 3.1Some general remarks
    • 3.2 MI, MI 2, and MI 3
    • 3.3A brief comment on (log) Dice
  • 4.A new measure
    • 4.1Motivation and development
    • 4.2Application to fast
  • 5.A small excursus
  • 6.Concluding remarks
  • Notes
  • References
Published online: 12 November 2021
DOI logo
https://doi.org/10.1075/jsls.21028.gri
References (27)
Baayen, R. Harald, Petar Milin, & Michael Ramscar
2016 Frequency in lexical processing. Aphasiaology 30(11). 1174–1220. DOI logoGoogle Scholar
Bestgen, Yves & Sylviane Granger
2014 Quantifying the development of phraseological competence in L2 English writing: An automated approach. Journal of Second Language Writing 261. 28–41. DOI logoGoogle Scholar
Chruch, Kenneth W. & Patrick Hanks
1993 Word association norms, mutual information, and lexicography. Computational Linguistics 16(1). 22–29.Google Scholar
Dunning, Ted
1993 Accurate methods for the statistics of surprise and coincidence. Computational Linguistics 19(1), 61–74.Google Scholar
Durrant, Phil
2014 Corpus frequency and second language learners’ knowledge of collocations. International Journal of Corpus Linguistics 19(4). 443–477. DOI logoGoogle Scholar
Durrant, Phil & Norbert Schmitt
2009 To what extent do native and non-native writers make use of collocations? Internationak Review of Applied Linguistics 471. 157–177. DOI logoGoogle Scholar
Ellis, Nick C.
2007a Language acquisition as rational contingency learning. Applied Linguistics 27(1). 1–24. DOI logoGoogle Scholar
2007b The Associative-Cognitive CREED. In Bill VanPatten & Jessica Williams (eds.), Theories of second language acquisition: an introduction, 77–95. Mahwah, NJ: Lawrence Erlbaum.Google Scholar
Ellis, Nick C., Rita Simpson-Vlach, & Carson Maynard
2008 Formulaic language in native and second language speakers: Psycholinguistics, corpus linguistics, and TESOL. TESOL Quarterly 42(3). 375–396. DOI logoGoogle Scholar
Evert, Stefan
2009 Corpora and collocations. In Anke Lüdeling & Merja. Kytö (eds.), Corpus Linguistics: An International Handbook, Vol. 21, 1212–1248. Berlin & New York: Mouton de Gruyter.Google Scholar
Evert, Stefan & Brigitte Krenn
2001 Methods for the qualitative evaluation of lexical association measures. Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics, p, 188–195. DOI logoGoogle Scholar
Groom, Nicholas
2009 Effects of second language immersion on second language collocational development. In Andy Barfield & Henrik Gyllstad (eds.), Researching collocations in another language, 21–33. Basingstoke, UK: Palgrave Macmillan. DOI logoGoogle Scholar
Gries, Stefan Th.
2008 Dispersions and adjusted frequencies in corpora. International Journal of Corpus Linguistics 13(4). 403–437. DOI logoGoogle Scholar
2010 Dispersions and adjusted frequencies in corpora: further explorations. In Stefan Th. Gries, Stefanie Wulff, & Mark Davies (eds.), Corpus linguistic applications: current studies, new directions, 197–212. Amsterdam: Rodopi. DOI logoGoogle Scholar
2013 50-something years of work on collocations: what is or should be next … International Journal of Corpus Linguistics 18(1). 137–165. DOI logoGoogle Scholar
2019a Ten lectures on corpus-linguistic approaches: Applications for usage-based and psycholinguistic research. Leiden & Boston: Brill. DOI logoGoogle Scholar
2019b 15 years of collostructions: some long overdue additions/corrections (to/of actually all sorts of corpus-linguistics measures). International Journal of Corpus Linguistics 24(3). 385–412. DOI logoGoogle Scholar
2020 Analyzing dispersion. In Magali Paquot & Stefan Th. Gries (eds.), A practical handbook of corpus linguistics, 99–118. Berlin & New York: Springer. DOI logoGoogle Scholar
Gries, Stefan Th.
2021 A new approach to (key) keywords analysis: using frequency, and now also dispersion. Research in Corpus Linguistics 9(2). 1–33. DOI logoGoogle Scholar
Gries, Stefan Th.
2022 What do (some of) our dispersion measures measure (most)? Dispersion? Journal of Second Language Studies. DOI logoGoogle Scholar
Hunston, Susan
2002 Corpora in applied linguistics. Cambridge: Cambridge University Press. DOI logoGoogle Scholar
Pecina, Pavel
2009 Lexical AMs and collocation extraction. Language Resources and Evaluation 44(1–2). 137–158. DOI logoGoogle Scholar
Savický, Petr & Jaroslava Hlaváčová
2002 Measures of word commonness. Journal of Quantitative Linguistics 9(3), 215–231. DOI logoGoogle Scholar
Schmid, Hans Joerg
2010 Entrenchment, salience, and basic levels. In Dirk Geeraerts & Hubert Cuyckens (eds.), The Oxford Handbook of Cognitive Linguistics, 117–138. Oxford: Oxford University Press.Google Scholar
Siyanova-Chanturia, Anna
2015 Collocation in beginner learner writing: A longitudinal study. System 531. 148–160. DOI logoGoogle Scholar
Stubbs, Michael
1995 Collocations and semantic profiles: on the cause of the trouble with quantitative methods. Functions of Language 2(1). 23–55. DOI logoGoogle Scholar
Thanopoulos, Aristomenis, Nikos Fakotakis, & George Kokkinakis
2002 Comparative Evaluation of Collocation Extraction Metrics. Paper presented at LREC 2002.
Cited by (15)

Cited by 15 other publications

Bardenstein, Ruti & Mira Ariel
2024. From location to conjunction, disjunction, partition, exemplification and association: Hebrew bein constructions. Linguistics 0:0 DOI logo
Cuberos Vicente, Rocío, Elisa Rosado Villegas & Iban Mañas Navarrete
2024. Towards a graded lexical inventory of multi-word combinations. ITL - International Journal of Applied Linguistics DOI logo
Hoang, Hien & Peter Crosthwaite
2024. A comparative analysis of multiword units in the reading and listening input of English textbooks. System 121 ► pp. 103224 ff. DOI logo
Hougham, Dan, Jon Clenton & Takumi Uchihara
2024. Disentangling the contributions of shorter vs. longer lexical bundles to L2 oral fluency. System 121 ► pp. 103243 ff. DOI logo
Hougham, Dan, Jon Clenton, Takumi Uchihara & George Higginbotham
2024. The Impact of Lexical Bundle Length on L2 Oral Proficiency. Languages 9:7 ► pp. 232 ff. DOI logo
Liao, Shengyu, Stefan Th. Gries & Stefanie Wulff
2024. Transfer five ways: applications of multiple distinctive collexeme analysis to the dative alternation in Mandarin Chinese. Corpus Linguistics and Linguistic Theory 0:0 DOI logo
Schäfer, Roland & Ulrike Sayatz
2024. Between syntax and morphology: German noun+verb units. Glossa: a journal of general linguistics 9:1 DOI logo
Suethanapornkul, Sakol & Sarut Supasiraprapa
2024. Usage events and constructional knowledge: A study of two variants of the introductory-it construction. Studies in Second Language Acquisition 46:2 ► pp. 355 ff. DOI logo
Yi, Wei & Yanlu Zhong
2024. The processing advantage of multiword sequences: A meta-analysis. Studies in Second Language Acquisition 46:2 ► pp. 427 ff. DOI logo
Eguchi, Masaki & Kristopher Kyle
2023. L2 collocation profiles and their relationship with vocabulary proficiency: A learner corpus approach. Journal of Second Language Writing 60 ► pp. 100975 ff. DOI logo
Jeaco, Stephen
2023. How can we communicate (visually) what we (usually) mean by collocation and keyness?. Journal of Second Language Studies 6:1 ► pp. 29 ff. DOI logo
Ballance, Oliver James
2022. Methodological considerations for the use of mutual information: Examining the role of context in collocation research. Research Methods in Applied Linguistics 1:3 ► pp. 100024 ff. DOI logo
Gries, Stefan Th.
2022. What do (most of) our dispersion measures measure (most)? Dispersion?. Journal of Second Language Studies 5:2 ► pp. 171 ff. DOI logo
Gries, Stefan Th.
2022. What do (some of) our association measures measure (most)? Association?. Journal of Second Language Studies 5:1 ► pp. 1 ff. DOI logo
[no author supplied]
2024. Frequency, Dispersion, Association, and Keyness [Studies in Corpus Linguistics, 115], DOI logo

This list is based on CrossRef data as of 5 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.