Definition of an evaluation grid for term-extraction software
Marie-Claude L'Homme | University of Montreal, University of Metz, University of Nice
Loubna Benali | University of Montreal, University of Metz, University of Nice
Claudine Bertrand | University of Montreal, University of Metz, University of Nice
Patricia Lauduique | University of Montreal, University of Metz, University of Nice
This paper examines evaluation criteria for term-extraction software. These tools have gained popularity over the past few years, but they come in all sorts of structures and their performance cannot be compared (qualitatively) to that of humans performing the same task. The lists obtained after an automated extraction must always be filtered by users. The evaluation form proposed here consists of a certain number of preprocessing criteria (such as the language analyzed by the software, identification strategies used, etc.) and a postprocessing criterion (performance of software) that users must take into account before they start using such systems. Each criterion is defined and illustrated with examples. Commercial tools have also been tested.
Rigouts Terryn, Ayla, Véronique Hoste & Els Lefever
2020. In no uncertain terms: a dataset for monolingual and multilingual automatic term extraction from comparable corpora. Language Resources and Evaluation 54:2 ► pp. 385 ff.
Bonadonna, Maria Francesca, Marianna Lisi, F. Neveu, G. Bergounioux, M.-H. Côté, J.-M. Fournier, L. Hriba & S. Prévost
2016. L’adjectif dans la désignation des énergies marines renouvelables. SHS Web of Conferences 27 ► pp. 05006 ff.
L'Homme, Marie-Claude
2004. Bibliographie. In La terminologie : principes et techniques, ► pp. 259 ff.
Jacquemin, Christian, Béatrice Daille, Jean Royauté & Xavier Polanco
2002. In vitro evaluation of a program for machine-aided indexing. Information Processing & Management 38:6 ► pp. 765 ff.
This list is based on CrossRef data as of 27 september 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers.
Any errors therein should be reported to them.