Automatic expansion of domain-specific lexicons by term categorization

Abstract

We discuss an approach to the automatic expansion of domain-specific lexicons , that is, to the problem of extending, for each c i in a predefined set C = { c 1 ,…, c m } of semantic domains , an initial lexicon L i 0 into a larger lexicon L i 1 . Our approach relies on term categorization , defined as the task of labeling previously unlabeled terms according to a predefined set of domains. We approach this as a supervised learning problem in which term classifiers are built using the initial lexicons as training data. Dually to classic text categorization tasks in which documents are represented as vectors in a space of terms, we represent terms as vectors in a space of documents. We present the results of a number of experiments in which we use a boosting-based learning device for training our term classifiers. We test the effectiveness of our method by using WordNetDomains, a well-known large set of domain-specific lexicons, as a benchmark. Our experiments are performed using the documents in the Reuters Corpus Volume 1 as implicit representations for our terms.