Word Sense Induction: Triplet-Based Clustering and Automatic Evaluation

Stefan Bordag

2006 · 60 citations · 13 references

Concepts

TL;DR

Word sense induction typically relies on clustering word co‑occurrences and follows the one‑sense‑per‑collocation principle. The study introduces a new unsupervised word sense induction approach. It enhances the one‑sense‑per‑collocation observation by clustering triplets of words and employs a two‑step clustering process with sentence co‑occurrence features, along with an automatic evaluation method. The method achieves accurate results, offers reproducibility and independence from biased gold standards, and enables automatic parameter optimization.

Abstract

In this paper a novel solution to automatic and unsupervised word sense induction (WSI) is introduced. It represents an instantiation of the ‘one sense per collocation’ observation (Gale et al., 1992). Like most existing approaches it utilizes clustering of word co-occurrences. This approach differs from other approaches to WSI in that it enhances the effect of the one sense per collocation observation by using triplets of words instead of pairs. The combination with a two-step clustering process using sentence co-occurrences as features allows for accurate results. Additionally, a novel and likewise automatic and unsupervised evaluation method inspired by Sch¨ utze’s (1992) idea of evaluation of word sense disambiguation algorithms is employed. Offering advantages like reproducability and independency of a given biased gold standard it also enables automatic parameter optimization of the WSI algorithm.

References

13