International Conference on Computational Linguistics · 2010 · 29 citations · 7 references
HumanitiesComputer ScienceComputational LinguisticsCorpus LinguisticsNatural Language ProcessingComparable CorporaComparable Corpus AnalysisTerm ExtractionBilingual CorporaBilingual Lexicon InductionBilingual Text CorporaComparable Corpus MiningDiachronic Comparable CorporaMonolingual Comparable CorporaMultilingual Lexicon Induction
Many existing methods for bilingual lexicon learning from comparable corpora are based on similarity of context vectors. These methods suffer from noisy vectors that greatly affect their accuracy. We introduce a method for filtering this noise allowing highly accurate learning of bilingual lexicons. Our method is based on the notion of in-domain terms which can be thought of as the most important contextually relevant words. We provide a method for identifying such terms. Our evaluation shows that the proposed method can learn highly accurate bilingual lexicons without using orthographic features or a large initial seed dictionary. In addition, we also introduce a method for measuring the similarity between two words in different languages without requiring any initial dictionary.
7
Accurate methods for the statistics of surprise and coincidence
Ted Dunning · 1993 · 2.7K citations
Learning Bilingual Lexicons from Monolingual Corpora
Aria Haghighi, Percy Liang, Taylor Berg-Kirkpatrick et al. · 2008 · 312 citations
Identifying word translations in non-parallel texts
Reinhard Rapp · 1995 · 256 citations · Full text
Learning a translation lexicon from monolingual corpora
Philipp Koehn, Kevin Knight · 2002 · 227 citations · Full text