2015 · 43 citations · 25 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingSemanticsLanguage ModelingLanguage ModelsLexical SemanticsWord MeaningContextContext RepresentationContextual Word RepresentationFillersLexical SubstitutionWord Meaning RepresentationWord Representation Learning
Context representations are a key element in distributional models of word meaning. In contrast to typical representations based on neighboring words, a recently proposed ap-proach suggests to represent a context of a tar-get word by a substitute vector, comprising the potential fillers for the target word slot in that context. In this work we first propose a vari-ant of substitute vectors, which we find partic-ularly suitable for measuring context similar-ity. Then, we propose a novel model for rep-resenting word meaning in context based on this context representation. Our model outper-forms state-of-the-art results on lexical substi-tution tasks in an unsupervised setting. 1
25
Word association norms, mutual information, and lexicography
Kenneth Church, Patrick Hanks · 1990 · 3.7K citations
A Synopsis of Linguistic Theory, 1930-1955
J. R. Firth · Medical Entomology and Zoology · 1957 · 1.7K citations
Improved backing-off for M-gram language modeling
Reinhard Kneser, Hermann Ney · 2002 · 1.5K citations