2015 · 81 citations · 18 references
ComputingComputer ScienceLinguisticsComputational LinguisticsNatural Language ProcessingSemanticsLanguage ModelingLanguage ModelsLexical SemanticsNatural Language UnderstandingWord EmbeddingsDistribution LearningDistributional DataLexical DistributionSemantic Feature KnowledgeSemantic Knowledge RepresentationSemantic Models
In recent years, distributional models (DMs) have shown great success in repre-senting lexical semantics. In this work we show that the extent to which DMs rep-resent semantic knowledge is highly de-pendent on the type of knowledge. We pose the task of predicting properties of concrete nouns in a supervised setting, and compare between learning taxonomic properties (e.g., animacy) and attributive properties (e.g., size, color). We employ four state-of-the-art DMs as sources of feature representation for this task, and show that they all yield poor results when tested on attributive properties, achieving no more than an average F-score of 0.37 in the binary property prediction task, com-pared to 0.73 on taxonomic properties. Our results suggest that the distributional hypothesis may not be equally applicable to all types of semantic information. 1
18
Chih-Chung Chang, Chih‐Jen Lin · ACM Transactions on Intelligent Systems and Technology · 2011 · 41.3K citations
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Zellig S. Harris · WORD · 1954 · 4.7K citations