Transactions of the Association for Computational Linguistics · 2017 · 37 citations · 28 references
Language StudiesComputer ScienceLinguisticsComputational LinguisticsPsycholinguisticsSemanticsCognitive SemanticsLanguage ModelingLanguage ModelsNatural Language UnderstandingText ComprehensionHuman Information ProcessingLanguage Processing ModelsLexical PredictionPredictionPredictive Processing In LanguageReferring Expression UnderstandingScript KnowledgeSemantic Prediction
Recent research in psycholinguistics has provided increasing evidence that humans predict upcoming content. Prediction also affects perception and might be a key to robustness in human language processing. In this paper, we investigate the factors that affect human prediction by building a computational model that can predict upcoming discourse referents based on linguistic knowledge alone vs. linguistic knowledge jointly with common-sense knowledge in the form of scripts. We find that script knowledge significantly improves model estimates of human predictions. In a second study, we test the highly controversial hypothesis that predictability influences referring expression type but do not find evidence for such an effect.
28
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
A Limited Memory Algorithm for Bound Constrained Optimization
Richard H. Byrd, Peihuang Lu, Jorge Nocedal et al. · SIAM Journal on Scientific Computing · 1995 · 6.2K citations
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Jason Weston et al. · 2015 · 5.2K citations · Full text
The Analysis of Contingency Tables
Charles L. Odoroff, B. A. Everitt · Technometrics · 1978 · 1.5K citations