2018 · 13 citations · 18 references
ComputingComputer ScienceComputational LinguisticsComputer VisionNatural Language ProcessingLanguage ModelingScene UnderstandingSpatial Data RepresentationSpatial Knowledge RepresentationSpatial RelationsSpatial RepresentationHuman-robot DialogueImage CaptioningNeural Language ModelsPerplexitySemantic Feature KnowledgeSemantic Knowledge RepresentationSpatial DescriptionSpatial Semantic Representation
The challenge for computational models of spatial descriptions for situated dialogue systems is the integration of information from different modalities. The semantics of spatial descriptions are grounded in at least two sources of information: (i) a geometric representation of space and (ii) the functional interaction of related objects that. We train several neural language models on descriptions of scenes from a dataset of image captions and examine whether the functional or geometric bias of spatial descriptions reported in the literature is reflected in the estimated perplexity of these models. The results of these experiments have implications for the creation of models of spatial lexical semantics for human-robot dialogue systems. Furthermore, they also provide an insight into the kinds of the semantic knowledge captured by neural language models trained on spatial descriptions, which has implications for image captioning systems.
18
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations
A Neural Probabilistic Language Model
Yoshua Bengio, Réjean Ducharme, Pascal Vincent · 2000 · 1.2K citations