arXiv (Cornell University) · 2016 · 23 citations · 31 references
ComputingComputer ScienceComputer VisionMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingPerceptual LearningPhonological RepresentationRepresentation LearningVisual SemanticsContextHierarchical Representation LearningNeural Language ModelsRecurrent Neural Language ModelsRecurrent Neural Network Language ModelsRecurrent Neural NetworksVisual Context EffectsVisual Grounding
We present a model of visually-grounded language learning based on stacked gated recurrent neural networks which learns to predict visual features given an image description in the form of a sequence of phonemes. The learning task resembles that faced by human language learners who need to discover both structure and meaning from noisy and ambiguous data across modalities. We show that our model indeed learns to predict features of the visual context given phonetically transcribed image descriptions, and show that it represents linguistic information in a hierarchy of levels: lower layers in the stack are comparatively more sensitive to form, whereas higher layers are more sensitive to meaning.
31
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
Jeffrey L. Elman · Cognitive Science · 1990 · 10.8K citations
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Jun‐Young Chung, Çağlar Gülçehre, Kyunghyun Cho et al. · arXiv (Cornell University) · 2014 · 10.8K citations · Full text
An introduction to latent semantic analysis
Thomas K. Landauer, Peter W. Foltz, Darrell Laham · Discourse Processes · 1998 · 4.9K citations