2017 · 37 citations · 50 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingTranslation TheoryDeep LearningLanguage ClassificationLanguage ModelingMachine TranslationMultilingual Natural Language ProcessingWord EmbeddingsBilingual Lexicon InductionCharacter-level RepresentationCross-lingual Representation LearningCross-lingual Text ClassificationLong Short-term Memory NetworksNeural Language ModelsNeural Network ModelingWord Representation Learning
We study the problem of bilingual lexicon induction (BLI) in a setting where some translation resources are available, but unknown translations are sought for certain, possibly domain-specific terminology. We frame BLI as a classification problem for which we design a neural network based classification architecture composed of recurrent long short-term memory and deep feed forward networks. The results show that word-and character-level representations each improve state-of-the-art results for BLI, and the best results are obtained by exploiting the synergy between these wordand character-level representations in the classification model.
50
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov, Kai Chen, Greg S. Corrado et al. · arXiv (Cornell University) · 2013 · 11.7K citations · Full text