2017 · 63 citations · 24 references
ComputingComputer ScienceKnowledge RepresentationNatural Language ProcessingTranslation TheoryLanguage ModelingMachine TranslationBayesian RegularizationLog-linear RegressionNeural Machine TranslationPrior Knowledge EstimationPrior Related KnowledgeRegularizationRegularization Techniques
Although neural machine translation has made significant progress recently, how to integrate multiple overlapping, arbitrary prior knowledge sources remains a challenge. In this work, we propose to use posterior regularization to provide a general framework for integrating prior knowledge into neural machine translation. We represent prior knowledge sources as features in a log-linear model, which guides the learning process of the neural translation model. Experiments on Chinese-English translation show that our approach leads to significant improvements.
24
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14