2019 · 25 citations · 40 references
ComputingComputer ScienceComputational LinguisticsKnowledge RepresentationNatural Language ProcessingKnowledge GraphsMachine TranslationKnowledge Graph EmbeddingsNeural Machine TranslationOut-of-vocabulary Word HandlingParallel Text CorporaSemantic Feature KnowledgeSemantic Feature ModelingSemantic Relation ExtractionSemantic Relations Extraction
While neural networks have led to substantial progress in machine translation, their success depends heavily on large amounts of training data. However, parallel training corpora are not always readily available. Moreover, out-of-vocabulary words---mostly entities and terminological expressions---pose a difficult challenge to Neural Machine Translation systems. Recent efforts have tried to alleviate the data sparsity problem by augmenting the training data using different strategies, such as external knowledge injection. In this paper, we hypothesize that knowledge graphs enhance the semantic feature extraction of neural models, thus optimizing the translation of entities and terminological expressions in texts and consequently leading to better translation quality. We investigate two different strategies for incorporating knowledge graphs into neural models without modifying the neural network architectures. Additionally, we examine the effectiveness of our augmented models on domain-specific texts and ontologies. Our knowledge-graph-augmented neural translation model, dubbed KG-NMT, achieves significant and consistent improvements of +3 BLEU, METEOR and chrF3 on average on the newstest datasets between 2015 and 2018 for the WMT English-German translation task.
40
Kishore Papineni, Salim Roukos, Todd J. Ward et al. · 2001 · 21.5K citations · Full text
LIBLINEAR: A Library for Large Linear Classification
Rong-En Fan, Kai‐Wei Chang, Cho‐Jui Hsieh et al. · 2008 · 6.6K citations
Ashish Vaswani, Noam Shazeer, Niki Parmar et al. · 2025 · 6.6K citations · Full text
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Jason Weston et al. · 2015 · 5.2K citations · Full text