2012 · 40 citations · 32 references
ComputingComputer ScienceComputational LinguisticsData StructuresNatural Language ProcessingInformation ExtractionLanguage ModelingLanguage ModelsMachine TranslationDomain AdaptationForced AlignmentHierarchical Phrase StructureInterpolation Parameter OptimizationPhrase-based Machine TranslationPruningRule-based Machine TranslationStatistical Machine Translation
We present Jane 2, an open source toolkit supporting both the phrase-based and the hierarchical phrase-based paradigm for statistical machine translation. It is implemented in C++ and provides efficient decoding algorithms and data structures. This work focuses on the description of its phrase-based functionality. In addition to the standard pipeline, including phrase extraction and parameter optimization, Jane 2 contains several state-of-the-art extensions and tools. Forced alignment phrase training can considerably reduce rule table size while learning the translation scores in a more principled manner. Word class language models can be used to integrate longer context with a reduced vocabulary size. Rule table interpolation is applicable for different tasks, e.g. domain adaptation. The decoder distinguishes between lexical and coverage pruning and applies reordering constraints for efficiency.
32
A Simplex Method for Function Minimization
J. A. Nelder, R. Mead · The Computer Journal · 1965 · 28.9K citations
Philipp Koehn, Richard Zens, Chris Dyer et al. · 2007 · 4.9K citations · Full text
Statistical phrase-based translation
Philipp Koehn, Franz Josef Och, Daniel Marcu · 2003 · 3.3K citations · Full text
Hierarchical Phrase-Based Translation
David Chiang · Computational Linguistics · 2007 · 1.2K citations · Full text