Meeting of the Association for Computational Linguistics · 2010 · 15 citations · 25 references
ComputingComputer ScienceTranslation StudiesComputational LinguisticsNatural Language ProcessingTranslation TheoryLanguage ModelingMachine TranslationMorphological SegmentationTranslation Quality AssessmentObjective Function FormulationParallelizationPhrase-based Machine TranslationSegmentationStatistical Machine TranslationTranslation Unit SegmentationUnsupervised Machine TranslationUnsupervised Morphological Segmentation
We tackle the previously unaddressed problem of unsupervised determination of the optimal morphological segmentation for statistical machine translation (SMT) and propose a segmentation metric that takes into account both sides of the SMT training corpus. We formulate the objective function as the posterior probability of the training corpus according to a generative segmentation-translation model. We describe how the IBM Model-1 translation likelihood can be computed incrementally between adjacent segmentation states for efficient computation. Submerging the proposed segmentation method in a SMT task from morphologically-rich Turkish to English does not exhibit the expected improvement in translation BLEU scores and confirms the robustness of phrase-based SMT to translation unit combinatorics. A positive outcome of this work is the described modification to the sequential search algorithm of Morfessor (Creutz and Lagus, 2007) that enables arbitrary-fold parallelization of the computation, which unexpectedly improves the translation performance as measured by BLEU.
25
Kishore Papineni, Salim Roukos, Todd J. Ward et al. · 2001 · 21.5K citations · Full text
Philipp Koehn, Richard Zens, Chris Dyer et al. · 2007 · 4.9K citations · Full text
SRILM - an extensible language modeling toolkit
Andreas Stolcke · 2002 · 4.4K citations
A Systematic Comparison of Various Statistical Alignment Models
Franz Josef Och, Hermann Ney · Computational Linguistics · 2003 · 3.9K citations · Full text