Edinburgh Research Explorer (University of Edinburgh) · 2012 · 18 citations · 5 references
Open access
ComputingComputer ScienceNatural Language ProcessingLanguage ModelingMachine TranslationAutomated Translation EvaluationHuman Evaluation Of Machine TranslationHuman-machine Translation InteractionMachine Translation Quality EvaluationTranslation Assessment ModelsTranslation Judgement
We present a Monte Carlo model to simulate human judgments in machine translation evaluation campaigns, such as WMT or IWSLT. We use the model to compare different ranking methods and to give guidance on the number of judgments that need to be collected to obtain sufficiently significant distinctions between systems
5
Example selection for bootstrapping statistical parsers
Mark Steedman, Rebecca Hwa, Stephen Clark et al. · 2003 · 400 citations · Full text
A Grain of Salt for the WMT Manual Evaluation
Ondřej Bojar, Miloš Ercegovċević, Martin Popel et al. · 2011 · 50 citations