2010 · 26 citations · 20 references
ComputingComputer ScienceComputational LinguisticsCorpus LinguisticsNatural Language ProcessingComparable CorporaCorpus AnalysisLanguage ModelingMultilingual Natural Language ProcessingMultilingual ProcessingParallel CorporaCorpus CreationMultilingual Parallel CorporaParallel Corpus DesignParallel Corpus DevelopmentParallel Corpus MiningParallel Sentence ProcessingParallel Text CorporaPatent Corpus Mining
The paper provides an account on the augmentation of a Chinese-English patent parallel corpus consisting of about 160K sentence pairs, which has been enlarged by about 45 times to more than 7 million sentence pairs mostly by the means of “harvesting” comparable patents from the Web. First, based on a large corpus of English-Chinese comparable patents, more than 22 million bilingual sentence pair candidates have been mined, of which we extract more than 7 million high-quality parallel sentences, which to our best knowledge is the largest parallel sentence corpus in the patent domain. Based on 1 million parallel sentences extracted from the abstract and claims sections, some interesting preliminary SMT results are also reported here. Last by not least, the method and approach proposed here should be applicable to other languages, which shows a novel way on how to reduce the data acquisition bottleneck in multilingual language processing.
20
Philipp Koehn, Richard Zens, Chris Dyer et al. · 2007 · 4.9K citations · Full text
A Systematic Comparison of Various Statistical Alignment Models
Franz Josef Och, Hermann Ney · Computational Linguistics · 2003 · 3.9K citations · Full text