2007 · 23 citations · 11 references
Language StudiesComputer ScienceLinguisticsComputational LinguisticsCorpus LinguisticsNatural Language ProcessingComparable CorporaComparable Corpus AnalysisComparative Corpus AnalysisInformation ExtractionLanguage ModelingSyntactic AnalysisComparable Corpus MiningDiachronic Comparable CorporaJoint Probability AnalysisMonolingual Comparable CorporaPhrase SimilarityTextual AlignmentWord Alignment
We propose a method of extracting phrasal alignments from comparable corpora by using an extended phrase-based joint probability model for statistical machine translation (SMT). Our method does not require preexisting dictionaries or splitting documents into sentences in advance. By checking each alignment for its reliability by using log-likelihood ratio statistics while searching for optimal alignments, our method aims to produce phrasal alignments for only parallel parts of the comparable corpora. Experimental result shows that our method achieves about 0.8 in precision of phrasal alignment extraction when using 2,000 Japanese-English document pairs as training data. 1
11