International Journal of Advanced Computer Science and Applications · 2016 · 12 citations · 12 references
ComputingComputer ScienceComputational LinguisticsCorpus-based Translation StudiesNatural Language ProcessingLanguage ModelingLanguage ModelsMachine TranslationAccuracyAutomated Text ClassificationHidden Markov Model TrainingSegmentationStatistical Machine TranslationText ClassificationViterbi AlgorithmViterbi Decoding
The statistical machine translation approach is highly popular in automatic translation research area and promising approach to yield good accuracy. Efforts have been made to develop Urdu to Punjabi statistical machine translation system. The system is based on an incremental training approach to train the statistical model. In place of the parallel sentences corpus has manually mapped phrases which were used to train the model. In preprocessing phase, various rules were used for tokenization and segmentation processes. Along with these rules, text classification system was implemented to classify input text to predefined classes and decoder translates given text according to selected domain by the text classifier. The system used Hidden Markov Model(HMM) for the learning process and Viterbi algorithm has been used for decoding. Experiment and evaluation have shown that simple statistical model like HMM yields good accuracy for a closely related language pair like Urdu-Punjabi. The system has achieved 0.86 BLEU score and in manual testing and got more than 85% accuracy.
12
World Academy of Science, Engineering and Technology 62 2010
Mohammad Moghiman, Mohammad Javadi, امیر رضا مقیمان et al. · 2010 · 3.8K citations
Engineering, Industrial Engineering, Production Engineering +3
Thorsten Brants · 2000 · 1.3K citations · Full text
TnT - A Statistical Part-of-Speech Tagger
Thorsten Brants · ArXiv.org · 2000 · 326 citations · Full text