2009 · 122 citations · 18 references
ComputingComputer ScienceTranslation StudiesComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningLanguage ModelingLanguage ModelsMachine TranslationWord EmbeddingsBelief NetworksDeep Belief NetworksMachine TransliterationNeural Language ModelsTransliteration Systems
In this paper we present a novel transliteration technique which is based on deep belief networks. Common approaches use finite state machines or other methods similar to conventional machine translation. Instead of using conventional NLP techniques, the approach presented here builds on deep belief networks, a technique which was shown to work well for other machine learning problems. We show that deep belief networks have certain properties which are very interesting for transliteration and possibly also for translation and that a combination with conventional techniques leads to an improvement over both components on an Arabic-English transliteration task.
18
A Fast Learning Algorithm for Deep Belief Nets
Geoffrey E. Hinton, Simon Osindero, Yee‐Whye Teh · Neural Computation · 2006 · 16.4K citations
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations