2019 · 12 citations · 5 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingArtificial Intelligence In Language LearningDeep LearningLanguage ModelingPattern RecognitionRepresentation LearningAutomatic DiacritizationConvolutional Neural NetworksDiacritic MarkingDiacritics RemovalDiacritics RepresentationNeural Language ModelsNeural Text RepresentationSemantic Information
In this paper we address the issue of automatic diacritics restoration (ADR) for Romanian using deep learning strategies.We compare 6 separate architectures with various mixtures of recurrent and convolutional layers. The input consists in sequences of consecutive words stripped of their diacritic symbols. The network's task is to learn to restore the diacritics for the entire sequence. No additional linguistic or semantic information is used as input to the networks.The best results were obtained with a CNN-based architecture and achieved an accuracy of 97% at word level. At diacritic-level the accuracy of the same architecture is 89%.
5
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14
Letter level learning for language independent diacritics restoration
Rada Mihalcea, Vivi Năstase · 2002 · 35 citations · Full text
Diacritics Restoration Using Neural Networks
Jakub Náplava, Milan Straka, Pavel Straňák et al. · 2018 · 26 citations · Full text
Automatic Insertion of Accents in French Text
Michel Simard · 1998 · 25 citations