2019 · 11 citations · 12 references
ComputingArabicComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDeep LearningDialect ClassificationLanguage ClassificationLanguage ModelingLanguage ModelsDialect AnnotationHierarchical ClassificationHierarchical Representation LearningNaive BayesNaive Bayes ClassificationNeural Language ModelsRandom Forest ClassificationRecurrent Neural Networks
In this paper, we present two approaches for Arabic Fine-Grained Dialect Identification. The first approach is based on Recurrent Neural Networks (BLSTM, BGRU) using hierarchical classification. The main idea is to separate the classification process for a sentence from a given text in two stages. We start with a higher level of classification (8 classes) and then the finer-grained classification (26 classes). The second approach is given by a voting system based on Naive Bayes and Random Forest. Our system achieves an F 1 score of 63.02% on the subtask evaluation dataset.
12
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
HDLTex: Hierarchical Deep Learning for Text Classification
Kamran Kowsari, Donald E. Brown, Mojtaba Heidarysafa et al. · 2017 · 448 citations · Full text
The MADAR Arabic Dialect Corpus and Lexicon
Houda Bouamor, Nizar Habash, Mohammad Salameh et al. · 2018 · 156 citations · Full text
Morphological Analysis and Disambiguation for Dialectal Arabic
Nizar Habash, Ryan M. Roth, Owen Rambow et al. · 2013 · 125 citations