2016 · 40 citations · 26 references
ComputingComputer ScienceComputational LinguisticsMachine LearningNatural Language ProcessingDocument ClusteringLanguage ModelsSupport Vector MachinesText ClusteringText MiningWord EmbeddingsContextual EmbeddingsContextual Word EmbeddingsDocument ClassificationK-means ClusteringNeural Language ModelsSupport Vector ClassificationSupport Vector Machine ClassificationWord Representation Learning
In this paper, we present Bengali word embeddings and it's application in the classification of news documents. Word embeddings are multi-dimensional vectors that can be created by exploiting the linguistic context of the words in large corpus. To generate the embeddings, we collected Bengali news document of last five years from the major daily newspapers. Word embeddings are generated using the Neural Network based language processing model Word2vec. We use the vector representations of the Bengali words to cluster them using K-means algorithm. We show that those clusters can be used directly to perform various natural language processing task by solving the problem of Bengali news document classification. We use the Support Vector Machine (SVM) for the classification task and achieve ∼91% F1-score. The accuracy of our method demonstrates that our word embeddings could capture the semantics of word from the respective context correctly.
26
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Data clustering: 50 years beyond K-means
Anil K. Jain · Pattern Recognition Letters · 2009 · 9.2K citations
Natural Language Processing (almost) from Scratch
Ronan Collobert, Jason Weston, Léon Bottou et al. · arXiv (Cornell University) · 2011 · 5.2K citations · Full text