2018 · 26 citations · 11 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingText AnalyticsDeep LearningLanguage ModelingLanguage ModelsN-gram AnalysisText ClusteringWord EmbeddingsClusteringDynamic Word EmbeddingsEfficiencyN-gram Representation
In this paper we discuss the performance of three-word embedding methods on Bangla corpus. Word embedding is a big part of natural language processing related research works. Many research works have focused on finding appropriate methods of word clustering process. Previously N-gram models were used for this purpose but now with the improvement of deep learning methods, dynamic word clustering models are preferred because they reduce processing time and improve memory efficiency. In this paper we discuss the performance of three word embedding models namely, word2vec in Tensorflow, word2vec from Gensim package and FastText model. We use same dataset on all the model and analyze the outcomes. These three models are applied on a Bangla dataset containing 5,21,391 unique words to produce the clusters and we evaluate their performance in terms of accuracy and efficiency.
11
Using Word2Vec to process big text data
Long Ma, Yanqing Zhang · 2015 · 225 citations
Robert Bamler, Stephan Mandt · arXiv (Cornell University) · 2017 · 111 citations · Full text