PROBLEMS IN PROGRAMMING · 2020 · 15 citations · 21 references
ComputingComputer ScienceLinguisticsComputational LinguisticsNatural Language ProcessingSemanticsLanguage ModelingLanguage ModelsLexical RelationsRelation ExtractionTerm ExtractionWord EmbeddingsAnnotated Text CorporaAutomatic Term ExtractionCorpus-based Term ExtractionDistributed Text RepresentationsSemantic Relation ExtractionSemantic Relations ExtractionVector Space ModelsWord Representation Learning
We design a new technique for the distributional semantic modeling with a neural network-based approach to learn distributed term representations (or term embeddings) – term vector space models as a result, inspired by the recent ontology-related approach (using different types of contextual knowledge such as syntactic knowledge, terminological knowledge, semantic knowledge, etc.) to the identification of terms (term extraction) and relations between them (relation extraction) called semantic pre-processing technology – SPT. Our method relies on automatic term extraction from the natural language texts and subsequent formation of the problem-oriented or application-oriented (also deeply annotated) text corpora where the fundamental entity is the term (includes non-compositional and compositional terms). This gives us an opportunity to changeover from distributed word representations (or word embeddings) to distributed term representations (or term embeddings). The main practical result of our work is the development kit (set of toolkits represented as web service APIs and web application), which provides all necessary routines for the basic linguistic pre-processing and the semantic pre-processing of the natural language texts in Ukrainian for future training of term vector space models.
21
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Efficient Estimation of Word Representations in Vector Space
Tomáš Mikolov, Kai Chen, Greg S. Corrado et al. · arXiv (Cornell University) · 2013 · 11.7K citations · Full text
Distributed Representations of Sentences and Documents
Quoc V. Le, Tomáš Mikolov · arXiv (Cornell University) · 2014 · 5.1K citations · Full text