2017 · 24 citations · 23 references
ComputingComputer ScienceComputational LinguisticsNatural Language ProcessingText AnalyticsLanguage ModelingNatural Language UnderstandingText GenerationText RepresentationText SummarizationWord EmbeddingsEmbedding LearningParaphrase GenerationParaphrase RecognitionSemantic InformationSummarizationText Vectorization
This paper introduces a sentence to vector encoding framework suitable for advanced natural language processing. Our latent representation is shown to encode sentences with common semantic information with similar vector representations. The vector representation is extracted from an encoderdecoder model which is trained on sentence paraphrase pairs. We demonstrate the application of the sentence representations for two different tasks - sentence paraphrasing and paragraph summarization, making it attractive for commonly used recurrent frameworks that process text. Experimental results help gain insight how vector representations are suitable for advanced language embedding.
23
Laurens van der Maaten, Geoffrey E. Hinton · Journal of Machine Learning Research · 2008 · 35.7K citations
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Sequence to Sequence Learning with Neural Networks
Ilya Sutskever, Oriol Vinyals, Quoc V. Le · arXiv (Cornell University) · 2014 · 13.4K citations · Full text
Computing, Computer Science, French +14