TUbilio (Technical University of Darmstadt) · 2018 · 74 citations · 17 references
ComputingComputer ScienceComputational LinguisticsCorpus LinguisticsNatural Language ProcessingLanguage ModelingMachine TranslationMultilingual Natural Language ProcessingMultilingual ProcessingMultilingualismWord EmbeddingsCross-lingual Representation LearningCross-lingual Word EmbeddingsMonolingual Corpora
Average word embeddings are a common baseline for more sophisticated sentence embedding techniques. However, they typically fall short of the performances of more complex models such as InferSent. Here, we generalize the concept of average word embeddings to power mean word embeddings. We show that the concatenation of different types of power mean word embeddings considerably closes the gap to state-of-the-art methods monolingually and substantially outperforms these more complex techniques cross-lingually. In addition, our proposed method outperforms different recently proposed baselines such as SIF and Sent2Vec by a solid margin, thus constituting a much harder-to-beat monolingual baseline. Our data and code are publicly available.
17
A unified architecture for natural language processing
Ronan Collobert, Jason Weston · 2008 · 5.2K citations
A large annotated corpus for learning natural language inference
Samuel R. Bowman, Gabor Angeli, Christopher Potts et al. · 2015 · 3.5K citations · Full text