International Conference on Computational Linguistics · 2016 · 68 citations · 25 references
Graph Representation LearningMachine LearningEngineeringGraph DatabaseSemantic WebRepresentation LearningNatural Language ProcessingKnowledge EmbeddingKnowledge Graph EmbeddingsInformation RetrievalData ScienceData MiningEmbeddingsSpatial Knowledge GraphsKnowledge RepresentationProjects TriplesKnowledge DiscoveryComputer ScienceKnowledge GraphsSemantic NetworkKnowledge BaseGraph TheoryBusinessDomain Knowledge ModelingGraph Neural NetworkSemantic Graph
Knowledge embedding maps triples from a knowledge base into vector space, yet prior methods treat each triple independently, ignoring the inherent interconnections among triples. This work introduces GAKE, a graph‑aware knowledge embedding that learns vertex and edge representations by exploiting the directed graph structure of the knowledge base. GAKE incorporates neighbor, path, and edge contexts and an attention mechanism to capture structural information, and is evaluated on two benchmark tasks. Experiments show GAKE outperforms multiple state‑of‑the‑art knowledge embedding models.
Knowledge embedding, which projects triples in a given knowledge base to d-dimensional vectors, has attracted considerable research efforts recently. Most existing approaches treat the given knowledge base as a set of triplets, each of whose representation is then learned separately. However, as a fact, triples are connected and depend on each other. In this paper, we propose a graph aware knowledge embedding method (GAKE), which formulates knowledge base as a directed graph, and learns representations for any vertices or edges by leveraging the graph’s structural information. We introduce three types of graph context for embedding: neighbor context, path context, and edge context, each reflects properties of knowledge from different perspectives. We also design an attention mechanism to learn representative power of different vertices or edges. To validate our method, we conduct several experiments on two tasks. Experimental results suggest that our method outperforms several state-of-art knowledge embedding models.
25
Distributed Representations of Words and Phrases and their Compositionality
Tomáš Mikolov, Ilya Sutskever, Kai Chen et al. · arXiv (Cornell University) · 2013 · 18.1K citations · Full text
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
Kelvin Xu, Jimmy Ba, Ryan Kiros et al. · arXiv (Cornell University) · 2015 · 7.5K citations · Full text
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier · 2015 · 5.2K citations · Full text
Kurt Bollacker, Colin Evans, Praveen Paritosh et al. · 2008 · 4.9K citations
Metaweb Query Language, Engineering, Information Retrieval +15