GAKE: Graph Aware Knowledge Embedding

Jun Feng, Minlie Huang, Yang Yang, Xiaoyan Zhu

International Conference on Computational Linguistics · 2016 · 68 citations · 25 references

Concepts

TL;DR

Knowledge embedding maps triples from a knowledge base into vector space, yet prior methods treat each triple independently, ignoring the inherent interconnections among triples. This work introduces GAKE, a graph‑aware knowledge embedding that learns vertex and edge representations by exploiting the directed graph structure of the knowledge base. GAKE incorporates neighbor, path, and edge contexts and an attention mechanism to capture structural information, and is evaluated on two benchmark tasks. Experiments show GAKE outperforms multiple state‑of‑the‑art knowledge embedding models.

Abstract

Knowledge embedding, which projects triples in a given knowledge base to d-dimensional vectors, has attracted considerable research efforts recently. Most existing approaches treat the given knowledge base as a set of triplets, each of whose representation is then learned separately. However, as a fact, triples are connected and depend on each other. In this paper, we propose a graph aware knowledge embedding method (GAKE), which formulates knowledge base as a directed graph, and learns representations for any vertices or edges by leveraging the graph’s structural information. We introduce three types of graph context for embedding: neighbor context, path context, and edge context, each reflects properties of knowledge from different perspectives. We also design an attention mechanism to learn representative power of different vertices or edges. To validate our method, we conduct several experiments on two tasks. Experimental results suggest that our method outperforms several state-of-art knowledge embedding models.

References

25