Neural Networks · 2024 · 13 citations · 47 references
ComputingComputer ScienceKnowledge RepresentationMachine LearningNatural Language ProcessingDeep LearningGraph AnalyticsGraph MiningGraph-based LearningKnowledge GraphsContrastive LearningContrastive LossData AugmentationGraph Attention NetworksGraph Contrastive LearningGraph EmbeddingsGraph Representation LearningLow-dimensional Embeddings
Multi-relational graph learning aims to embed entities and relations in knowledge graphs into low-dimensional representations, which has been successfully applied to various multi-relationship prediction tasks, such as information retrieval, question answering, and etc. Recently, contrastive learning has shown remarkable performance in multi-relational graph learning by data augmentation mechanisms to deal with highly sparse data. In this paper, we present a Multi-Relational Graph Contrastive Learning architecture (MRGCL) for multi-relational graph learning. More specifically, our MRGCL first proposes a Multi-relational Graph Hierarchical Attention Networks (MGHAN) to identify the importance between entities, which can learn the importance at different levels between entities for extracting the local graph dependency. Then, two graph augmented views with adaptive topology are automatically learned by the variant MGHAN, which can automatically adapt for different multi-relational graph datasets from diverse domains. Moreover, a subgraph contrastive loss is designed, which generates positives per anchor by calculating strongly connected subgraph embeddings of the anchor as the supervised signals. Comprehensive experiments on multi-relational datasets from three application domains indicate the superiority of our MRGCL over various state-of-the-art methods. Our datasets and source code are published at https://github.com/Legendary-L/MRGCL.
47
Birds of a Feather: Homophily in Social Networks
Miller McPherson, Lynn Smith‐Lovin, James M. Cook · Annual Review of Sociology · 2001 · 18.6K citations
Translating embeddings for modeling multi-relational data
Antoine Bordes, Nicolas Usunier, Jason Weston et al. · 2015 · 5.2K citations · Full text
Heterogeneous Graph Attention Network
Xiao Wang, Houye Ji, Chuan Shi et al. · 2019 · 2.9K citations · Full text