arXiv (Cornell University) · 2019 · 38 citations · 44 references
ComputingComputer ScienceKnowledge RepresentationMachine LearningRepresentation TheoryDeep LearningGraph AlgorithmsGraph AnalyticsGraph TheoryGraph-based LearningGraphical RepresentationConvolutional Neural NetworksGraph ClassificationGraph Convolutional NetworksGraph LaplacianGraph Neural NetworksGraph PoolingGraph Representation LearningRecurrent Neural Networks
This work generalizes graph neural networks (GNNs) beyond those based on the Weisfeiler-Lehman (WL) algorithm, graph Laplacians, and diffusions. Our approach, denoted Relational Pooling (RP), draws from the theory of finite partial exchangeability to provide a framework with maximal representation power for graphs. RP can work with existing graph representation models and, somewhat counterintuitively, can make them even more powerful than the original WL isomorphism test. Additionally, RP allows architectures like Recurrent Neural Networks and Convolutional Neural Networks to be used in a theoretically sound approach for graph classification. We demonstrate improved performance of RP-based graph representations over state-of-the-art methods on a number of tasks.
44
Sepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 98.1K citations
Backpropagation Applied to Handwritten Zip Code Recognition
Yann LeCun, Bernhard E. Boser, J. S. Denker et al. · Neural Computation · 1989 · 11.9K citations
A Stochastic Approximation Method
Herbert Robbins, Sutton Monro · The Annals of Mathematical Statistics · 1951 · 9.6K citations · Full text