arXiv (Cornell University) · 2020 · 64 citations · 27 references
ComputingComputer ScienceBig Data AnalyticsComputer VisionMachine LearningDeep LearningGaussian Process ModelingGaussian ProcessesModel IntegrationNeural NetworksScalable Machine LearningDeep Gaussian ProcessesModular System IntegrationScalable Gaussian Processes
One obstacle to the use of Gaussian processes (GPs) in large-scale problems, and as a component in deep learning system, is the need for bespoke derivations and implementations for small variations in the model or inference. In order to improve the utility of GPs we need a modular system that allows rapid implementation and testing, as seen in the neural network community. We present a mathematical and software framework for scalable approximate inference in GPs, which combines interdomain approximations and multiple outputs. Our framework, implemented in GPflow, provides a unified interface for many existing multioutput models, as well as more recent convolutional structures. This simplifies the creation of deep models with GPs, and we hope that this work will encourage more interest in this approach.
27
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
Stochastic variational inference
Matthew D. Hoffman, David M. Blei, Chong Wang et al. · Journal of Machine Learning Research · 2013 · 1.5K citations
Expectation Propagation for approximate Bayesian inference
Thomas P. Minka · arXiv (Cornell University) · 2013 · 1.5K citations · Full text
Sparse Gaussian Processes using Pseudo-inputs
Edward Snelson, Zoubin Ghahramani · 2005 · 1.3K citations