arXiv (Cornell University) · 2017 · 26 citations · 152 references
ComputingComputer ScienceMachine LearningStatistical ModelingStochastic ModelingBayesian ComputationBayesian InferenceBayesian StatisticsProbabilistic Machine LearningStatistical InferenceVariational InferenceAmortized Variational InferenceApproximate Bayesian InferenceInference NetworksMean-field ApproximationMean-field Variational InferenceVariational BayesVariational Bayesian InferenceVariational Posterior Approximation
Many modern unsupervised or semi-supervised machine learning algorithms rely on Bayesian probabilistic models. These models are usually intractable and thus require approximate inference. Variational inference (VI) lets us approximate a high-dimensional Bayesian posterior with a simpler variational distribution by solving an optimization problem. This approach has been successfully used in various models and large-scale applications. In this review, we give an overview of recent trends in variational inference. We first introduce standard mean field variational inference, then review recent advances focusing on the following aspects: (a) scalable VI, which includes stochastic approximations, (b) generic VI, which extends the applicability of VI to a large class of otherwise intractable models, such as non-conjugate models, (c) accurate VI, which includes variational models beyond the mean field approximation or with atypical divergences, and (d) amortized VI, which implements the inference over local latent variables with inference networks. Finally, we provide a summary of promising future research directions.
152
Reinforcement Learning: An Introduction
IEEE Transactions on Neural Networks · 2005 · 25.8K citations
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text