arXiv (Cornell University) · 2021 · 53 citations · 28 references
Fast Sampling MethodsEngineeringMachine LearningData ScienceDensity EstimationDiffusion ProcessSampling TheorySampling TechniqueSampling (Statistics)Statistical InferenceProbability TheoryComputer ScienceMarkov Chain Monte CarloDiffusion-based ModelingStatisticsFast SamplingSample Quality
In this work, we propose FastDPM, a unified framework for fast sampling in diffusion probabilistic models. FastDPM generalizes previous methods and gives rise to new algorithms with improved sample quality. We systematically investigate the fast sampling methods under this framework across different domains, on different datasets, and with different amount of conditional information provided for generation. We find the performance of a particular method depends on data domains (e.g., image or audio), the trade-off between sampling speed and sample quality, and the amount of conditional information. We further provide insights and recipes on the choice of methods for practitioners.
28
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.2K citations
Convolutional Neural Network, Engineering, Machine Learning +17
Deep Learning Face Attributes in the Wild
Ziwei Liu, Ping Luo, Xiaogang Wang et al. · 2015 · 7.5K citations
Face Detection, Convolutional Neural Network, Facial Recognition System +15
Denoising Diffusion Probabilistic Models
arXiv (Cornell University) · 2020 · 5.6K citations · Full text
GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner et al. · arXiv (Cornell University) · 2017 · 4.5K citations · Full text
Diffusion Models Beat GANs on Image Synthesis
Prafulla Dhariwal, Alex Nichol · arXiv (Cornell University) · 2021 · 2.2K citations · Full text