Energy-based Generative Adversarial Network

Junbo Zhao, Michaël Mathieu, Yann LeCun

arXiv (Cornell University) · 2016 · 895 citations · 19 references

DOIFull text

Open access

Concepts

TL;DR

Similar to probabilistic GANs, the generator produces contrastive samples with minimal energies while the discriminator assigns high energies to these samples. The authors introduce the Energy‑based Generative Adversarial Network (EBGAN), which treats the discriminator as an energy function assigning low energies near the data manifold and higher energies elsewhere. By modeling the discriminator as an energy function, the framework supports diverse architectures and loss functions; the authors instantiate it with an auto‑encoder whose reconstruction error serves as the energy. EBGAN demonstrates more stable training than conventional GANs and enables a single‑scale architecture to generate high‑resolution images.

Abstract

We introduce the "Energy-based Generative Adversarial Network" model (EBGAN) which views the discriminator as an energy function that attributes low energies to the regions near the data manifold and higher energies to other regions. Similar to the probabilistic GANs, a generator is seen as being trained to produce contrastive samples with minimal energies, while the discriminator is trained to assign high energies to these generated samples. Viewing the discriminator as an energy function allows to use a wide variety of architectures and loss functionals in addition to the usual binary classifier with logistic output. Among them, we show one instantiation of EBGAN framework as using an auto-encoder architecture, with the energy being the reconstruction error, in place of the discriminator. We show that this form of EBGAN exhibits more stable behavior than regular GANs during training. We also show that a single-scale architecture can be trained to generate high-resolution images.

References

19