2018 · 27 citations · 15 references
ComputingPerforming ArtsComputer VisionGenerative DesignImprovisationDeep LearningGenerative ArchitectureGenerative ModelingSound SynthesisSpeech SynthesisFramesGenerative Adversarial NetworksLatent LearningNeural Sequence ModelsSequence GenerationSpatial Correlation StructureSpatial Cross-correlationVideo Generation
A semi-recurrent hybrid VAE-GAN model for generating sequential data is introduced. In order to consider the spatial correlation of the data in each frame of the generated sequence, CNNs are utilized in the encoder, generator, and discriminator. The subsequent frames are sampled from the latent distributions obtained by encoding the previous frames. As a result, the dependencies between the frames are maintained. Two testing frameworks for synthesizing a sequence with any number of frames are also proposed. The promising experimental results on piano music generation indicates the potential of the proposed framework in modelling other sequential data such as video.
15
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
WaveNet: A Generative Model for Raw Audio
Aäron van den Oord, Sander Dieleman, Heiga Zen et al. · arXiv (Cornell University) · 2016 · 3.6K citations · Full text
Computing, Musicology, Acoustics +16