arXiv (Cornell University) · 2019 · 16 citations · 31 references
HumanitiesMusicologyMachine LearningMusic AnalysisVocal PerformanceGenerative ModelingSpeech SynthesisVocal MusicVoice GenerationGenerative Adversarial NetworksNeural Speech SynthesisScore-based Generative ModelsText-to-speech Synthesis
Generative models for singing voice have been mostly concerned with the task of ``singing voice synthesis,'' i.e., to produce singing voice waveforms given musical scores and text lyrics. In this work, we explore a novel yet challenging alternative: singing voice generation without pre-assigned scores and lyrics, in both training and inference time. In particular, we outline three such generation schemes, and propose a pipeline to tackle these new tasks. Moreover, we implement such models using generative adversarial networks and evaluate them both objectively and subjectively.
31
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Conditional Generative Adversarial Nets
Mehdi Mirza, Simon Osindero · arXiv (Cornell University) · 2014 · 8.9K citations · Full text
Least Squares Generative Adversarial Networks
Xudong Mao, Qing Li, Haoran Xie et al. · 2017 · 5.2K citations
librosa: Audio and Music Signal Analysis in Python
Brian McFee, Colin Raffel, Dawen Liang et al. · Proceedings of the Python in Science Conferences · 2015 · 2.9K citations · Full text