2018 · 10 citations · 8 references
ComputingLinguisticsAcousticsComputational AcousticsMachine LearningDeep LearningGenerative ModelingSpeech AcousticsSpeech SynthesisDeep Neural Network Acoustic ModelsGated Recurrent Unit NetworksRecurrent Neural Networks
In this paper, we propose a variational recurrent neural network (VRNN) based method for modeling and generating speech parameter sequences. In recent years. the performance of speech synthesis systems has been improved over conventional techniques thanks to deep learning-based acoustic models. Among the popular deep learning techniques, recurrent neural networks (RNNs) has been successful in modeling time-dependent sequential data efficiently. However, due to the deterministic nature of RNNs prediction, such models do not reflect the full complexity of highly structured data, like natural speech. In this regard, we propose adversarially trained variational recurrent neural network (AdVRNN) which use VRNN to better represent the variability of natural speech for acoustic modeling in speech synthesis. Also, we apply adversarial learning scheme in training AdVRNN to overcome oversmoothing problem. We conducted comparative experiments for the proposed VRNN with the conventional gated recurrent unit which is one of RNNs, for speech synthesis system. It is shown that the proposed AdVRNN based method performed better than the conventional GRU technique.
8
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
Jun‐Young Chung, Çağlar Gülçehre, Kyunghyun Cho et al. · arXiv (Cornell University) · 2014 · 10.8K citations · Full text
A Recurrent Latent Variable Model for Sequential Data
Jun‐Young Chung, Kyle Kastner, Laurent Dinh et al. · arXiv (Cornell University) · 2015 · 705 citations · Full text