2015 · 127 citations · 9 references
Language StudiesLinguisticsAcousticsFeature EngineeringPhoneticsSpeech AcousticsSpeech Intelligibility EnhancementSpeech RecognitionSpeech SynthesisVoice GenerationDeep Neural Network Acoustic ModelsNeural Speech SynthesisSpeaker AdaptationSpeaker-dependent Speech Analysis
In DNN-based TTS synthesis, DNNs hidden layers can be viewed as deep transformation for linguistic features and the output layers as representation of acoustic space to regress the transformed linguistic features to acoustic parameters. The deep-layered architectures of DNN can not only represent highly-complex transformation compactly, but also take advantage of huge amount of training data. In this paper, we propose an approach to model multiple speakers TTS with a general DNN, where the same hidden layers are shared among different speakers while the output layers are composed of speaker-dependent nodes explaining the target of each speaker. The experimental results show that our approach can significantly improve the quality of synthesized speech objectively and subjectively, comparing with speech synthesized from the individual, speaker-dependent DNN-based TTS. We further transfer the hidden layers for a new speaker with limited training data and the resultant synthesized speech of the new speaker can also achieve a good quality in term of naturalness and speaker similarity.
9
Sinno Jialin Pan, Qiang Yang · IEEE Transactions on Knowledge and Data Engineering · 2009 · 23.2K citations
Statistical parametric speech synthesis using deep neural networks
Heiga Zen, Andrew Senior, Mike Schuster · 2013 · 831 citations