IEEE Signal Processing Letters · 2016 · 13 citations · 18 references
ComputingComputer ScienceMachine LearningNatural Language ProcessingTime Series AnalysisDeep LearningHigh-frequency Time Series AnalysisNeural NetworksSpeech AcousticsSpeech RecognitionTime-frequency AnalysisBandwidth ExtensionBandwidth Extension TechniquesFeedforward Neural NetworksGaussian Mixture ModelsNonlinear Feature MappingRestricted Boltzmann MachinesSpectral EnvelopeTemporal Correlation
In this paper, we present a new speech bandwidth extension method (BWE) using recurrent temporal restricted Boltzmann machine (RTRBM). The conventional Gaussian mixture model (GMM)-based and deep neural networks (DNNs)-based BWE methods perform stably and effectively. However, the mapping function of GMM-based methods is a piecewise linear transformation, which is insufficient to model the complex nonlinear mapping relationship between the spectral envelope features of low frequency (LF) and high frequency (HF). In the conventional DNNs methods, temporal correlations across speech frames are ignored, resulting in spectral detail loss of the reconstructed speech by BWE. To counter these issues, a multilayer DNN which is composed of two RTRBMs and a feedforward neural network (NN) is employed to obtain time information and model deep nonlinear relationships between the spectral envelope features of LF and HF. The proposed method takes advantage of the strong ability of RTRBM in discovering the temporal correlation in the high-order space and modeling deep nonlinear relationships between input and output. Both the objective and subjective evaluations indicate that our proposed method outperforms the conventional GMM-based methods and other NN-based methods.
18
The Recurrent Temporal Restricted Boltzmann Machine
Ilya Sutskever, Geoffrey E. Hinton, Graham W. Taylor · 2008 · 373 citations
A deep neural network approach to speech bandwidth expansion
Kehuang Li, Chin‐Hui Lee · 2015 · 135 citations