IEEE Journal of Selected Topics in Signal Processing · 2019 · 27 citations · 39 references
ComputingComputer ScienceAcousticsComputer VisionMachine LearningDeep LearningPattern RecognitionSignal ProcessingSpeech AcousticsSpeech RecognitionAccuracyAcoustic EnvironmentsAudio SystemsDeep Neural Network Acoustic ModelsEncoder-decoder ArchitecturesNon-speech InformationSpectral FeaturesSpeech Activity Detection
We address voice activity detection in acoustic environments of transients and stationary noises, which often occur in real-life scenarios. We exploit unique spatial patterns of speech and non-speech audio frames by independently learning their underlying geometric structure. This process is done through a deep encoder-decoder-based neural network architecture. This structure involves an encoder that maps spectral features with temporal information to their low-dimensional representations, which are generated by applying the diffusion maps method. The encoder feeds a decoder that maps the embedded data back into the high-dimensional space. A deep neural network, which is trained to separate speech from non-speech frames, is obtained by concatenating the decoder to the encoder, resembling the known diffusion nets architecture. Experimental results show enhanced performance compared to competing voice activity detection methods. The improvement is achieved in both accuracy, robustness, and generalization ability. Our model performs in a real-time manner and can be integrated into audio-based communication systems. We also present a batch algorithm that obtains an even higher accuracy for offline applications.
39
Dropout: a simple way to prevent neural networks from overfitting
Nitish Srivastava, Geoffrey E. Hinton, Alex Krizhevsky et al. · 2014 · 34.3K citations
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Ronald R. Coifman, Stéphane Lafon · Applied and Computational Harmonic Analysis · 2006 · 2.3K citations
Self-Tuning Spectral Clustering
Lihi Zelnik‐Manor, Pietro Perona · CaltechAUTHORS (California Institute of Technology) · 2004 · 1.9K citations · Full text