IEEE/ACM Transactions on Audio Speech and Language Processing · 2016 · 294 citations · 47 references
ComputingComputational EngineeringAcousticsComputational AcousticsMachine LearningAcoustic Source ModelingAuditory Scene AnalysisDeep LearningSpeech RecognitionExpectation-maximizationExpectation-maximization AlgorithmMultichannel Speech EnhancementSound Source SeparationSpeech EnhancementSpeech Enhancement AlgorithmsSpeech Signal EnhancementWiener Filtering
This article addresses the problem of multichannel audio source separation. We propose a framework where deep neural networks (DNNs) are used to model the source spectra and combined with the classical multichannel Gaussian model to exploit the spatial information. The parameters are estimated in an iterative expectation-maximization (EM) fashion and used to derive a multichannel Wiener filter. We present an extensive experimental study to show the impact of different design choices on the performance of the proposed technique. We consider different cost functions for the training of DNNs, namely the probabilistically motivated Itakura-Saito divergence, and also Kullback-Leibler, Cauchy, mean squared error, and phase-sensitive cost functions. We also study the number of EM iterations and the use of multiple DNNs, where each DNN aims to improve the spectra estimated by the preceding EM iteration. Finally, we present its application to a speech enhancement problem. The experimental results show the benefit of the proposed multichannel approach over a single-channel DNN-based approach and the conventional multichannel nonnegative matrix factorization-based iterative EM algorithm.
47
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2015 · 18.8K citations
ADADELTA: An Adaptive Learning Rate Method
Matthew D. Zeiler · arXiv (Cornell University) · 2012 · 5.5K citations · Full text
Recurrent neural network based language model
Tomáš Mikolov, Martin Karafiát, Lukáš Burget et al. · 2010 · 5.4K citations
Kaldi Speech Recognition Toolkit
Daniel Povey · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · 2024 · 4.9K citations · Full text
Computing, Linguistics, Acoustics +15