Sensors · 2023 · 14 citations · 23 references
ComputingCommunicationMachine LearningPsychoacousticsStatistical LearningAudio RecordingSpeech RecognitionAudio Signal ProcessingMetricsResponse TimeSignal-to-noise RatioSpeech EnhancementSpeech Enhancement AlgorithmsSpeech Signal EnhancementVoice Communication Systems
Deep learning-based speech-enhancement techniques have recently been an area of growing interest, since their impressive performance can potentially benefit a wide variety of digital voice communication systems. However, such performance has been evaluated mostly in offline audio-processing scenarios (i.e., feeding the model, in one go, a complete audio recording, which may extend several seconds). It is of significant interest to evaluate and characterize the current state-of-the-art in applications that process audio online (i.e., feeding the model a sequence of segments of audio data, concatenating the results at the output end). Although evaluations and comparisons between speech-enhancement techniques have been carried out before, as far as the author knows, the work presented here is the first that evaluates the performance of such techniques in relation to their online applicability. This means that this work measures how the output signal-to-interference ratio (as a separation metric), the response time, and memory usage (as online metrics) are impacted by the input length (the size of audio segments), in addition to the amount of noise, amount and number of interferences, and amount of reverberation. Three popular models were evaluated, given their availability on public repositories and online viability, MetricGAN+, Spectral Feature Mapping with Mimic Loss, and Demucs-Denoiser. The characterization was carried out using a systematic evaluation protocol based on the Speechbrain framework. Several intuitions are presented and discussed, and some recommendations for future work are proposed.
23
Librispeech: An ASR corpus based on public domain audio books
Vassil Panayotov, Guoguo Chen, Daniel Povey et al. · 2015 · 6K citations
Computing, Computer Science, English +17
Generative Adversarial Networks: An Overview
Antonia Creswell, Tom White, Vincent Dumoulin et al. · IEEE Signal Processing Magazine · 2018 · 4.4K citations · Full text
A short-time objective intelligibility measure for time-frequency weighted noisy speech
Cees Taal, Richard C. Hendriks, Richard Heusdens et al. · 2010 · 1.1K citations