Interspeech 2022 · 2022 · 48 citations · 21 references
ComputingAudiologyAcousticsComputational AcousticsMachine LearningDeep LearningDigital Signal ProcessingSignal ProcessingConvolutionFailure ModesSampling RatesShort-time Fourier TransformSpectral Feature ExtractionSuper-resolutionSuper-resolution Processing
Conventionally, audio super-resolution models fixed the initial and the target sampling rates, which necessitate the model to be trained for each pair of sampling rates. We introduce NU-Wave 2, a diffusion model for neural audio upsampling that enables the generation of 48 kHz audio signals from inputs of various sampling rates with a single model. Based on the architecture of NU-Wave, NU-Wave 2 uses short-time Fourier convolution (STFC) to generate harmonics to resolve the main failure modes of NU-Wave, and incorporates bandwidth spectral feature transform (BSFT) to condition the bandwidths of inputs in the frequency domain. We experimentally demonstrate that NU-Wave 2 produces high-resolution audio regardless of the sampling rate of input while requiring fewer parameters than other models. The official code and the audio samples are available at https://mindslab-ai.github.io/nuwave2.
21
Adam: A Method for Stochastic Optimization
Diederik P. Kingma, Jimmy Ba · UvA-DARE (University of Amsterdam) · 2014 · 84.8K citations · Full text
Denoising Diffusion Probabilistic Models
arXiv (Cornell University) · 2020 · 5.6K citations · Full text
Semantic Image Synthesis With Spatially-Adaptive Normalization
Taesung Park, Ming-Yu Liu, Ting-Chun Wang et al. · 2019 · 2.8K citations
Image Super-Resolution Via Iterative Refinement
Chitwan Saharia, Jonathan Ho, William Chan et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2022 · 1.6K citations · Full text
Deep Unsupervised Learning using Nonequilibrium Thermodynamics
Jascha Sohl‐Dickstein, Eric A. Weiss, Niru Maheswaranathan et al. · arXiv (Cornell University) · 2015 · 1.4K citations · Full text
Computing, Computer Science, Physics +15