Entropy · 2023 · 10 citations · 33 references
ComputingComputer ScienceAcousticsFeature EngineeringMachine LearningDeep LearningFeature-level FusionRepresentation LearningTemporal AttentionTemporal Feature EngineeringAttention MechanismsAudio Feature ExtractionConvolutional Neural NetworksDeep Feature ExtractionDeep Feature FusionDeep Feature LearningFeature FusionSpatiotemporal Feature Fusion
Source acquisition device identification from recorded audio aims to identify the source recording device by analyzing the intrinsic characteristics of audio, which is a challenging problem in audio forensics. In this paper, we propose a spatiotemporal representation learning framework with multi-attention mechanisms to tackle this problem. In the deep feature extraction stage of recording devices, a two-branch network based on residual dense temporal convolution networks (RD-TCNs) and convolutional neural networks (CNNs) is constructed. The spatial probability distribution features of audio signals are employed as inputs to the branch of the CNN for spatial representation learning, and the temporal spectral features of audio signals are fed into the branch of the RD-TCN network for temporal representation learning. This achieves simultaneous learning of long-term and short-term features to obtain an accurate representation of device-related information. In the spatiotemporal feature fusion stage, three attention mechanisms-temporal, spatial, and branch attention mechanisms-are designed to capture spatiotemporal weights and achieve effective deep feature fusion. The proposed framework achieves state-of-the-art performance on the benchmark CCNU_Mobile dataset, reaching an accuracy of 97.6% for the identification of 45 recording devices, with a significant reduction in training time compared to other models.
33
Speech recognition with deep recurrent neural networks
Alex Graves, Abdelrahman Mohamed, Geoffrey E. Hinton · 2013 · 8.8K citations
Residual Dense Network for Image Super-Resolution
Yulun Zhang, Yapeng Tian, Yu Kong et al. · 2018 · 4.1K citations
X-Vectors: Robust DNN Embeddings for Speaker Recognition
David Snyder, Daniel Garcia-Romero, Gregory Sell et al. · 2018 · 2.7K citations