2024 · 24 citations · 14 references
ComputingComputer ScienceAcousticsFeature EngineeringMachine LearningAnomaly DetectionDeep LearningRepresentation LearningScalable Machine LearningSelf-supervised LearningSupervised LearningAutoencoder-based Anomaly DetectionData AugmentationDeep Learning-based Anomaly DetectionDeep Learning-based DetectionSelf-supervised Fine-tuningSelf-supervised PretrainingSelf-supervised Representation LearningSelf-supervised Speech Representation Learning
Machine anomalous sound detection is a useful technique for various applications, but it often suffers from poor generalization due to the challenges of data collection and complex acoustic environment. To address this issue, we propose a robust machine anomalous sound detection model that leverages self-supervised pre-trained models on large-scale speech data. Specifically, we assign different weights to the features from different layers of the pre-trained model and then use the working condition as the label for self-supervised classification fine-tuning. Moreover, we introduce a data augmentation method that simulates different operating states of the machine to enrich the dataset. Furthermore, we devise a transformer pooling method that fuses the features of different segments. Experiments on the DCASE2023 dataset show that our proposed method outperforms the commonly used reconstruction-based autoencoder and classification-based convolutional network by a large margin, demonstrating the effectiveness of large-scale pre-training for enhancing the generalization and robustness of machine anomalous sound detection. In Task2 of DCASE2023, we achieve 2nd place with these methods.
14
Efficient algorithms for mining outliers from large data sets
Sridhar Ramaswamy, Rajeev Rastogi, Kyuseok Shim · 2000 · 1.1K citations · Full text
Audio augmentation for speech recognition
Tom Ko, Vijayaditya Peddinti, Daniel Povey et al. · 2015 · 1.1K citations
Computing, Speech-language Pathology, Feature Engineering +9