Ecological Informatics · 2024 · 14 citations · 40 references
ComputingComputer ScienceZoologyAcousticsComputer VisionMachine LearningBird ConservationBird IdentificationDeep LearningNeural NetworksPattern RecognitionSpeech RecognitionActivation FunctionsAutomated Bird IdentificationDeep Learning-based ClassificationDeep Neural Network Acoustic ModelsMachine Learning For AcousticsMachine Learning For Bird IdentificationSound Pattern RecognitionSpecies-specific Identification
The combination of deep learning and bird sound recognition is widely employed in bird species conservation monitoring. A complex network structure is not conducive for deploying bird sound recognition devices, resulting in problems such as long inference time and low efficiency. Using AlexNet as the backbone model, we explore the potential of shallow and straightforward models without complex connection techniques or attention mechanisms, named SIAlex, to recognise and classify 20 bird sound datasets, which are simultaneously validated on a 10 class UrbanSound8k dataset. Using the structural re-parameterization method, the number of model layers is reduced, computational efficiency is improved, and the inference time is significantly reduced, achieving a decoupling of training and inference time in the structure. To increase the nonlinearity of the model, a cascaded approach is utilised to increase the number of activation functions, thereby significantly improving the generalisation performance of the model. Simultaneously, in the classifier section, convolutional layer replaces the original fully connected layer, thereby reducing the inference time and increasing the feature extraction ability of the model, improving accuracy, and effectively recognising bird speech. The experimental data show that the SIAlex network on the Birdsdata dataset improves the accuracy to 93.66%, and the inference time for a piece of data is only 2.466 ms. The accuracy of the UrbanSound8k dataset reaches 96.04%, and the inference time for a piece of data is 3.031 ms. A large number of experimental comparisons have shown that the method proposed in this paper achieves good results in reducing the inference time of the model, bringing breakthroughs in the application of shallow, simple models.
40
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
1993 · 14.3K citations
Generative Adversarial Networks
arXiv (Cornell University) · 2014 · 4.6K citations · Full text
Striving for Simplicity: The All Convolutional Net
Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox et al. · arXiv (Cornell University) · 2014 · 2.6K citations · Full text