Heliyon · 2024 · 55 citations · 66 references
ComputingComputer ScienceComputer VisionHabitat ConservationMachine LearningDeep LearningEvolutionary OptimizationOptimization For Machine LearningConvergenceDeep Image FeaturesDeep Learning-based ClassificationError Rate AnalysisOptimization AlgorithmsPremature Convergence
Deep Convolutional Neural Networks (DCNNs) have shown remarkable success in image classification tasks, but optimizing their hyperparameters can be challenging due to their complex structure. This paper develops the Adaptive Habitat Biogeography-Based Optimizer (AHBBO) for tuning the hyperparameters of DCNNs in image classification tasks. In complicated optimization problems, the BBO suffers from premature convergence and insufficient exploration. In this regard, an adaptable habitat is presented as a solution to these problems; it would permit variable habitat sizes and regulated mutation. Better optimization performance and a greater chance of finding high-quality solutions across a wide range of problem domains are the results of this modification's increased exploration and population diversity. AHBBO is tested on 53 benchmark optimization functions and demonstrates its effectiveness in improving initial stochastic solutions and converging faster to the optimum. Furthermore, DCNN-AHBBO is compared to 23 well-known image classifiers on nine challenging image classification problems and shows superior performance in reducing the error rate by up to 5.14%. Our proposed algorithm outperforms 13 benchmark classifiers in 87 out of 95 evaluations, providing a high-performance and reliable solution for optimizing DNNs in image classification tasks. This research contributes to the field of deep learning by proposing a new optimization algorithm that can improve the efficiency of deep neural networks in image classification.
66
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Seyedali Mirjalili, Seyed Mohammad Mirjalili, Seyed Mohammad Mirjalili et al. · Advances in Engineering Software · 2014 · 18.4K citations · Full text
Squeeze-and-Excitation Networks
Jie Hu, Li Shen, Samuel Albanie et al. · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2019 · 12.5K citations
Joaquín Derrac, Salvador García, Daniel Molina et al. · Swarm and Evolutionary Computation · 2011 · 5.4K citations