Scientific Reports · 2024 · 136 citations · 26 references
ComputingComputer ScienceArtificial IntelligenceComputer VisionMachine LearningDeep LearningFeature ExtractionFeature SelectionPattern RecognitionRepresentation LearningAverage PoolingBenchmark DatasetsComputational EfficiencyConvolutional Neural NetworksDeep Feature ExtractionDeep Learning-based ClassificationMax PoolingPooling Operations
The pooling layer in convolutional neural networks plays a crucial role in reducing spatial dimensions, and improving computational efficiency. However, standard pooling operations such as max pooling or average pooling are not suitable for all applications and data types. Therefore, developing custom pooling layers that can adaptively learn and extract relevant features from specific datasets is of great significance. In this paper, we propose a novel approach to design and implement customizable pooling layers to enhance feature extraction capabilities in CNNs. The proposed T-Max-Avg pooling layer incorporates a threshold parameter T, which selects the K highest interacting pixels as specified, allowing it to control whether the output features of the input data are based on the maximum values or weighted averages. By learning the optimal pooling strategy during training, our custom pooling layer can effectively capture and represent discriminative information in the input data, thereby improving classification performance. Experimental results show that the proposed T-Max-Avg pooling layer achieves good performance on three different datasets. When compared to LeNet-5 model with average pooling, max pooling, and Avg-TopK methods, the T-Max-Avg pooling method achieves the highest accuracy on CIFAR-10, CIFAR-100, and MNIST datasets.
26
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.9K citations
Proceedings of IEEE Conference on Computer Vision and Pattern Recognition
1993 · 14.3K citations
Recent advances in convolutional neural networks
Jiuxiang Gu, Zhenhua Wang, Jason Kuen et al. · Pattern Recognition · 2017 · 6.3K citations