IEEE Transactions on Neural Networks and Learning Systems · 2024 · 20 citations · 40 references
ComputingComputer ScienceComputer VisionFeature EngineeringMachine LearningDeep LearningMetric LearningRepresentation LearningData AugmentationFew-shot ClassificationFew-shot Image ClassificationFew-shot LearningFew-shot Metric LearningMetric Downsampling
The few-shot image classification task is to enable a model to identify novel classes by using only a few labeled samples as references. In general, the more knowledge a model has, the more robust it is when facing novel situations. Although directly introducing large amounts of new training data to acquire more knowledge is an attractive solution, it violates the purpose of few-shot learning with respect to reducing dependence on big data. Another viable option is to enable the model to accumulate knowledge more effectively from existing data, i.e., improve the utilization of existing data. In this article, we propose a new data augmentation method called self-mixup (SM) to assemble different augmented instances of the same image, which facilitates the model to more effectively accumulate knowledge from limited training data. In addition to the utilization of data, few-shot learning faces another challenge related to feature extraction. Specifically, existing metric-based few-shot classification methods rely on comparing the extracted features of the novel classes, but the widely adopted downsampling structures in various networks can lead to feature degradation due to the violation of the sampling theorem, and the degraded features are not conducive to robust classification. To alleviate this problem, we propose a calibration-adaptive downsampling (CADS) that calibrates and utilizes the characteristics of different features, which can facilitate robust feature extraction and benefit classification. By improving data utilization and feature extraction, our method shows superior performance on four widely adopted few-shot classification datasets.
40
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
ImageNet Large Scale Visual Recognition Challenge
Olga Russakovsky, Jia Deng, Hao Su et al. · International Journal of Computer Vision · 2015 · 40.2K citations
Squeeze-and-Excitation Networks
Sergey Zagoruyko, Nikos Komodakis · 2016 · 6K citations
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Sangdoo Yun, Dongyoon Han, Sanghyuk Chun et al. · 2019 · 4.7K citations