Knowledge-Based Systems · 2022 · 21 citations · 38 references
ComputingComputer ScienceFeature EngineeringMachine LearningStatistical LearningDeep LearningGraph-based LearningRepresentation LearningSemi-supervised LearningSupervised LearningUnsupervised LearningBenchmark DatasetsData AugmentationGraph-based Semi-supervised LearningImbalanced ClassificationLabel PropagationSemi-supervised ClassificationSemi-supervised ModelsUnsupervised Feature Learning
Semi-supervised learning (SSL) has been studied widely in standard benchmark datasets; however, real-world data often exhibit class-imbalanced distributions, which pose significant challenges for deep semi-supervised models. To address this issue, we design a three-stage learning framework, 3LPR, by combining unsupervised feature extraction, graph-based Label Propagation, and mixed data augmentation (MDA)-based label Reassignment. Specifically, we first explore the performance of supervised and unsupervised learning for feature extraction of class-imbalanced data and then establish our first stage of feature extraction through unsupervised learning. Then, we adopt graph network-based offline label propagation and sieving to effectively expand the labeled set to overcome the excessive label bias in the classifier during the training process. Finally, we propose a label reassignment (LRA) algorithm for class-imbalanced semi-supervised learning (CISSL) to train the expanded dataset, where the MDA strategy is adopted but with the label reassigned. The experimental results demonstrate that the proposed 3LPR framework for CISSL outperforms other state-of-the-art methods on various datasets.
38
CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features
Sangdoo Yun, Dongyoon Han, Sanghyuk Chun et al. · 2019 · 4.7K citations
Class-Balanced Loss Based on Effective Number of Samples
Yin Cui, Menglin Jia, Tsung-Yi Lin et al. · 2019 · 2.6K citations
FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
Kihyuk Sohn, David Berthelot, Chunliang Li et al. · arXiv (Cornell University) · 2020 · 2.3K citations · Full text