2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) · 2022 · 173 citations · 30 references
ComputingComputer ScienceComputer VisionMachine LearningStatistical LearningBias-variance TradeoffFairness In Machine LearningLoss FunctionOverfittingRepresentation LearningSupervised LearningClass ImbalanceClass Imbalance LearningHigh-dimensional RegressionHuman Pose EstimationImbalanceImbalanced ClassificationImbalanced LearningLabels
Data imbalance exists ubiquitously in real-world visual regressions, e.g., age estimation and pose estimation, hurting the model's generalizability and fairness. Thus, im-balanced regression gains increasing research attention recently. Compared to imbalanced classification, imbalanced regression focuses on continuous labels, which can be boundless and high-dimensional and hence more challenging. In this work, we identify that the widely used Mean Square Error (MSE) loss function can be ineffective in imbalanced regression. We revisit MSE from a statistical view and propose a novel loss function, Balanced MSE, to accommodate the imbalanced training label distribution. We further design multiple implementations of Balanced MSE to tackle different real-world scenarios, particularly including the one that requires no prior knowledge about the training label distribution. Moreover, to the best of our knowledge, Balanced MSE is the first general solution to high-dimensional imbalanced regression in modern context. Extensive experiments on both synthetic and three real-world benchmarks demonstrate the effectiveness of Balanced MSE. Code and models are available at github.com/jiawei-ren/BalancedMSE.
30
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
Auto-Encoding Variational Bayes
Diederik P. Kingma, Max Welling · UvA-DARE (University of Amsterdam) · 2013 · 15.6K citations · Full text
Momentum Contrast for Unsupervised Visual Representation Learning
Kaiming He, Haoqi Fan, Yuxin Wu et al. · 2020 · 12K citations
Haibo He, Edwardo A. Garcia · IEEE Transactions on Knowledge and Data Engineering · 2009 · 9.7K citations
A Simple Framework for Contrastive Learning of Visual Representations
Ting Chen, Simon Kornblith, Mohammad Norouzi et al. · arXiv (Cornell University) · 2020 · 7.3K citations · Full text