Emerging Science Journal · 2023 · 11 citations · 22 references
ComputingComputer ScienceData MiningMachine LearningStatistical LearningClassificationEnsemble LearningEnsemble MethodsOverfittingResampling MethodsUnderfittingBaggingClass ImbalanceClass Imbalance LearningEnsemble ClassificationImbalanceImbalanced ClassificationImbalanced LearningSynthetic Minority Oversampling
Imbalanced learning problems are a challenge faced by classifiers when data samples have an unbalanced distribution among classes. The Synthetic Minority Over-Sampling Technique (SMOTE) is one of the most well-known data pre-processing methods. Problems that arise when oversampling with SMOTE are the phenomenon of noise, small disjunct samples, and overfitting due to a high imbalance ratio in a dataset. A high level of imbalance ratio and low variance conditions cause the results of synthetic data generation to be collected in narrow areas and conflicting regions among classes and make them susceptible to overfitting during the learning process by machine learning methods. Therefore, this research proposes a combination between Radius-SMOTE and Bagging Algorithm called the IRS-BAG Model. For each sub-sample generated by bootstrapping, oversampling was done using Radius SMOTE. Oversampling on the sub-sample was likely to overcome overfitting problems that might occur. Experiments were carried out by comparing the performance of the IRS-BAG model with various previous oversampling methods using the imbalanced public dataset. The experiment results using three different classifiers proved that all classifiers had gained a notable improvement when combined with the proposed IRS-BAG model compared with the previous state-of-the-art oversampling methods. Doi: 10.28991/ESJ-2023-07-05-04 Full Text: PDF
22
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
Leo Breiman · Machine Learning · 1996 · 16.4K citations · Full text
ADASYN: Adaptive synthetic sampling approach for imbalanced learning
Haibo He, Yang Bai, Edwardo A. Garcia et al. · 2008 · 4.4K citations