A Survey of Methods for Managing the Classification and Solution of Data Imbalance Problem

Khan Md. Hasib, Md. Sadiq Iqbal, Faisal Muhammad Shah, Jubayer Al Mahmud, Mahmudul Hasan Popel, Md. Imran Hossain Showrov, Shakil Ahmed, Obaidur Rahman

Journal of Computer Science · 2020 · 164 citations · 35 references

DOIFull text

Open access

Concepts

TL;DR

Class imbalance, where most instances belong to a majority class and few to a minority class, is a pervasive issue in real‑world applications and has spurred research into sampling, cost‑sensitive learning, genetic programming, bagging, boosting, and other techniques. This survey reviews 24 studies from 2003 to 2019 to examine single, hybrid, and ensemble architectures aimed at improving classification performance on imbalanced data. The authors perform statistical analyses of classification algorithms across diverse methods, experimental conditions, and datasets reported in the surveyed papers.

Abstract

The problem of class imbalance is extensive for focusing on numerous applications in the real world. In such a situation, nearly all of the examples are labeled as one class called majority class, while far fewer examples are labeled as the other class usually, the more important class is called minority. Over the last few years, several types of research have been carried out on the issue of class imbalance, including data sampling, cost-sensitive analysis, Genetic Programming based models, bagging, boosting, etc. Nevertheless, in this survey paper, we enlisted the 24 related studies in the years 2003, 2008, 2010, 2012 and 2014 to 2019, focusing on the architecture of single, hybrid and ensemble method design to understand the current status of improving classification output in machine learning techniques to fix problems with class imbalances. This survey paper also includes a statistical analysis of the classification algorithms under various methods and several other experimental conditions, as well as datasets used in different research papers.

References

35