Knowledge-Based Systems · 2021 · 107 citations · 41 references
ComputingComputer ScienceData ScienceData MiningMachine LearningStatistical LearningActive LearningClassificationEnsemble LearningEnsemble MethodsActive Learning DesignActive Learning For ClassificationClass ImbalanceConcept DriftImbalanced ClassificationMulticlass ClassificationSliding WindowsStreaming Machine Learning
A challenge to many real-world applications is multiclass imbalance with concept drift. In this paper, we propose a comprehensive active learning method for multiclass imbalanced streaming data with concept drift (CALMID). First, we design a comprehensive online active learning framework that includes an ensemble classifier, a drift detector, a label sliding window, sample sliding windows and an initialization training sample sequence. Next, a variable threshold uncertainty strategy based on an asymmetric margin threshold matrix is designed to comprehensively address the problem that a given class can simultaneously be a majority to a given subset of classes while also being a minority to others. Last but not least, we design a novel sample weight formula that comprehensively considers the class imbalance ratio of the sample’s category and the prediction difficulty. On 10 multiclass synthetic streams with different imbalance ratios and concept drifts, and on 5 real-world imbalanced streams with 7 to 55 classes and unknown drifts, the experimental results demonstrate that the proposed CALMID is more effective and efficient than several state-of-the-art learning algorithms.
41
SMOTE: Synthetic Minority Over-sampling Technique
Nitesh V. Chawla, Kevin W. Bowyer, Lawrence Hall et al. · Journal of Artificial Intelligence Research · 2002 · 31.2K citations · Full text
Haibo He, Edwardo A. Garcia · IEEE Transactions on Knowledge and Data Engineering · 2009 · 9.7K citations
Learning from Time-Changing Data with Adaptive Windowing
Albert Bifet, Ricard Gavaldà · 2007 · 1.7K citations
Albert Bifet, Geoffrey Holmes, Richard Kirkby et al. · Research Commons (University of Waikato) · 2010 · 1.1K citations · Full text