IEEE Access · 2018 · 35 citations · 29 references
ComputingComputer ScienceData MiningMachine LearningStatistical LearningActive LearningClassificationEnsemble LearningEnsemble MethodsSemi-supervised LearningSupervised LearningActive Learning For ClassificationClass ImbalanceConcept DriftImbalanced ClassificationLabelingOnline Ensemble LearningSemi-supervised Ensemble LearningStreaming Machine Learning
Practical applications often require learning algorithms capable of addressing data streams with concept drift and class imbalance. This paper proposes an online active learning paired ensemble for drifting streams with class imbalance. The paired ensemble consists of a long-term stable classifier and a dynamic classifier to address both sudden concept drift and gradual concept drift. To select the most representative instances for learning, a hybrid labeling strategy which includes an uncertainty strategy and an imbalance strategy is proposed. The uncertainty strategy applies a margin-based uncertainty criterion and a dynamic adjustment threshold. Based on the categorical distribution of the last data block, the imbalance strategy prefers to learn instances of the minority category. In addition, it also incorporates the advantages of the traditional random strategy and helps to capture the drifts away from the decision boundary. Experiments on real datasets and synthetic datasets utilize prequential AUC as an evaluation index, comparing the classification performance of our method with semi-supervised and supervised learning methods. The results show that the proposed methods can obtain higher AUC values at an even lower labeling cost. Moreover, it is noteworthy that the labeling cost can be dynamically allocated according to the concept drift and imbalance ratio.
29
Statistical Comparisons of Classifiers over Multiple Data Sets
Janez Demšar · 2006 · 11.2K citations
E. S. Page · Biometrika · 1954 · 4.7K citations
A streaming ensemble algorithm (SEA) for large-scale classification
W. Nick Street, YongSeog Kim · 2001 · 1.2K citations
Albert Bifet, Geoffrey Holmes, Richard Kirkby et al. · Research Commons (University of Waikato) · 2010 · 1.1K citations · Full text
Learning in Nonstationary Environments: A Survey
Gregory Ditzler, Manuel Roveri, Cesare Alippi et al. · IEEE Computational Intelligence Magazine · 2015 · 784 citations · Full text