IEEE Transactions on Neural Networks and Learning Systems · 2018 · 111 citations · 29 references
ComputingComputer ScienceData MiningMachine LearningPredictive AnalyticsActive LearningClassificationEnsemble LearningEnsemble MethodsOnline AlgorithmsActive Learning For ClassificationConcept DriftDecision Threshold AdaptationDecision Threshold OptimizationDecision Threshold SelectionLabelingOnline Ensemble LearningOnline Machine Learning
In practical applications, data stream classification faces significant challenges, such as high cost of labeling instances and potential concept drifting. We present a new online active learning ensemble framework for drifting data streams based on a hybrid labeling strategy that includes the following: 1) an ensemble classifier, which consists of a long-term stable classifier and multiple dynamic classifiers (a multilevel sliding window model is used to create and update the dynamic classifiers to effectively process both the gradual drift type and sudden drift type data stream) and 2) active learning, which takes a nonfixed labeling budget, supports on-demand request labeling, and adopts an uncertainty strategy and random strategy to label instances. The decision threshold of the uncertainty strategy is adjusted dynamically, i.e., when concept drift occurs, the threshold is gradually reduced to query the most uncertain instances in priority to reduce the request expense as much as possible. Experiments on synthetic and real data sets show that precise prediction accuracy can be obtained by the proposed method without increasing the total cost of labeling, and that the labeling cost can be dynamically allocated according to the concept drift.
29
Statistical Comparisons of Classifiers over Multiple Data Sets
Janez Demšar · 2006 · 11.2K citations
Mining time-changing data streams
Geoff Hulten, Laurie Spencer, Pedro Domingos · 2001 · 1.8K citations
Learning from Time-Changing Data with Adaptive Windowing
Albert Bifet, Ricard Gavaldà · 2007 · 1.7K citations
Mining concept-drifting data streams using ensemble classifiers
Haixun Wang, Wei Fan, Philip S. Yu et al. · 2003 · 1.3K citations
A streaming ensemble algorithm (SEA) for large-scale classification
W. Nick Street, YongSeog Kim · 2001 · 1.2K citations