Pattern Recognition · 2023 · 31 citations · 18 references
ComputingComputer ScienceMachine LearningStatistical LearningUncertainty QuantificationActive LearningClassificationMeta-learningStream ProcessingSupervised LearningAccuracyConcept DriftConcept Drift AdaptationData Stream MiningMeta-feature LearningStreaming Machine LearningTuningUncertainty Sampling
Supervised data stream learning depends on the incoming sample’s true label to update a classifier’s model. In real life, obtaining the ground truth for each instance is a challenging process; it is highly costly and time consuming. Active Learning has already bridged this gap by finding a reduced set of instances to support the creation of a reliable stream classifier. However, identifying a reduced number of informative instances to support a suitable classifier update and drift adaptation is very tricky. To better adapt to concept drifts using a reduced number of samples, we propose an online tuning of the Uncertainty Sampling threshold using a meta-learning approach. Our approach exploits statistical meta-features from adaptive windows to meta-recommend a suitable threshold to address the trade-off between the number of labelling queries and high accuracy. Experiments exposed that the proposed approach provides the best trade-off between accuracy and query reduction by dynamic tuning the uncertainty threshold using lightweight meta-features.
18
Mark Hall, Eibe Frank, Geoffrey Holmes et al. · ACM SIGKDD Explorations Newsletter · 2009 · 17.8K citations
Memory: A Contribution to Experimental Psychology
Hermann Ebbinghaus · Annals of Neurosciences · 2013 · 2.9K citations · Full text
An empirical comparison of botnet detection methods
Sebastián García, Martin Grill, Jan Stiborek et al. · Computers & Security · 2014 · 917 citations · Full text
TSFEL: Time Series Feature Extraction Library
Marília Barandas, Duarte Folgado, Letícia Fernandes et al. · SoftwareX · 2020 · 498 citations · Full text