IEEE Transactions on Pattern Analysis and Machine Intelligence · 2021 · 87 citations · 28 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningStatistical LearningAdaptive LearningEvolutionary ComputationGenetic AlgorithmsGenetic ProgrammingOptimization For Machine LearningAutomated Machine LearningAutomlBayesian OptimizationConcept DriftConcept Drift AdaptationConcept Drift ModelingIncremental LearningStreaming Machine Learning
Automated Machine Learning (AutoML) systems have been shown to efficiently build good models for new datasets. However, it is often not clear how well they can adapt when the data evolves over time. The main goal of this study is to understand the effect of concept drift on the performance of AutoML methods, and which adaptation strategies can be employed to make them more robust to changes in the underlying data. To that end, we propose 6 concept drift adaptation strategies and evaluate their effectiveness on a variety of AutoML approaches for building machine learning pipelines, including Bayesian optimization, genetic programming, and random search with automated stacking. These are evaluated empirically on real-world and synthetic data streams with different types of concept drift. Based on this analysis, we propose ways to develop more sophisticated and robust AutoML techniques.
28
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
Greedy function approximation: A gradient boosting machine.
Jerome H. Friedman · The Annals of Statistics · 2001 · 29K citations · Full text
Algorithms for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2011 · 3.2K citations · Full text
Mining high-speed data streams
Pedro Domingos, Geoff Hulten · 2000 · 2.2K citations · Full text