arXiv (Cornell University) · 2018 · 61 citations · 2 references
ComputingComputer ScienceData ScienceArtificial IntelligenceMachine LearningStatistical LearningDeep LearningEnsemble LearningEnsemble MethodsRepresentation LearningSelf-supervised LearningSupervised LearningAutomated Machine LearningAutomlBenchmark DatasetsMachine Learning Classification
AutoML serves as the bridge between varying levels of expertise when designing machine learning systems and expedites the data science process. A wide range of techniques is taken to address this, however there does not exist an objective comparison of these techniques. We present a benchmark of current open source AutoML solutions using open source datasets. We test auto-sklearn, TPOT, auto_ml, and H2O's AutoML solution against a compiled set of regression and classification datasets sourced from OpenML and find that auto-sklearn performs the best across classification datasets and TPOT performs the best across regression datasets.
2
OpenML Benchmarking Suites and the OpenML100.
Bernd Bischl, Giuseppe Casalicchio, Matthias Feurer et al. · arXiv (Cornell University) · 2017 · 36 citations · Full text