arXiv (Cornell University) · 2016 · 33 citations · 12 references
ComputingComputer ScienceData ScienceAlgorithmsArtificial IntelligenceMachine LearningData PipelinesDecision TreesOptimization For Machine LearningAutomated Machine LearningClassification AccuracyData Pipeline DesignPareto-based OptimizationPipeline AutomationPipeline DesignPipeline OptimizationPipelines
As the field of data science continues to grow, there will be an ever-increasing demand for tools that make machine learning accessible to non-experts. In this paper, we introduce the concept of tree-based pipeline optimization for automating one of the most tedious parts of machine learning---pipeline design. We implement an open source Tree-based Pipeline Optimization Tool (TPOT) in Python and demonstrate its effectiveness on a series of simulated and real-world benchmark data sets. In particular, we show that TPOT can design machine learning pipelines that provide a significant improvement over a basic machine learning analysis while requiring little to no input nor prior knowledge from the user. We also address the tendency for TPOT to design overly complex pipelines by integrating Pareto optimization, which produces compact pipelines without sacrificing classification accuracy. As such, this work represents an important step toward fully automating machine learning pipeline design.
12
Scikit-learn: Machine Learning in Python
Fabián Pedregosa, Gaël Varoquaux, Alexandre Gramfort et al. · arXiv (Cornell University) · 2012 · 63.7K citations · Full text
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Random search for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2012 · 7.9K citations
DEAP: evolutionary algorithms made easy
Félix-Antoine Fortin, François-Michel De Rainville, Marc-André Gardner et al. · 2012 · 1.7K citations