arXiv (Cornell University) · 2019 · 13 citations · 11 references
ComputingComputer ScienceHigh-performance ComputingArtificial IntelligenceEnsemble PerformanceMachine LearningDeep LearningEnsemble LearningEnsemble MethodsNeural NetworksRepresentation LearningScalable Machine LearningBenchmark DatasetsDeep EnsemblesEnsemble GenerationNeural Network ModelingTraining
AdaNet is a lightweight TensorFlow-based (Abadi et al., 2015) framework for automatically learning high-quality ensembles with minimal expert intervention. Our framework is inspired by the AdaNet algorithm (Cortes et al., 2017) which learns the structure of a neural network as an ensemble of subnetworks. We designed it to: (1) integrate with the existing TensorFlow ecosystem, (2) offer sensible default search spaces to perform well on novel datasets, (3) present a flexible API to utilize expert information when available, and (4) efficiently accelerate training with distributed CPU, GPU, and TPU hardware. The code is open-source and available at: https://github.com/tensorflow/adanet.
11
Distilling the Knowledge in a Neural Network
Geoffrey E. Hinton, Oriol Vinyals · arXiv (Cornell University) · 2015 · 14K citations · Full text
Neural Networks and the Bias/Variance Dilemma
Stuart Geman, Elie Bienenstock, René Doursat · Neural Computation · 1992 · 3.6K citations
Efficient and robust automated machine learning
Matthias Feurer, Aaron Klein, Katharina Eggensperger et al. · Neural Information Processing Systems · 2015 · 1.3K citations
Ensemble selection from libraries of models
Rich Caruana, Alexandru Niculescu-Mizil, G. Crew et al. · 2004 · 844 citations