Proceedings of International Conference on Neural Networks (ICNN'96) · 2002 · 236 citations · 8 references
ComputingData ScienceMachine LearningStatistical LearningStatisticsBias-variance TradeoffEnsemble LearningEnsemble MethodsEnsemble Performance AnalysisEstimation TheoryStatistical InferenceEnsemble AveragingEnsemble Learning TheoryEnsemble VarianceEnsemble-based PredictionGeneralization Error
It has been empirically shown that a better estimate with less generalization error can be obtained by averaging outputs of multiple estimators. This paper presents an analytical result for the generalization error of ensemble estimators. First, we derive a general expression of the ensemble generalization error by using factors of interest (bias, variance, covariance, and noise variance) and show how the generalization error is affected by each of them. Some special cases are then investigated. The result of a simulation is shown to verify our analytical result. A practically important problem of the ensemble approach, ensemble dilemma, is also discussed.
8
Advances in neural information processing systems 7
Computers & Mathematics with Applications · 1996 · 14.4K citations
David H. Wolpert · Neural Networks · 1992 · 7.5K citations
Neural Networks and the Bias/Variance Dilemma
Stuart Geman, Elie Bienenstock, René Doursat · Neural Computation · 1992 · 3.6K citations
Neural Network Ensembles, Cross Validation, and Active Learning
Anders Krogh, Jesper Vedelsby · 1994 · 1.8K citations