Universidad de Córdoba Insitutional Repository (Universidad de Córdoba) · 2007 · 90 citations · 50 references
Open access
ComputingComputer ScienceEnsemble PerformanceMachine LearningStatistical LearningClassificationDimensionality ReductionEnsemble LearningEnsemble MethodsPattern RecognitionSupervised LearningBoostingEnsemble ClassificationEnsemble GenerationEnsemble Learning TheoryEnsemble SelectionNeural Network ModelingProjectionsSubspace Learning
In this paper we propose a novel approach for ensemble construction based on the use of nonlinear \nprojections to achieve both accuracy and diversity of individual classifiers. The proposed approach \ncombines the philosophy of boosting, putting more effort on difficult instances, with the basis of \nthe random subspace method. Our main contribution is that instead of using a random subspace, \nwe construct a projection taking into account the instances which have posed most difficulties to \nprevious classifiers. In this way, consecutive nonlinear projections are created by a neural network \ntrained using only incorrectly classified instances. The feature subspace induced by the hidden layer \nof this network is used as the input space to a new classifier. The method is compared with bagging \nand boosting techniques, showing an improved performance on a large set of 44 problems from the \nUCI Machine Learning Repository. An additional study showed that the proposed approach is less \nsensitive to noise in the data than boosting methods
50
Chih-Chung Chang, Chih‐Jen Lin · ACM Transactions on Intelligent Systems and Technology · 2011 · 41.3K citations
Leo Breiman · Machine Learning · 1996 · 17K citations · Full text
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
Experiments with a new boosting algorithm
Yoav Freund, Robert E. Schapire · 1996 · 7.6K citations