IEEE Signal Processing Letters · 2014 · 94 citations · 13 references
ComputingComputer ScienceAlgorithmsComputer VisionMachine LearningClassificationPattern RecognitionAdaboostBoostingConvergenceData ClassificationGeneralization ErrorMachine Learning ClassificationTraining Error Reduction
As a machine learning algorithm, AdaBoost has obtained considerable success in data classification and object detection. Later its generalized version called Real AdaBoost was proposed by Schapire and Singer. Real AdaBoost increases weights for misclassified samples and decreases weights for correctly classified samples in every iteration. This kind of weight adjustment focuses on the samples with large weights and tries to make them correctly classified in future runs. However, it may lead to the misclassification of some other samples that have been correctly classified in previous runs. If we can curb this kind of misclassification during the boosting process, a faster training can be achieved. Based on this assumption, we propose Parameterized AdaBoost in which a parameter is devised to penalize the misclassification of samples that have already been correctly classified. Then we analyse that samples with positive classification margins in Parameterized AdaBoost are more than in Real AdaBoost. Experimental results show that our approach achieves a faster convergence of the training error and also improves the generalization error to some degree when compared with Real AdaBoost.
13
A Short Introduction to Boosting
Yoav Freund, Robert E. Schapire · 1999 · 3K citations
Improved boosting algorithms using confidence-rated predictions
Robert E. Schapire, Yoram Singer · 1998 · 2.6K citations
Boosting the margin: a new explanation for the effectiveness of voting methods
Peter L. Bartlett, Yoav Freund, Wee Sun Lee et al. · The Annals of Statistics · 1998 · 2.3K citations · Full text