Journal of Information Processing Systems · 2013 · 43 citations · 11 references
ComputingBiomedical EngineeringCardiologyBiomedical Signal ProcessingData MiningMachine LearningCardiac Signal ProcessingClassificationEnsemble LearningEnsemble MethodsFeature ExtractionFeature SelectionClassification AccuracyClassification ModelsEnsemble ClassificationFeature Selection For ClassificationFeature Subset SelectionSubset SelectionVoting ClassifiersVoting Ensembles
In this paper, a novel method is proposed to build an ensemble of classifiers by using a feature selection schema. The feature selection schema identifies the best feature sets that affect the arrhythmia classification. Firstly, a number of feature subsets are extracted by applying the feature selection schema to the original dataset. Then classification models are built by using the each feature subset. Finally, we combine the classification models by adopting a voting approach to form a classification ensemble. The voting approach in our method involves both classification error rate and feature selection rate to calculate the score of the each classifier in the ensemble. In our method, the feature selection rate depends on the extracting order of the feature subsets. In the experiment, we applied our method to arrhythmia dataset and generated three top disjointed feature sets. We then built three classifiers based on the top-three feature subsets and formed the classifier ensemble by using the voting approach. Our method can improve the classification accuracy in high dimensional dataset. The performance of each classifier and the performance of their ensemble were higher than the performance of the classifier that was based on whole feature space of the dataset. The classification performance was improved and a more stable classification model could be constructed with the proposed approach.
11
Boosting the margin: a new explanation for the effectiveness of voting methods
Peter L. Bartlett, Yoav Freund, Wee Sun Lee et al. · The Annals of Statistics · 1998 · 2.3K citations · Full text
Classifier selection for majority voting
Dymitr Ruta, Bogdan Gabryś · Information Fusion · 2004 · 630 citations
Computing, Data Science, Data Mining +10
Feature Selection with Ensembles, Artificial Variables, and Redundancy Elimination
Eugene Tuv, Alexander Borisov, George C. Runger et al. · 2009 · 278 citations