2004 · 10 citations · 13 references
ComputingDecision SciencesInformation SystemsData MiningDecision Support SystemsMachine LearningClassificationDecision SupportDecision TreesEnsemble LearningEnsemble MethodsSupport Vector MachinesEnsemble ClassificationHybrid Decision Support SystemsVoting Ensembles
Abstract: In decision support systems a classification problem can be solved by employing one of several methods such as different types of artificial neural networks, decision trees, bayesian classifiers, etc. However, it may happen that certain parts of instances ’ space are better predicting by one method than the others. Thus, the decision of which particular method to choose is a complicated problem. A good alternative to choosing only one method is to create a hybrid forecasting system incorporating a number of possible solution methods as components (an ensemble of classifiers). For this purpose, we have implemented a hybrid decision support system that combines a neural net, a decision tree and a bayesian algorithm using a stacking variant methodology. The presented system can be trained with any data, but in the current implementation is mainly used by tutors of Hellenic Open University to identify drop-out prone students. However, a comparison with other ensembles using the same classifiers as base learner on several standard benchmark datasets showed that this tool gives better accuracy in most cases. 1.
13
Leo Breiman · Machine Learning · 1996 · 17K citations · Full text
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
Experiments with a new boosting algorithm
Yoav Freund, Robert E. Schapire · 1996 · 7.6K citations