IEEE Transactions on Knowledge and Data Engineering · 1997 · 129 citations · 24 references
ComputingComputer ScienceData ScienceData MiningFeature EngineeringMachine LearningClassificationDecision TreesFeature ExtractionFeature SelectionRepresentation LearningCorrelationFeature DiscretizationFeature RankingFeature Selection For ClassificationFeature Subset SelectionFeature-based RankingRanking FeaturesSubset Selection
Deriving classification rules or decision trees from examples is an important problem. When there are too many features, discarding weak features before the derivation process is highly desirable. When there are numeric features, they need to be discretized for the rule generation. We present a new approach to these problems. Traditional techniques make use of feature merits based on either the information theoretic, or the statistical correlation between each feature and the class. We instead assign merits to features by finding each feature's "obligation" to the class discrimination in the context of other features. The merits are then used to rank the features, select a feature subset, and discretize the numeric variables. Experience with benchmark example sets demonstrates that the new approach is a powerful alternative to the traditional methods. This paper concludes by posing some new technical issues that arise from this approach.
24
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Classification and Regression Trees.
John Van Ryzin, Leo Breiman, Jerome H. Friedman et al. · Journal of the American Statistical Association · 1986 · 21K citations
Classification and regression trees
J. Praagman · European Journal of Operational Research · 1985 · 10.2K citations
Graph-Based Algorithms for Boolean Function Manipulation
Bryant · IEEE Transactions on Computers · 1986 · 8.9K citations · Full text
J. R. Quinlan · International Journal of Man-Machine Studies · 1987 · 2.5K citations