Induction of decision rules in classification and discovery-oriented perspectives

Jerzy Stefanowski, Daniel Vanderpooten

International Journal of Intelligent Systems · 2000 · 91 citations · 9 references

DOIFull text

Open access

Concepts

TL;DR

Decision rules are induced from data tables describing objects by attributes, with rough sets theory handling inconsistencies, and the two main perspectives—classification and knowledge discovery—differ in how rule evaluation is performed. The study presents and discusses criteria for evaluating rule quality and analyzes the trade‑off between classification‑ and discovery‑relevant criteria. The authors conducted an extensive experimental comparison on several well‑known data sets between the rough‑set based LEM2 algorithm for classification rules and their own Explore algorithm tailored to the discovery perspective. The experimental study compared LEM2 and Explore across several data sets, illustrating differences in rule quality between classification and discovery perspectives. © 2001 John Wiley & Sons, Inc.

Abstract

This paper discusses induction of decision rules from data tables representing information about a set of objects described by a set of attributes. If the input data contains inconsistencies, rough sets theory can be used to handle them. The most popular perspectives of rule induction are classification and knowledge discovery. The evaluation of decision rules is quite different depending on the perspective. Criteria for evaluating the quality of a set of rules are presented and discussed. The degree of conflict and the possibility of achieving a satisfying compromise between criteria relevant to classification and criteria relevant to discovery are then analyzed. For this purpose, we performed an extensive experimental study on several well-known data sets where we compared two different approaches: (1) the popular rough set based rule induction algorithm LEM2 generating classification rules, (2) our own algorithm Explore—specific for discovery perspective. © 2001 John Wiley & Sons, Inc.

References

9