Evolutionary Computation · 2003 · 114 citations · 13 references
ComputingComputational EngineeringEvolutionary TheoryMachine LearningOptimizationEvolutionary ComputationEvolutionary OptimizationFitness Trade-offsGenetic AlgorithmsSelection Pressure DesignAccuracyBoundingEvolutionary AlgorithmsRule Evolution
The evolutionary learning mechanism in XCS strongly depends on its accuracy-based fitness approach. The approach is meant to result in an evolutionary drive from classifiers of low accuracy to those of high accuracy. Since, given inaccuracy, lower specificity often corresponds to lower accuracy, fitness pressure most often also results in a pressure towards higher specificity. Moreover, fitness pressure should cause the evolutionary process to be innovative in that it combines low-order building blocks of lower accurate classifiers, to higher-order building blocks with higher accuracy. This paper investigates how, when, and where accuracy-based fitness results in successful rule evolution in XCS. Along the way, a weakness in the current proportionate selection method in XCS is identified. Several problem bounds are derived that need to be obeyed to enable proper evolutionary pressure. Moreover, a fitness dilemma is identified that causes accuracy-based fitness to be misleading. Improvements are introduced to XCS to make fitness pressure more robust and overcome the fitness dilemma. Specifically, (1) tournament selection results in a much better fitness-bias exploitation, and (2) bilateral accuracy prevents the fitness dilemma. While the improvements stand for themselves, we believe they also contribute to the ultimate goal of an evolutionary learning system that is able to solve decomposable machine-learning problems quickly, accurately,and reliably. The paper also contributes to the further understanding of XCS in general and the fitness approach in XCS in particular.
13
Classifier Fitness Based on Accuracy
Stewart W. Wilson · Evolutionary Computation · 1995 · 1.4K citations
An algorithmic description of XCS
Martin V. Butz, Stewart W. Wilson · Soft Computing · 2002 · 486 citations
Cognitive systems based on adaptive algorithms
John H. Holland, Judith S. Reitman · ACM SIGART Bulletin · 1977 · 472 citations · Full text