Genetic Programming and Evolvable Machines · 2014 · 38 citations · 30 references
ArchitectureComputer ScienceAlgorithmsComputational GeometryOptimizationCrossover OperatorsEvolutionary ComputationEvolutionary OptimizationFitness Landscape AnalysisGenetic AlgorithmsGenetic ProgrammingBoolean Function MinimizationComparative Data AnalysisCrossoversGenetic Programming CrossoverSymbolic RegressionTask Success RateTree CrossoverTree-based Genetic Programming
This paper provides a structured, unified, formal and empirical perspective on all geometric semantic crossover operators proposed so far, including the exact geometric crossover by Moraglio, Krawiec, and Johnson, as well as the approximately geometric operators. We start with presenting the theory of geometric semantic genetic programming, and discuss the implications of geometric operators for the structure of fitness landscape. We prove that geometric semantic crossover can by construction produce an offspring that is not worse than the fitter parent, and that under certain conditions such an offspring is guaranteed to be not worse than the worse parent. We review all geometric semantic crossover operators presented to date in the literature, and conduct a comprehensive experimental comparison using a tree-based genetic programming framework and a representative suite of nine symbolic regression and nine Boolean function synthesis tasks. We scrutinize the performance (program error and success rate), generalization, computational cost, bloat, population diversity, and the operators’ capability to generate geometric offspring. The experiment leads to several interesting conclusions, the primary one being that an operator’s capability to produce geometric offspring is positively correlated with performance. The paper is concluded by recommendations regarding the suitability of operators for the particular domains of program induction tasks.
30
Genetic algorithms in search, optimization, and machine learning
Choice Reviews Online · 1989 · 49.3K citations
Neural Networks and the Bias/Variance Dilemma
Stuart Geman, Elie Bienenstock, René Doursat · Neural Computation · 1992 · 3.6K citations