IEEE Transactions on Evolutionary Computation · 2019 · 354 citations · 65 references
ArchitectureComputer ScienceAlgorithmsDesign OptimizationOptimizationEvolutionary ComputationEvolutionary OptimizationGenetic AlgorithmsHeuristic OptimizationMetaheuristic OptimizationParameter OptimizationParameter ControlParameter TuningTuning
Parameter tuning optimizes metaheuristic performance, and automating this task has attracted significant attention over the past two decades. This survey reviews automatic parameter tuning methods for metaheuristics and highlights future research challenges. The authors introduce a taxonomy that classifies tuning methods into simple generate‑evaluate, iterative generate‑evaluate, and high‑level generate‑evaluate categories, and review each in turn. The survey discusses each method’s strengths and weaknesses, aiding researchers and practitioners in selecting appropriate tuning strategies.
Parameter tuning, that is, to find appropriate parameter settings (or configurations) of algorithms so that their performance is optimized, is an important task in the development and application of metaheuristics. Automating this task, i.e., developing algorithmic procedure to address parameter tuning task, is highly desired and has attracted significant attention from the researchers and practitioners. During last two decades, many automatic parameter tuning approaches have been proposed. This paper presents a comprehensive survey of automatic parameter tuning methods for metaheuristics. A new classification (or taxonomy) of automatic parameter tuning methods is introduced according to the structure of tuning methods. The existing automatic parameter tuning approaches are consequently classified into three categories: 1) simple generate-evaluate methods; 2) iterative generate-evaluate methods; and 3) high-level generate-evaluate methods. Then, these three categories of tuning methods are reviewed in sequence. In addition to the description of each tuning method, its main strengths and weaknesses are discussed, which is helpful for new researchers or practitioners to select appropriate tuning methods to use. Furthermore, some challenges and directions of this field are pointed out for further research.
65
Leo Breiman · Machine Learning · 2001 · 126.2K citations · Full text
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44.6K citations
Riccardo Poli, James Kennedy, Tim Blackwell · Swarm Intelligence · 2007 · 21.4K citations