IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · 2011 · 67 citations · 32 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningOptimizationEvolutionary ComputationGenetic AlgorithmsHeuristic OptimizationHeuristic SearchMetaheuristic OptimizationNeural NetworksGenetic Algorithm OptimizationGenetic Algorithms For SearchLocal OptimizationMultilayer PerceptronOptimization AlgorithmsSimulated AnnealingTabu SearchTraining
The performance of an artificial neural network (ANN) depends upon the selection of proper connection weights, network architecture, and cost function during network training. This paper presents a hybrid approach (GaTSa) to optimize the performance of the ANN in terms of architecture and weights. GaTSa is an extension of a previous method (TSa) proposed by the authors. GaTSa is based on the integration of the heuristic simulated annealing (SA), tabu search (TS), genetic algorithms (GA), and backpropagation, whereas TSa does not use GA. The main advantages of GaTSa are the following: a constructive process to add new nodes in the architecture based on GA, the ability to escape from local minima with uphill moves (SA feature), and faster convergence by the evaluation of a set of solutions (TS feature). The performance of GaTSa is investigated through an empirical evaluation of 11 public-domain data sets using different cost functions in the simultaneous optimization of the multilayer perceptron ANN architecture and weights. Experiments demonstrated that GaTSa can also be used for relevant feature selection. GaTSa presented statistically relevant results in comparison with other global and local optimization techniques.
32
Genetic algorithms in search, optimization, and machine learning
Choice Reviews Online · 1989 · 49.3K citations
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44.6K citations
UCI Repository of machine learning databases
Catherine Blake · Medical Entomology and Zoology · 1998 · 10.5K citations
D. E. Goldberg · Medical Entomology and Zoology · 1989 · 10.1K citations
Oscillation and Chaos in Physiological Control Systems
Michael C. Mackey, Leon Glass · Science · 1977 · 4.1K citations