2003 · 16 citations · 19 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningOptimizationGlobal OptimizationHeuristic SearchMetaheuristic OptimizationNeural NetworksOptimization For Machine LearningSimulation-based OptimizationBoltzmann EntropyBoltzmann MachinesEntropy-based OptimizationSimulated AnnealingSimulated Annealing Optimization
The design of the organization level of the intelligent machine as a Boltzmann machine, as described in current neural network literature, is discussed. Since this level is responsible for planning the actions of the machine, the problem at this tier is formulated as the construction of the right sequence of tasks or events which minimizes the entropy for the desired action. Two search techniques, simulated annealing (SA) and expanding subinterval random search (ESRS), are described. These techniques are used to find the global minimum entropy of a Boltzmann machine. Simulations using these search techniques were conducted using energy as a cost function, and results indicate that ESRS converges faster than SA to a global minimum if the topology contains narrow and deep cost wells.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
19
Optimization by Simulated Annealing
Scott Kirkpatrick, C. D. Gelatt, M.P. Vecchi · Science · 1983 · 44.6K citations
Information Theory and Statistical Mechanics
E. T. Jaynes · Physical Review · 1957 · 12.9K citations