1994 · 10 citations · 14 references
Natural SciencesComputer ScienceMathematicsOptimizationProbability TheoryStochastic ModelingBayesian Decision TheoryBayesian InferenceContinuous OptimizationHeuristic OptimizationOptimization Under UncertaintyStochastic OptimizationBayesian OptimizationNumerical ReasoningRandomized OptimizationRandomized Optimization Algorithms
We consider here the average deviation as the most important objective when designing numerical techniques and algorithms. We call that a Bayesian approach. We start by describing the Bayesian approach to the continu ous global optimization. Then we show how to apply the results to the adaptation of parameters of randomized techniques of optimiza tion. We assume that there exists a simple function which roughly predicts the consequences of decisions. We call it heuristics. We define the probability of a decision by a randomized decision func tion depending on heuristics. We fix this decision function, except for some parameters that we call the decision parameters. We repeat the randomized decision procedure several times given the decision parameters and regard the best outcome as a result. We optimize the decision parameters to make the search more efficient. Thus we replace the original optimization problem by an auxiliary problem of continuous stochastic optimization. We solve the auxiliary problem by the Bayesian methods of global op timization. Therefore we call the approach as the Bayesian one. We discuss the advantages and disadvantages of the Bayesian approach. We describe the applications to some of discrete pro-
14
Equation of State Calculations by Fast Computing Machines
N. Metropolis, Arianna W. Rosenbluth, M. N. Rosenbluth et al. · The Journal of Chemical Physics · 1953 · 37.1K citations