Bayesian approach adapting stochastic and heuristic methods of global and discrete optimization

Audrius Mockus, Audris Mockus, Linas Mockus

1994 · 10 citations · 14 references

Concepts

Abstract

We consider here the average deviation as the most important objective when designing numerical techniques and algorithms. We call that a Bayesian approach. We start by describing the Bayesian approach to the continu­ ous global optimization. Then we show how to apply the results to the adaptation of parameters of randomized techniques of optimiza­ tion. We assume that there exists a simple function which roughly predicts the consequences of decisions. We call it heuristics. We define the probability of a decision by a randomized decision func­ tion depending on heuristics. We fix this decision function, except for some parameters that we call the decision parameters. We repeat the randomized decision procedure several times given the decision parameters and regard the best outcome as a result. We optimize the decision parameters to make the search more efficient. Thus we replace the original optimization problem by an auxiliary problem of continuous stochastic optimization. We solve the auxiliary problem by the Bayesian methods of global op­ timization. Therefore we call the approach as the Bayesian one. We discuss the advantages and disadvantages of the Bayesian approach. We describe the applications to some of discrete pro-

References

14