2012 · 227 citations · 29 references
Natural SciencesMathematicsOptimizationProbability TheoryUncertainty QuantificationConstrained OptimizationConvex OptimizationNonlinear ProgrammingOptimization TheoryOptimization Under UncertaintyRobust OptimizationChance-constrained OptimizationChance-constrained ProgrammingDistributionally Robust OptimizationDivergence MinimizationKullback-leibler DivergenceMathematical Programming ModelsMinimizationObjective Function Formulation
In this paper we study distributionally robust optimization (DRO) problems where the ambiguity set of the probability distribution is defined by the Kullback-Leibler (KL) divergence. We consider DRO problems where the ambiguity is in the objective function, which takes a form of an expectation, and show that the resulted minimax DRO problems can be formulated as a one-layer convex minimization problem. We also consider DRO problems where the ambiguity is in the constraint. We show that ambiguous expectation-constrained programs may be reformulated as a one-layer convex optimization problem that takes the form of the Benstein approximation of Nemirovski and Shapiro (2006). We further consider distributionally robust probabilistic programs. We show that the optimal solution of a probability minimization problem is also optimal for the distributionally robust version of the same problem, and also show that the ambiguous chance-constrained programs (CCPs) may be reformulated as the original CCP with an adjusted confidence level. A number of examples and special cases are also discussed in the paper to show that the reformulated problems may take simple forms that can be solved easily. The main contribution of the paper is to show that the KL divergence constrained DRO problems are often of the same complexity as their original stochastic programming problems and, thus, KL divergence appears a good candidate in modeling distribution ambiguities in mathematical programming.
29
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
Risk, Ambiguity, and the Savage Axioms
Daniel Ellsberg · The Quarterly Journal of Economics · 1961 · 7.9K citations
Business, Mathematics, Philosophy +12
Optimization of conditional value-at-risk
R. T. Rockafellar, Stan Uryasev · The Journal of Risk · 2000 · 6.5K citations
Business, Finance, Risk Management +17
Dimitris Bertsimas, Melvyn Sim · Operations Research · 2004 · 4.4K citations