INFORMS journal on computing · 2018 · 108 citations · 30 references
Natural SciencesComputer ScienceAlgorithmsDesign OptimizationOptimizationConvex OptimizationLinear ProgrammingNonlinear ProgrammingParameter OptimizationColumn GenerationParameter ControlPenalized OptimizationSmooth OptimizationSmoothing TechniquesStabilizationStabilization Techniques
The convergence of a column generation algorithm can be improved in practice by using stabilization techniques. Smoothing and proximal methods based on penalizing the deviation from the incumbent dual solution have become standards of the domain. Interpreting column generation as cutting plane strategies in the dual problem, we analyze the mechanisms on which stabilization relies. In particular, the link is established between smoothing and in-out separation strategies to derive generic convergence properties. For penalty function methods as well as for smoothing, we describe proposals for parameter self-adjusting schemes. Such schemes make initial parameter tuning less of an issue as corrections are made dynamically. Such adjustments also allow to adapt the parameters to the phase of the algorithm. We provide extensive test reports that validate our self-adjusting parameter scheme and highlight their performances. Our results also show that using smoothing in combination with penalty function yields a cumulative effect on convergence speed-ups.
30
New variants of bundle methods
Claude Lemaréchal, Arkadi Nemirovski, Yurii Nesterov · Mathematical Programming · 1995 · 399 citations