Proceedings of the AAAI Conference on Artificial Intelligence · 2016 · 304 citations · 20 references
ComputingComputer ScienceAlgorithmsMachine LearningOptimizationBranch And BoundCombinatorial OptimizationDiscrete OptimizationInteger ProgrammingOptimization For Machine LearningSurrogate-assisted OptimizationBranching AlgorithmsBranching RulesLearning To RankMixed-integer OptimizationMixed-integer ProgrammingOffline TestingParameter TuningSearch Tree Pruning
Branching strategies in mixed integer programming are typically developed through extensive parameter tuning and offline experiments on diverse testbeds, and once designed, they are largely input‑agnostic. The authors propose a machine‑learning framework to improve variable branching in mixed integer programming. The framework observes Strong Branching decisions, extracts features of candidate variables at each node, learns an instance‑specific ranking surrogate via a learning‑to‑rank problem, and applies this surrogate for branching during the branch‑and‑bound search. Experiments on benchmark instances show that the method produces significantly smaller search trees than existing heuristics and is competitive with a state‑of‑the‑art commercial solver.
The design of strategies for branching in Mixed Integer Programming (MIP) is guided by cycles of parameter tuning and offline experimentation on an extremely heterogeneous testbed, using the average performance. Once devised, these strategies (and their parameter settings) are essentially input-agnostic. To address these issues, we propose a machine learning (ML) framework for variable branching in MIP.Our method observes the decisions made by Strong Branching (SB), a time-consuming strategy that produces small search trees, collecting features that characterize the candidate branching variables at each node of the tree. Based on the collected data, we learn an easy-to-evaluate surrogate function that mimics the SB strategy, by means of solving a learning-to-rank problem, common in ML. The learned ranking function is then used for branching. The learning is instance-specific, and is performed on-the-fly while executing a branch-and-bound search to solve the MIP instance. Experiments on benchmark instances indicate that our method produces significantly smaller search trees than existing heuristics, and is competitive with a state-of-the-art commercial solver.
20
Optimizing search engines using clickthrough data
Thorsten Joachims · 2002 · 3.9K citations
Training linear SVMs in linear time
Thorsten Joachims · 2006 · 2K citations
Learning to rank for information retrieval
Tie‐Yan Liu · 2010 · 2K citations
ParamILS: An Automatic Algorithm Configuration Framework
Frank Hutter, Holger H. Hoos, Kevin Leyton‐Brown et al. · Journal of Artificial Intelligence Research · 2009 · 868 citations · Full text