Neural Information Processing Systems · 2019 · 75 citations · 14 references
Natural SciencesComputer EngineeringComputer ScienceAlgorithmsDesign OptimizationOptimizationMetaheuristic OptimizationMulti-objective Design OptimizationMulti-objective OptimizationMultiobjective OptimizationPower OptimizationBayesian OptimizationMulti-objective Bayesian OptimizationMulti-objective Exploration-exploitation Trade-offsPareto Optimal SetPerformance Trade-off AnalysisPerformance-energy Trade-off Optimization
We consider the problem of multi-objective (MO) blackbox optimization using expensive function evaluations, where the goal is to approximate the true Pareto-set of solutions by minimizing the number of function evaluations. For example, in hardware design optimization, we need to find the designs that trade-off performance, energy, and area overhead using expensive simulations. We propose a novel approach referred to as Max-value Entropy Search for Multi-objective Optimization (MESMO) to solve this problem. MESMO employs an output-space entropy based acquisition function to efficiently select the sequence of inputs for evaluation for quickly uncovering high-quality solutions. We also provide theoretical analysis to characterize the efficacy of MESMO. Our experiments on several synthetic and real-world benchmark problems show that MESMO consistently outperforms state-of-the-art algorithms.
14
Gradient-based learning applied to document recognition
Yann LeCun, Léon Bottou, Yoshua Bengio et al. · Proceedings of the IEEE · 1998 · 58.2K citations · Full text
Random Features for Large-Scale Kernel Machines
Ali Rahimi, Benjamin Recht · 2007 · 2.7K citations