ACM Transactions on Software Engineering and Methodology · 2023 · 44 citations · 31 references
ComputingComputer EngineeringComputer ScienceAlgorithmsMachine LearningOptimizationCombinatorial OptimizationConfiguration SpaceGlobal OptimizationRandomized AlgorithmsStochastic OptimizationConfiguration Space ExplorationConfiguration Space ModelingConfiguration Space SearchConstraintsRandom SamplingRandom Sampling AlgorithmsSoftware Product LinesUniform Random Sampling
A Software Product Line ( SPL ) is a family of similar programs. Each program is defined by a unique set of features, called a configuration , that satisfies all feature constraints. “What configuration achieves the best performance for a given workload?” is the SPL Optimization ( SPLO ) challenge. SPLO is daunting: just 80 unconstrained features yield 10 24 unique configurations, which equals the estimated number of stars in the universe. We explain (a) how uniform random sampling and random search algorithms solve SPLO more efficiently and accurately than current machine-learned performance models and (b) how to compute statistical guarantees on the quality of a returned configuration; i.e., it is within x% of optimal with y% confidence.
31
Classification and regression trees
J. Praagman · European Journal of Operational Research · 1985 · 10.2K citations
Random search for hyper-parameter optimization
James Bergstra, Yoshua Bengio · 2012 · 7.9K citations