Proceedings of the 2022 International Conference on Management of Data · 2022 · 50 citations · 29 references
ComputingCloud ComputingComputer ScienceCloud DatabasesDatabasesMachine LearningOptimization For Machine LearningPerformance TuningReinforcement LearningCold-start ProblemConfiguration Space ExplorationConfiguration Space SearchDeep Reinforcement LearningExplorationOnline Machine LearningParallelizationTuning
Recently, using machine learning for performance tuning of cloud database (CDB) service has shown great potentials. However, facing personalized requirements such as various restrictions for tuning with very different workloads, pre-trained models may mismatch or recommend suboptimal configurations given a new workload. On the other hand, if the system tunes configurations in an online fashion, the system will suffer from the cold start problem, resulting in long tuning time and performance fluctuation. To accommodate these problems, we propose an online CDB tuning system called HUNTER. The key feature of HUNTER is a hybrid architecture, which uses samples generated by Genetic Algorithm to warm-start the finer grained exploration of deep reinforcement learning. Meanwhile, we employ Principal Component Analysis, Random Forest, and Fast Exploration Strategy to reduce the search space and the update time of the learning model. In addition, we further propose a clone and parallelization scheme to stress-test workloads on multiple cloned CDB instances (CDBs), resulting in faster and safer configuration exploration. Extensive trials on CDB with public and real-world workloads demonstrate that, given the same time budget and resources, HUNTER improves performance and considerably decreases recommendation time compared to state-of-the-art tuning systems, with accelerations of up to 2.8× and 22.8× utilizing 1 and 20 cloned CDBs, respectively.
29
Deep Reinforcement Learning: A Brief Survey
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage et al. · IEEE Signal Processing Magazine · 2017 · 4.3K citations
Automatic Database Management System Tuning Through Large-scale Machine Learning
Dana Van Aken, Andrew Pavlo, Geoffrey J. Gordon et al. · 2017 · 550 citations · Full text
Ryan Marcus, Parimarjan Negi, Hongzi Mao et al. · Proceedings of the VLDB Endowment · 2019 · 339 citations · Full text
An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning