Proceedings of the ACM on Management of Data · 2023 · 30 citations · 17 references
ComputingComputer ScienceComputer SystemsAlgorithmsDatabasesMachine LearningOptimization For Machine LearningParameter OptimizationParametric OptimizationQuery OptimizationQuery ProcessingRobust OptimizationCost ModelsCost-based Query OptimizationQuery Latency OptimizationQuery Performance OptimizationQuery Performance PredictionQuery Performance Tuning
Most existing parametric query optimization (PQO) techniques rely on traditional query optimizer cost models, which are often inaccurate and result in suboptimal query performance. We propose Kepler, an end-to-end learning-based approach to PQO that demonstrates significant speedups in query latency over a traditional query optimizer. Central to our method is Row Count Evolution (RCE), a novel plan generation algorithm based on perturbations in the sub-plan cardinality space. While previous approaches require accurate cost models, we bypass this requirement by evaluating candidate plans via actual execution data and training anML model to predict the fastest plan given parameter binding values. Our models leverage recent advances in neural network uncertainty in order to robustly predict faster plans while avoiding regressions in query performance. Experimentally, we show that Kepler achieves significant improvements in query runtime on multiple datasets on PostgreSQL.
17
Grigorios Tsoumakas, Ioannis Katakis · International Journal of Data Warehousing and Mining · 2007 · 2.5K citations
How good are query optimizers, really?
Viktor Leis, Andrey Gubichev, Atanas Mirchev et al. · Proceedings of the VLDB Endowment · 2015 · 673 citations · Full text
Djellel Difallah, Andrew Pavlo, Carlo Curino et al. · Proceedings of the VLDB Endowment · 2013 · 383 citations
Deep Reinforcement Learning for Join Order Enumeration
Ryan Marcus, Olga Papaemmanouil · 2018 · 217 citations · Full text
Learning-based Query Performance Modeling and Prediction
Mert Akdere, Uğur Çetintemel, Matteo Riondato et al. · 2012 · 213 citations