arXiv (Cornell University) · 2020 · 10 citations · 1 references
ComputingComputer ScienceComputer SystemsArtificial IntelligenceMachine LearningSchedulingBuffer ManagementCachingQuery OptimizationQuery ProcessingReinforcement LearningWorkload SchedulingBuffer Pool ManagementCache OptimizationDeep Reinforcement LearningLong-term PerformanceQuery Performance OptimizationQuery SchedulingScheduler DesignScheduling Heuristics
In this extended abstract, we propose a new technique for query scheduling with the explicit goal of reducing disk reads and thus implicitly increasing query performance. We introduce SmartQueue, a learned scheduler that leverages overlapping data reads among incoming queries and learns a scheduling strategy that improves cache hits. SmartQueue relies on deep reinforcement learning to produce workload-specific scheduling strategies that focus on long-term performance benefits while being adaptive to previously-unseen data access patterns. We present results from a proof-of-concept prototype, demonstrating that learned schedulers can offer significant performance improvements over hand-crafted scheduling heuristics. Ultimately, we make the case that this is a promising research direction at the intersection of machine learning and databases.
1
The three pillars of machine programming
Justin Gottschlich, Armando Solar-Lezama, Nesime Tatbul et al. · 2018 · 52 citations