Proceedings of the VLDB Endowment · 2020 · 37 citations · 17 references
ComputingInformation SystemsVisualizationData VisualizationDatabasesInteractive VisualizationHigh-dimensional Data VisualizationInteractive Data AnalysisInteractive Data ExplorationVisual Data ExplorationVisual QueryingExploratory Data Analysis InterfacesExpressive RangeInteractive Data VisualizationInteractive Visual AnalyticsMultidimensional ModelsVisual LanguageVisual Query InterfacesVisual Query Systems
In this paper, we describe the Polaris distributed SQL query engine in Azure Synapse. It is the result of a multi-year project to re-architect the query processing framework in the SQL DW parallel data warehouse service, and addresses two main goals: (i) converge data warehousing and big data workloads, and (ii) separate compute and state for cloud-native execution. From a customer perspective, these goals translate into many useful features, including the ability to resize live workloads, deliver predictable performance at scale, and to efficiently handle both relational and unstructured data. Achieving these goals required many innovations, including a novel "cell" data abstraction, and flexible, fine-grained, task monitoring and scheduling capable of handling partial query restarts and PB-scale execution. Most importantly, while we develop a completely new scale-out framework, it is fully compatible with T-SQL and leverages decades of investment in the SQL Server single-node runtime and query optimizer. The scalability of the system is highlighted by a 1PB scale run of all 22 TPC-H queries; to our knowledge, this is the first reported run with scale larger than 100TB.
17
Michael Isard, Mihai Budiu, Yuan Yu et al. · 2007 · 2.5K citations
Michael Armbrust, Reynold Xin, Cheng Lian et al. · 2015 · 1.2K citations
M. M. Astrahan, Michael W. Blasgen, Donald D. Chamberlin et al. · ACM Transactions on Database Systems · 1976 · 1K citations · Full text
Ronnie Chaiken, B. Keith Jenkins, Per-Åke Larson et al. · Proceedings of the VLDB Endowment · 2008 · 731 citations
Sergey Melnik, Andrey Gubarev, Jing Jing Long et al. · Proceedings of the VLDB Endowment · 2010 · 709 citations