The BigDAWG Polystore System

TLDR

The rise of diverse storage engines and query languages has created a need for polystores, yet challenges remain in query optimization and assigning objects to appropriate engines. The authors propose a polystore architecture that unifies querying across multiple data models and present a prototype developed at the Intel Science and Technology Center for Big Data. They design a polystore system that integrates multiple storage engines, enabling unified queries, and demonstrate it with a prototype implementation.

Abstract

This paper presents a new view of federated databases to address the growing need for managing information that spans multiple data models. This trend is fueled by the proliferation of storage engines and query languages based on the observation that 'no one size fits all'. To address this shift, we propose a polystore architecture; it is designed to unify querying over multiple data models. We consider the challenges and opportunities associated with polystores. Open questions in this space revolve around query optimization and the assignment of objects to storage engines. We introduce our approach to these topics and discuss our prototype in the context of the Intel Science and Technology Center for Big Data