Aggregate operators in probabilistic databases

Robert Ross, V. S. Subrahmanian, John Grant

Journal of the ACM · 2005 · 81 citations · 26 references

Concepts

TL;DR

Extensions to the relational data model have been proposed to handle probabilistic information, but handling aggregate operators in such databases has received little attention. This article introduces a general notion of an aggregate operator that subsumes classical aggregations (COUNT, SUM, etc.) and statistical operators (percentiles, variance, etc.). We devise a linear‑programming based semantics for computing aggregates over probabilistic DBMSs, develop algorithms that satisfy this semantics, analyze their complexity, and propose several polynomial‑time approximation families. Implementation and empirical testing on a large dataset reveal when each algorithm is preferable.

Abstract

Though extensions to the relational data model have been proposed in order to handle probabilistic information, there has been very little work to date on handling aggregate operators in such databases. In this article, we present a very general notion of an aggregate operator and show how classical aggregation operators (such as COUNT, SUM, etc.) as well as statistical operators (such as percentiles, variance, etc.) are special cases of this general definition. We devise a formal linear programming based semantics for computing aggregates over probabilistic DBMSs, develop algorithms that satisfy this semantics, analyze their complexity, and introduce several families of approximation algorithms that run in polynomial time. We implemented all of these algorithms and tested them on a large set of data to help determine when each one is preferable.

References

26