SPEEDING UP MATERIALIZED VIEW SELECTION IN DATA WAREHOUSES USING A RANDOMIZED ALGORITHM

Minsoo Lee, Joachim Hammer

International Journal of Cooperative Information Systems · 2001 · 85 citations · 22 references

Concepts

TL;DR

Data warehouses store information from heterogeneous sources and rely on materialized views for efficient querying, making the selection of which views to maintain a critical design task. The study aims to choose a set of materialized views that minimizes overall query response time while respecting a limited maintenance budget. To solve this, the authors employ a genetic algorithm that searches for near‑optimal view sets within OR view graphs, implemented in a prototype that simulates the necessary measurements. The approach yields dramatic time‑complexity gains over heuristic search, consistently producing solutions within 10 % of optimal query benefit while only increasing execution time linearly.

Abstract

A data warehouse stores information that is collected from multiple, heterogeneous information sources for the purpose of complex querying and analysis. Information in the warehouse is typically stored in the form of materialized views, which represent pre-computed portions of frequently asked queries. One of the most important tasks when designing a warehouse is the selection of materialized views to be maintained in the warehouse. The goal is to select a set of views in such a way as to minimize the total query response time over all queries, given a limited amount of time for maintaining the views (maintenance-cost view selection problem). In this paper, we propose an efficient solution to the maintenance-cost view selection problem using a genetic algorithm for computing a near-optimal set of views. Specifically, we explore the maintenance-cost view selection problem in the context of OR view graphs. We show that our approach represents a dramatic improvement in time complexity over existing search-based approaches using heuristics. Our analysis shows that the algorithm consistently yields a solution that lies within 10% of the optimal query benefit while at the same time exhibiting only a linear increase in execution time. We have implemented a prototype version of our algorithm which is used to simulate the measurements used in the analysis of our approach.

References

22