Zero-latency data warehousing (ZLDWH): the state-of-the-art and experimental implementation approaches

Abstract

Increased data volumes and accelerating update speeds are fundamentally changing the role of the data warehouse in modern businesses. More data, coming in faster, and requiring immediate conversion into decisions means that organizations are confronting the need for a Zero-Latency Data Warehousing. The Zero-Latency Data Warehouse (ZLDWH) is an extended stage in the data warehouse development, which will enable a complete business intelligence process to observe, understand, predict, react to, reorganize, monitor, automate and control feedback loops in the minimal latency. This paper reviews the start-of-the-art of the Zero-Latency Data Warehouse and investigates two experimental approaches towards its implementations. (1) The Grid-based Zero-Latency Data Stream Warehouse (GZLDSWH) with the aim to tackle the resource limitation issues in data stream processing without using approximation approaches. (2) Sense & Response Service Architecture (SARESA) towards a complete Business Intelligence process to sense, interpret, predict, automate and respond to business processes.