An event driven software architecture for enterprise-wide data source integration

Abstract

This is a work in progress paper where the authors are involved in a telco corporation reengineering project of a half terabyte data warehouse (DW). Firstly the DW context is introduced, focusing in three related and critical issues: the data source integration, component reuse and performance bottlenecks. Then we discuss the actual implicit architecture found in the runtime system, identifying the problems. Finally the proposed architecture is presented. It has two views: a static made with filters and pipes, and a dynamic based on an event driven scheduler, as opposed to a fixed time one. In the runtime scenario, the scheduler reads the pipe configurations from the metadata repository, and then executes on the fly the planned filters, transforming data into business information.