Purdue e-Pubs (Purdue University System) · 2006 · 87 citations · 23 references
ComputingComputer ScienceComputer SystemsData ManagementDatabasesProcess ControlDatabase ManagementQuery ProcessingStream ProcessingData Stream Management SystemsData Stream ProcessingData StreamingLoad SheddingQos ManagementStream Query ProcessingStreaming Databases
In Data Stream Management Systems (DSMSs), query processing has to meet various Quality-of-Service (QoS) requirements. In many data stream applications, processing delay is the most critical quality requirement since the value of query results decreases dramatically over time. The ability to remain within a desired level of delay is significantly hampered under situations of overloading, which are common in data stream systems. When overloaded, DSMSs employ load shedding in order to meet quality requirements and keep pace with the high rate of data arrivals. Data stream applications are extremely dynamic due to bursty data arrivals and time-varying data processing costs. Current approaches ignore system status information in decision-making and consequently are unable to achieve desired control of quality under dynamic load. In this paper, we present a quality management framework that leverages well studied feedback control techniques. We discuss the design and implementation of such a framework in a real DSMS- the Borealis stream manager. Our data management framework is built on the advantages of system identification and rigorous controller analysis. Experimental results show that our solution achieves significantly fewer QoS (delay) violations with the same or lower level of data loss, as compared to current strategies utilized in DSMSs. It is also robust and bears negligible computational overhead. 1.
23
Wide area traffic: the failure of Poisson modeling
Vern Paxson, Sally Floyd · IEEE/ACM Transactions on Networking · 1995 · 3.7K citations · Full text
Aurora: a new model and architecture for data stream management
Daniel J. Abadi, Don Carney, Ugur �etintemel et al. · The VLDB Journal · 2003 · 1.5K citations
The Design of the Borealis Stream Processing Engine
Daniel J. Abadi, Yanif Ahmad, Magdalena Bałazińska et al. · 2005 · 1.2K citations
A control-theoretic approach to flow control
Srinivasan Keshav · 1991 · 752 citations · Full text