RWTH Publications (RWTH Aachen) · 2011 · 22 citations · 14 references
ComputingInformation SystemsInformation TechnologyData EngineeringData ManagementQuality EngineeringData ModelingData QualityDescription LogicsFormal OntologyOntology EngineeringQuery ProcessingData Quality MetadataData Quality ModelingData Quality RulesData Stream ProcessingQuery EvaluationQuery-level EvaluationReal-time Traffic Information SystemsSemantic Rules
Data Stream Management Systems (DSMS) have been proposed to address the challenges of applications which produce continuous, rapid streams of data that have to be processed in real-time. Data quality (DQ) plays an important role in DSMS as there is usually a trade-off between accuracy and consistency on the one hand, and timeliness and completeness on the other hand. Previous work on data quality in DSMS has focused only on specific aspects of DQ. In this paper, we present a flexible, holistic ontology-based data quality framework for data stream applications. Our DQ model is based on a threefold notion of DQ. First, content-based evaluation of DQ uses semantic rules which can be user- defined in an extensible ontology. Second, query-based evaluation adds DQ information to the query results and updates it while queries are being processed. Third, the application-based evaluation can use any kind of function which computes an application-specific DQ value. The whole DQ process is driven by the metadata managed in an ontology which provides a semantically clear definition of the DQ features of the DSMS. The evaluation of our approach in two case studies in the domain of traffic information systems has shown that our framework provides the required flexibility, extensibility, and performance for DQ management in DSMS.
14
Models and issues in data stream systems
Brian Babcock, Shivnath Babu, Mayur Datar et al. · 2002 · 2.5K citations
Aurora: a new model and architecture for data stream management
Daniel J. Abadi, Don Carney, Ugur �etintemel et al. · The VLDB Journal · 2003 · 1.5K citations
Diane M. Strong, Yang W. Lee, Richard Y. Wang · Communications of the ACM · 1997 · 1.2K citations · Full text
Computing, Information Systems, Management Information Systems +7
The Design of the Borealis Stream Processing Engine
Daniel J. Abadi, Yanif Ahmad, Magdalena Bałazińska et al. · 2005 · 1.2K citations