2005 · 64 citations · 27 references
ComputingInformation SystemsInformation TechnologyData ManagementDatabasesKnowledge RepresentationData IntegrationData MappingMappingQuery ProcessingSensor IntegrationAccuracyContinuous MonitoringData Integration SystemsDeploymentMapping MaintenanceSchema MatchingSensor-based Mapping
Data integration systems rely on semantic mappings, but source changes frequently invalidate them, requiring ongoing monitoring by administrators. This work introduces MAVERIC, an automated system designed to detect broken mappings and alleviate the labor‑intensive monitoring bottleneck. MAVERIC employs inexpensive sensors that capture source characteristics, trains and deploys them, and incorporates perturbation, multi‑source training, and filtering to enhance detection accuracy and reduce false alarms. Experiments on 114 real‑world sources across six domains demonstrate that MAVERIC outperforms existing solutions and that its improvements significantly boost performance.
To answer user queries, a data integration system employs a set of semantic mappings between the mediated schema and the schemas of data sources. In dynamic environments sources often undergo changes that invalidate the mappings. Hence, once the system is deployed, the administrator must monitor it over time, to detect and repair broken mappings. Today such continuous monitoring is extremely labor intensive, and poses a key bottleneck to the widespread deployment of data integration systems in practice.We describe MAVERIC, an automatic solution to detecting broken mappings. At the heart of MAVERIC is a set of computationally inexpensive modules called sensors, which capture salient characteristics of data sources (e.g., value distributions, HTML layout properties). We describe how MAVERIC trains and deploys the sensors to detect broken mappings. Next we develop three novel improvements: perturbation (i.e., injecting artificial changes into the sources) and multi-source training to improve detection accuracy, and filtering to further reduce the number of false alarms. Experiments over 114 real-world sources in six domains demonstrate the effectiveness of our sensor-based approach over existing solutions, as well as the utility of our improvements.
27
A survey of approaches to automatic schema matching
Erhard Rahm, Philip A. Bernstein · The VLDB Journal · 2001 · 3.3K citations · Full text
Wrapper induction for information extraction
Nicholas Kushmerick, Daniel S. Weld · 1997 · 1K citations
Jianjun Chen, David J. DeWitt, Feng Tian et al. · ACM SIGMOD Record · 2000 · 1K citations