Proceedings of the VLDB Endowment · 2014 · 126 citations · 12 references
ComputingComputer ScienceData ScienceBig Data AnalyticsData ManagementData MiningData IntegrationData QualityData MergingLinked DataMergingRecord Linkage
Record linkage clusters records such that each cluster corresponds to a single distinct real-world entity. It is a crucial step in data cleaning and data integration. In the big data era, the velocity of data updates is often high, quickly making previous linkage results obsolete. This paper presents an end-to-end framework that can incrementally and efficiently update linkage results when data updates arrive. Our algorithms not only allow merging records in the updates with existing clusters, but also allow leveraging new evidence from the updates to fix previous linkage errors. Experimental results on three real and synthetic data sets show that our algorithms can significantly reduce linkage time without sacrificing linkage quality.
12
Swoosh: a generic approach to entity resolution
Omar Benjelloun, Héctor García-Molina, David Menestrina et al. · The VLDB Journal · 2008 · 486 citations
Lise Getoor, Ashwin Machanavajjhala · Proceedings of the VLDB Endowment · 2012 · 334 citations