Proceedings of the VLDB Endowment · 2010 · 32 citations · 21 references
ComputingComputer ScienceInformation SystemsData ManagementData MiningDatabasesDuplicate DetectionTransaction Processing SystemsCandidate GenerationComputational EfficiencyEntity DetectionEntity MatchingMatchingPatternsRecord LinkageTransaction Log Analysis
In this paper, we present a new record linkage approach that uses entity behavior to decide if potentially different entities are in fact the same. An entity's behavior is extracted from a transaction log that records the actions of this entity with respect to a given data source. The core of our approach is a technique that merges the behavior of two possible matched entities and computes the gain in recognizing behavior patterns as their matching score. The idea is that if we obtain a well recognized behavior after merge, then most likely, the original two behaviors belong to the same entity as the behavior becomes more complete after the merge. We present the necessary algorithms to model entities' behavior and compute a matching score for them. To improve the computational efficiency of our approach, we precede the actual matching phase with a fast candidate generation that uses a "quick and dirty" matching method. Extensive experiments on real data show that our approach can significantly enhance record linkage quality while being practical for large transaction logs.
21
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
Binary codes capable of correcting deletions, insertions and reversals
V.I. Levenshtein · Soviet physics. Doklady · 1965 · 10.4K citations
N. Ahmed, T. Natarajan, K.R. Rao · IEEE Transactions on Computers · 1974 · 5K citations
Natural Sciences, Computer Science, Electrical Engineering +16
Data mining and knowledge discovery: making sense out of data
U.M. Feyyad · IEEE Expert · 1996 · 4.7K citations