Proceedings · 2006 · 371 citations · 35 references
ComputingComputer ScienceData MiningDatabasesKnowledge RepresentationData ModelingEntity-relationship ModelingInformation ExtractionKnowledge ExtractionText MiningEntity ResolutionFirst-order Logic ReasoningGraphical ModelsMarkov Logic Networks
Entity resolution determines which database records refer to the same entities, a crucial yet costly step in data mining that has attracted many ad hoc approaches. The paper proposes an integrated solution to entity resolution using Markov logic. Markov logic merges first‑order logic with probabilistic graphical models by weighting formulas to serve as Markov network feature templates. The authors demonstrate that prior methods can be expressed and integrated in Markov logic, enabling efficient learning and inference, and experiments on two citation databases confirm the approach’s effectiveness and component contributions.
Entity resolution is the problem of determining which records in a database refer to the same entities, and is a crucial and expensive step in the data mining process. Interest in it has grown rapidly, and many approaches have been proposed. However, they tend to address only isolated aspects of the problem, and are often ad hoc. This paper proposes a well-founded, integrated solution to the entity resolution problem based on Markov logic. Markov logic combines first-order logic and probabilistic graphical models by attaching weights to first-order formulas, and viewing them as templates for features of Markov networks. We show how a number of previous approaches can be formulated and seamlessly combined in Markov logic, and how the resulting learning and inference problems can be solved efficiently. Experiments on two citation databases show the utility of this approach, and evaluate the contribution of the different components.
35
David E. Hapeman · Technometrics · 1991 · 9.1K citations
Matthew Richardson, Pedro Domingos · Machine Learning · 2006 · 2.7K citations · Full text
Ivan P. Fellegi, A. B. Sunter · Journal of the American Statistical Association · 1969 · 2.4K citations
Discriminative training methods for hidden Markov models
Michael Collins · 2002 · 1.9K citations · Full text