2003 · 481 citations · 19 references
ComputingComputer ScienceComputational LinguisticsInformation RetrievalNatural Language ProcessingDuplicate DetectionInformation ExtractionNamed Entity RecognitionQuery ProcessingString AlgorithmsText Similarity AnalysisComparatorsDistance MetricsEdit DistanceEntity MatchingMatching AlgorithmsNamed Entity AlignmentNamed Entity MatchingSimilarity Detection
We describe an open-source Java toolkit of methods for matching names and records. We summarize results obtained from using various string distance metrics on the task of matching entity names. These metrics include distance functions proposed by several different communities, such as edit-distance metrics, fast heuristic string comparators, token-based distance metrics, and hybrid methods. We then describe an extension to the toolkit which allows records to be compared. We discuss some issues involved in performing a similar comparision for record-matching techniques, and finally present results for some baseline record-matching algorithms that aggregate string comparisons between fields.
19
Ivan P. Fellegi, A. B. Sunter · Journal of the American Statistical Association · 1969 · 2.4K citations