2014 · 68 citations · 52 references
ComputingComputer ScienceCategorical Data AnalysisData MiningFeature EngineeringClassificationMetric LearningMetric SpacesTaxonomyCategorical Data RepresentationClusteringContext-sensitive AnalysisDistance MeasuresDistance MetricsSimilarity FunctionsSimilarity MeasuresSimilarity Metrics
Similarity or distance between two objects plays a fundamental role in many data mining tasks like classification and clustering. Categorical data, unlike numeric data, conceptually is deficient of default ordering relations on the attribute values. This makes the task of devising similarity or distance metrics and data mining tasks such as classification and clustering of categorical data more challenging. In this paper we formulate a taxonomy of various distance or similarity measures used in conjunction with data whose attributes are categorical. We categorize the existing measures into two broad classes, namely, Context-free and Context-sensitive measures for categorical data. In addition, we suggest a taxonomy of the clustering approaches for categorical data. We also propose a hybrid approach for measuring similarity between objects. We make a relative comparison of the strengths and weaknesses of some of the similarity measures and point out future research directions.
52
A Mathematical Theory of Communication
Claude E. Shannon · Bell System Technical Journal · 1948 · 80.7K citations
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text
Information theory and statistics
Journal of the Franklin Institute · 1959 · 7.2K citations
THE DISTRIBUTION OF THE FLORA IN THE ALPINE ZONE.<sup>1</sup>
Paul Jaccard · New Phytologist · 1912 · 4.5K citations · Full text
Life Sciences, Botany, Ecology +10