IEEE Transactions on Fuzzy Systems · 2016 · 39 citations · 11 references
ComputingData ScienceData MiningInformation TheoryMachine LearningData PartitioningFuzzy LogicMutual InformationCluster AnalysisCluster Evaluation MetricsCluster Validity IndicesClusteringGaussian Mixture ModelsMixture ModelProbabilistic ClusteringSoft Information
Previously, eight popular information-theoretic-based cluster validity indices have been generalized and tested for probabilistic partitions built by the expectation-maximization (EM) algorithm for the Gaussian mixture model. However, the analysis was limited to probabilistic clusters, and there were limited explanations for differences in the performance of the indices. In this paper, we extend the tests to partitions found by fuzzy c-means (FCM) and provide further explanations and insights about the performance of these indices. Of the eight generalized indices, we advocate a normalized version of the soft mutual information cluster validity index (NMI sM) as the best overall choice, as it outperforms the other seven indices for both FCM and EM according to our tests on synthetic and real data. The superiority of NMIsM is most pronounced for datasets with overlapped and/or varying-sized clusters. Finally, we provide a theoretical analysis, which helps explain the superior performance of NMIsM compared with the other three normalizations of soft mutual information.
11
UCI Machine Learning Repository
Arthur Asuncion · Medical Entomology and Zoology · 2007 · 24.4K citations
Algorithms for Clustering Data
Warren S. Sarle, Anil K. Jain, Richard C. Dubes · Technometrics · 1990 · 7.8K citations
Lawrence J. Hubert, Phipps Arabie · Journal of Classification · 1985 · 7.7K citations
Algorithms for clustering data
Bernhard Flury · Journal of Statistical Planning and Inference · 1989 · 6.5K citations