ComputingComputer ScienceData ScienceData MiningStatistical ComputingStatistical ModelingBayesian StatisticsCluster DetectionClustered Data AnalysisDocument ClusteringText ClusteringCluster AnalysisCluster ValidationClusteringCross-validationK-fold Cross-validationK-fold ValidationPenalized LikelihoodProbabilistic Clustering
Finding the "right" number of clusters, k, for a data set is a difficult, and often ill-posed, problem. In a probabilistic clustering context, likelihood-ratios, penalized likelihoods, and Bayesian techniques are among the more popular techniques. In this paper a new cross-validated likelihood criterion is investigated for determining cluster structure. A practical clustering algorithm based on Monte Carlo crossvalidation (MCCV) is introduced. The algorithm permits the data analyst to judge if there is strong evidence for a particular k, or perhaps weaker evidence over a sub-range of k values. Experimental results with Gaussian mixtures on real and simulated data suggest that MCCV provides genuine insight into cluster structure. v-fold cross-validation appears inferior to the penalized likelihood method (BIC), a Bayesian algorithm (AutoClass v2.0), and the new MCCV algorithm. Overall, MCCV and AutoClass appear the most reliable of the methods. MCCV provides the data-miner with a usefu...
14
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection
Ron Kohavi · 1995 · 10.7K citations · Full text
Algorithms for Clustering Data
Warren S. Sarle, Anil K. Jain, Richard C. Dubes · Technometrics · 1990 · 7.8K citations
Model-Based Gaussian and Non-Gaussian Clustering
Jeffrey D. Banfield, Adrian E. Raftery · Biometrics · 1993 · 2.4K citations
Linear Model Selection by Cross-validation
Jun Shao · Journal of the American Statistical Association · 1993 · 1.7K citations