The Annals of Statistics · 1996 · 171 citations · 22 references
ComputingComputer ScienceData ScienceMachine LearningStatistical ComputingStatisticsClassificationData PartitioningDensity EstimationSpatial PartitioningComplexityData Classification SchemesHigh-dimensional Density EstimationHistogram AnalysisHistogram Density EstimationMultivariate ClusteringMultivariate Data AnalysisMultivariate Density Estimation
We present general sufficient conditions for the almost sure $L_1$-consistency of histogram density estimates based on data-dependent partitions. Analogous conditions guarantee the almost-sure risk consistency of histogram classification schemes based on data-dependent partitions. Multivariate data are considered throughout. In each case, the desired consistency requires shrinking cells, subexponential growth of a combinatorial complexity measure and sublinear growth of the number of cells. It is not required that the cells of every partition be rectangles with sides parallel to the coordinate axis or that each cell contain a minimum number of points. No assumptions are made concerning the common distribution of the training vectors. We apply the results to establish the consistency of several known partitioning estimates, including the $k_n$-spacing density estimate, classifiers based on statistically equivalent blocks and classifiers based on multivariate clustering schemes.
22
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Classification and Regression Trees.
John Van Ryzin, Leo Breiman, Jerome H. Friedman et al. · Journal of the American Statistical Association · 1986 · 21K citations
Convergence of Stochastic Processes.
Peter M. Robinson, David Pollard · Economica · 1985 · 2.3K citations