IEEE Transactions on Information Theory · 2001 · 37 citations · 30 references
ComputingComputer ScienceBayesian Data AnalysisMachine LearningStatistical LearningBayesian InferenceBayesian LearningBayesian StatisticsClassificationPattern RecognitionProbabilistic Machine LearningBayes RiskBayesian ClassificationBayesian ClassifiersConsistencyConvergence Rate AnalysisK-nearest NeighborsOrthogonal ExpansionsProbabilistic Classification
The classical problem of constructing a multidimensional pattern classifier in the Bayesian framework is considered. Preprocessing of the learning sequence by a quasi-inverse of a space-filling curve is proposed and properties of space-filling curves which are necessary to obtain Bayes risk consistency are indicated. The learning sequence transformed into the unit interval is used to estimate the coefficients in an orthogonal expansion of the Bayes decision rule. To transform a new observation into the unit interval requires O(d) elementary operations, where d is the dimension of the observation space. Strong Bayes risk consistency of the classifiers is proved when distributions of the random pair of the observation vector and its class are absolutely continuous with respect to the Lebesgue measure. Attainable convergence rate of the Bayes risk is discussed. Details of the classification algorithm based on the Haar series and its properties are presented. Distribution-free consistency of the classifier is established. The performance of such a classifier is tested both on simulated data and on the standard benchmarks providing misclassification errors comparable to, or even better than the k nearest neighbors (k-NN) method.
30
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
Classification and Regression Trees.
John Van Ryzin, Leo Breiman, Jerome H. Friedman et al. · Journal of the American Statistical Association · 1986 · 21K citations
PE, P. Billingsley · Journal of the American Statistical Association · 1996 · 6.7K citations
Ν. H. Bingham, P. Billingsley · Journal of the Royal Statistical Society Series A (General) · 1980 · 461 citations