IEEE Transactions on Systems Man and Cybernetics Part B (Cybernetics) · 2008 · 29 citations · 49 references
ComputingComputer ScienceComputer VisionMachine LearningStatistical LearningDimension ReductionDimensionality ReductionFace RecognitionImage ClassificationPattern RecognitionSupport Vector MachinesFeature Dimensionality ReductionLinear Discriminant AnalysisSingularity ProblemSvms
Linear discriminant analysis (LDA) as a dimension reduction method is widely used in classification such as face recognition. However, it suffers from the small sample size (SSS) problem when data dimensionality is greater than the sample size, as in images where features are high dimensional and correlated. In this paper, we propose to address the SSS problem in the framework of statistical learning theory. We compute linear discriminants by regularized least squares regression, where the singularity problem is resolved. The resulting discriminants are complete in that they include both regular and irregular information. We show that our proposal and its nonlinear extension belong to the same framework where powerful classifiers such as support vector machines are formulated. In addition, our approach allows us to establish an error bound for LDA. Finally, our experiments validate our theoretical analysis results.
49
Yuhai Wu, Vladimir Vapnik · Technometrics · 1999 · 27K citations
Classification and Regression Trees.
Alexander Gordon, Leo Breiman, Jerome H. Friedman et al. · Biometrics · 1984 · 23.9K citations
THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS
Ronald Aylmer Fisher · Annals of Eugenics · 1936 · 14.7K citations · Full text
Solutions of Ill-Posed Problems.
John B. Bell, V. Y. Arsenin · Mathematics of Computation · 1978 · 8.2K citations