Technometrics · 2005 · 1K citations · 35 references
ComputingComputer ScienceData MiningFeature EngineeringMachine LearningDimension ReductionDimensionality ReductionMultivariate AnalysisOutlier HandlingPrincipal Component AnalysisPrincipal ComponentsProjection PursuitRobust EstimationRobust Principal Component Analysis
In this paper we introduce a new method for robust principal component analysis. Classical PCA is based on the empirical covariance matrix of the data and hence it is highly sensitive to outlying observations. In the past, two robust approaches have been developed. The first is based on the eigenvectors of a robust scatter matrix such as the MCD or an S-estimator, and is limited to relatively low-dimensional data. The second approach is based on projection pursuit and can handle high-dimensional data. Here, we propose the ROBPCA approach which combines projection pursuit ideas with robust scatter matrix estimation. It yields more accurate estimates at non-contaminated data sets and more robust estimates at contaminated data. ROBPCA can be computed fast, and is able to detect exact fit situations. As a byproduct, ROBPCA produces a diagnostic plot which displays and classifies the outliers. The algorithm is applied to several data sets from chemometrics and engineering.
35
Colin Goodall, Ian T. Jolliffe · Technometrics · 1988 · 8.7K citations
Robust Regression and Outlier Detection
Gregory F. Piepel, Peter J. Rousseeuw, Annick M. Leroy · Technometrics · 1989 · 6.2K citations
Least Median of Squares Regression
Peter J. Rousseeuw · Journal of the American Statistical Association · 1984 · 3.6K citations