The Annals of Statistics · 2018 · 103 citations · 90 references
ComputingData ScienceData AnalyticsSpatial StatisticsTime Series AnalysisDimensionality ReductionFactor AnalysisMaximum Likelihood EstimationMultivariate AnalysisPrincipal Component AnalysisStatistical InferenceCovariance EstimationCovariance Matrix ApproximationCovariance Matrix EstimationCovariance StructureHeavy-tailed DistributionsHigh-dimensional Covariance EstimationMatrix NormsRobust Covariance Estimation
We propose a general Principal Orthogonal complEment Thresholding (POET) framework for large-scale covariance matrix estimation based on the approximate factor model. A set of high level sufficient conditions for the procedure to achieve optimal rates of convergence under different matrix norms is established to better understand how POET works. Such a framework allows us to recover existing results for sub-Gaussian data in a more transparent way that only depends on the concentration properties of the sample covariance matrix. As a new theoretical contribution, for the first time, such a framework allows us to exploit conditional sparsity covariance structure for the heavy-tailed data. In particular, for the elliptical distribution, we propose a robust estimator based on the marginal and spatial Kendall's tau to satisfy these conditions. In addition, we study conditional graphical model under the same framework. The technical tools developed in this paper are of general interest to high dimensional principal component analysis. Thorough numerical results are also provided to back up the developed theory.
90
Robust Estimation of a Location Parameter
Peter J. Huber · The Annals of Mathematical Statistics · 1964 · 7K citations · Full text
High-dimensional graphs and variable selection with the Lasso
The Annals of Statistics · 2006 · 2.5K citations · Full text