ON RELATIONSHIPS BETWEEN UNCENTRED AND COLUMN-CENTRED PRINCIPAL COMPONENT ANALYSIS

Jorge Cadima, Ian T. Jolliffe

2009 · 55 citations · 14 references

Concepts

TL;DR

Principal component analysis is traditionally performed on column‑centred data, but in many applications the uncentred data matrix is used directly, yielding an uncentred PCA. This study investigates the relationships between standard column‑centred PCA and its uncentred counterpart. The authors derive exact results and bounds that link the eigenvalues and eigenvectors of the covariance matrix and the non‑central second‑moment matrix, as well as the corresponding principal components, for both analyses. The derived relationships show that the eigenvalues of both matrices contain rich information for comparing the two PCA variants and reveal that the two methods share more commonalities than previously thought.

Abstract

Principal component analysis (PCA) can be seen as a singular value decomposition (SVD) of a column-centred data matrix. In a number of applications, no pre-processing of the data is carried out, and it is the uncentred data matrix that is subjected to an SVD, in what is often called an uncentred PCA. This paper explores the relationships between the results from both the standard, column-centred, PCA, and its uncentred counterpart. In particular, it obtains both exact results and bounds relating the eigenvalues and eigenvectors of the covariation matrices, as well as the principal components, in both types of analysis. These relationships highlight how the eigenvalues of both the covariance matrix and the matrix of non-central second moments contain much information that is highly informative for a comparative assessment of PCA and its uncentred variant. The relations and the examples also suggest that the results of both types of PCA have more in common than might be supposed.

References

14