Permutation tests for equality of distributions in high-dimensional settings

Peter Hall

Biometrika · 2002 · 140 citations · 26 references

Concepts

TL;DR

The problem concerns testing equality of two independent high‑dimensional or infinite‑dimensional distributions, where the underlying populations may be very general and the distance measure used need only be symmetric, not a metric. The authors propose a permutation test for the null hypothesis that two sampled distributions are identical, motivated by high‑dimensional applications. The test ranks the pooled data by a chosen distance to each fixed datum, then uses a permutation argument on all pairwise distances to select a critical value that yields a known significance level.

Abstract

Motivated by applications in high‐dimensional settings, we suggest a test of the hypothesis H0 that two sampled distributions are identical. It is assumed that two independent datasets are drawn from the respective populations, which may be very general. In particular, the distributions may be multivariate or infinite‐dimensional, in the latter case representing, for example, the distributions of random functions from one Euclidean space to another. Our test uses a measure of distance between data. This measure should be symmetric but need not satisfy the triangle inequality, so it is not essential that it be a metric. The test is based on ranking the pooled dataset, with respect to the distance and relative to any fixed data value, and repeating this operation for each fixed datum. A permutation argument enables a critical point to be chosen such that the test has concisely known significance level, conditional on the set of all pairwise distances.

References

26