Bounding $\bar{d}$-distance by informational divergence: a method to prove measure concentration

K. Marton

The Annals of Probability · 1996 · 281 citations · 6 references

DOIFull text

Open access

Concepts

Abstract

There is a simple inequality by Pinsker between variational distance and informational divergence of probability measures defined on arbitrary probability spaces. We shall consider probability measures on sequences taken from countable alphabets, and derive, from Pinsker's inequality, bounds on the $\bar{d}$-distance by informational divergence. Such bounds can be used to prove the "concentration of measure" phenomenon for some nonproduct distributions.

References

6