Confliction of the Convexity and Metric Properties in f-Divergences

Mohammadali Khosravifard, Dariush Fooladivanda, T. Aaron Gulliver

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences · 2007 · 27 citations · 4 references

Concepts

Abstract

We prove that the Variational distance (and its positive multiples) is the only f-divergence that satisfies both the identity of indiscernibles and the triangle inequality. Therefore it is the unique f-divergence which serves as a metric. This point is interpreted as a fundamental confliction of the convexity for f(x) with the metric properties for its associated f-divergence. Therefore, we relax the convexity of f(x) and replace it with other constraints to create new metrics.

References

4