Granger Causality and Transfer Entropy Are Equivalent for Gaussian Variables

Lionel Barnett, Adam B. Barrett, Anil K. Seth

Physical Review Letters · 2009 · 1.1K citations · 24 references

DOIFull text

Open access

Concepts

TL;DR

Granger causality, a statistical measure of causal influence via vector autoregression, originated in econometrics and is now used in neuroscience, while transfer entropy, an information‑theoretic measure of directed information transfer, has similarly gained traction, and although their relationship has been suspected, it has not been formally described. The study demonstrates that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, linking autoregressive and information‑theoretic causal inference. The authors find that this mathematical equivalence provides a unified framework for data‑driven causal inference.

Abstract

Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.

References

24