Physical Review Letters · 2009 · 1.1K citations · 24 references
EngineeringNeuroscienceCausal InferenceEconometricsInformation TheoryGaussian Process ModelingGaussian ProcessesInformation MeasuresCausal Inference From DataCausal RelationshipsCausalityGaussian DistributionsInformation Theory In NeuroscienceTransfer EntropyVector Autoregression
Granger causality, a statistical measure of causal influence via vector autoregression, originated in econometrics and is now used in neuroscience, while transfer entropy, an information‑theoretic measure of directed information transfer, has similarly gained traction, and although their relationship has been suspected, it has not been formally described. The study demonstrates that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, linking autoregressive and information‑theoretic causal inference. The authors find that this mathematical equivalence provides a unified framework for data‑driven causal inference.
Granger causality is a statistical notion of causal influence based on prediction via vector autoregression. Developed originally in the field of econometrics, it has since found application in a broader arena, particularly in neuroscience. More recently transfer entropy, an information-theoretic measure of time-directed information transfer between jointly dependent processes, has gained traction in a similarly wide field. While it has been recognized that the two concepts must be related, the exact relationship has until now not been formally described. Here we show that for Gaussian variables, Granger causality and transfer entropy are entirely equivalent, thus bridging autoregressive and information-theoretic approaches to data-driven causal inference.
24
Probability, Random Variables, and Stochastic Processes
Irwin Miller, Anthanasios Papoulis · Technometrics · 1966 · 6.5K citations
Engineering, Mathematics, Physics +14
Causality: Models, Reasoning and Inference
Christopher Hitchcock, Judea Pearl · The Philosophical Review · 2001 · 4.8K citations