SIAM Journal on Mathematics of Data Science · 2021 · 10 citations · 33 references
Public HealthData ScienceCausal InferenceOptimizationTime Series AnalysisCausal Graphical ModelsComputational Time Series AnalysisGeneralized Linear ModelsTime Series ModelingCausalityGranger Causality AnalysisGranger Causality NetworksHigh-dimensional Time SeriesHigh-dimensional Time Series AnalysisMixture Distribution ModelingMultivariate Time Series ModelingNonconvex Optimization
We present a framework for learning Granger causality networks for multivariate categorical time series based on the mixture transition distribution (MTD) model. Traditionally, MTD is plagued by a nonconvex objective, non-identifiability, and presence of local optima. To circumvent these problems, we recast inference in the MTD as a convex problem. The new formulation facilitates the application of MTD to high-dimensional multivariate time series. As a baseline, we also formulate a multi-output logistic autoregressive model (mLTD), which while a straightforward extension of autoregressive Bernoulli generalized linear models, has not been previously applied to the analysis of multivariate categorial time series. We establish identifiability conditions of the MTD model and compare them to those for mLTD. We further devise novel and efficient optimization algorithms for MTD based on our proposed convex formulation, and compare the MTD and mLTD in both simulated and real data experiments. Finally, we establish consistency of the convex MTD in high dimensions. Our approach simultaneously provides a comparison of methods for network inference in categorical time series and opens the door to modern, regularized inference with the MTD model.
33
High dimensional graphs and variable selection with the Lasso
2006 · 2.7K citations
David R. Hunter, Kenneth Lange · The American Statistician · 2004 · 1.8K citations
Efficient projections onto the<i>l</i><sub>1</sub>-ball for learning in high dimensions
John C. Duchi, Shai Shalev‐Shwartz, Yoram Singer et al. · 2008 · 1.2K citations