Physical review. E · 2017 · 22 citations · 29 references
ComputingNeuroscienceBayesian Data AnalysisComputational NeuroscienceStochastic ProcessesBayesian InferenceBayesian Latent Variable ModelsBayesian StatisticsMaximum Likelihood EstimationNeuronal DynamicsVariational InferenceApproximate Bayesian InferenceEm AlgorithmGlauber ModelIsing ModelL1 RegularizationRegularizationSynaptic StructureVariational Em Algorithm
We consider the inverse Ising problem: the inference of network couplings from observed spin trajectories for a model with continuous time Glauber dynamics. By introducing two sets of auxiliary latent random variables we render the likelihood into a form which allows for simple iterative inference algorithms with analytical updates. The variables are (1) Poisson variables to linearize an exponential term which is typical for point process likelihoods and (2) Pólya-Gamma variables, which make the likelihood quadratic in the coupling parameters. Using the augmented likelihood, we derive an expectation-maximization (EM) algorithm to obtain the maximum likelihood estimate of network parameters. Using a third set of latent variables we extend the EM algorithm to sparse couplings via L1 regularization. Finally, we develop an efficient approximate Bayesian inference algorithm using a variational approach. We demonstrate the performance of our algorithms on data simulated from an Ising model. For data which are simulated from a more biologically plausible network with spiking neurons, we show that the Ising model captures well the low order statistics of the data and how the Ising couplings are related to the underlying synaptic structure of the simulated network.
29
Advances in Neural Information Processing Systems 28
Peter Flach, Meelis Kull · 2015 · 14.7K citations
Pattern Recognition and Machine Learning
Radford M. Neal · Technometrics · 2007 · 4.7K citations
Time-Dependent Statistics of the Ising Model
Roy J. Glauber · Journal of Mathematical Physics · 1963 · 3.6K citations
Weak pairwise correlations imply strongly correlated network states in a neural population
Elad Schneidman, Michael J. Berry, Ronen Segev et al. · Nature · 2006 · 1.9K citations · Full text