arXiv (Cornell University) · 2018 · 13 citations · 33 references
ComputingComputational EngineeringComputational MechanicsComputational PhysicsUncertainty QuantificationMaximum Likelihood EstimationNumerical AlgorithmsNumerical AnalysisContinuous Probability DistributionsContinuous Probability SpacesHigh-dimensional StatisticsImportance Sampling
Erwin Schroedinger posed, and to a large extent solved in 1931/32 the problem of finding the most likely random evolution between two continuous probability distributions. This article considers this problem in the case when only samples of the two distributions are available. A novel iterative procedure is proposed, inspired by Fortet-Sinkhorn type algorithms. Since only samples of the marginals are available, the new approach features constrained maximum likelihood estimation in place of the nonlinear boundary couplings, and importance sampling to propagate the functions $φ$ and $\hatφ$ solving the Schroedinger system. This method is well-suited to high-dimensional settings, where introducing grids leads to numerically unfeasible or unreliable methods. The methodology is illustrated in two applications: entropic interpolation of two-dimensional Gaussian mixtures, and the estimation of integrals through a variation of importance sampling.
33
Information Theory and Statistical Mechanics
E. T. Jaynes · Physical Review · 1957 · 12.9K citations
Sinkhorn Distances: Lightspeed Computation of Optimal Transport
Marco Cuturi · 2013 · 2.2K citations
Maximum entropy spectral analysis
John P. Burg · Medical Entomology and Zoology · 1967 · 1.9K citations
On the rationale of maximum-entropy methods
E. T. Jaynes · Proceedings of the IEEE · 1982 · 1.7K citations