Journal of the Royal Statistical Society Series B (Statistical Methodology) · 2012 · 15 citations · 42 references
ComputingComputer ScienceAlgorithmsComputational PhysicsOptimizationMaximum Likelihood EstimationNumerical AlgorithmsNumerical AnalysisNumerical Linear AlgebraConditional ExpectationConvergenceEm AlgorithmExpectation-maximizationExpectation-maximization Algorithm
Summary The ‘expectation–conditional maximization either’ (ECME) algorithm has proven to be an effective way of accelerating the expectation–maximization algorithm for many problems. Recognizing the limitation of using prefixed acceleration subspaces in the ECME algorithm, we propose a dynamic ECME (DECME) algorithm which allows the acceleration subspaces to be chosen dynamically. The simplest DECME implementation is what we call DECME-1, which uses the line that is determined by the two most recent estimates as the acceleration subspace. The investigation of DECME-1 leads to an efficient, simple, stable and widely applicable DECME implementation, which uses two-dimensional acceleration subspaces and is referred to as DECME-2. The fast convergence of DECME-2 is established by the theoretical result that, in a small neighbourhood of the maximum likelihood estimate, it is equivalent to a conjugate direction method. The remarkable accelerating effect of DECME-2 and its variant is also demonstrated with several numerical examples.
42
R: A Language and Environment for Statistical Computing
R Core Team · 2000 · 353K citations · Full text
Natural Sciences, Computer Science, Statistical Computing +10
Pattern Recognition and Machine Learning
Journal of Electronic Imaging · 2007 · 22.1K citations
The EM Algorithm and Extensions
Debashis Kushary, Geoffrey J. McLachlan, Thriyambakam Krishnan · Technometrics · 1998 · 5.1K citations