IEEE Transactions on Image Processing · 1995 · 297 citations · 40 references
ComputingComputer ScienceMathematicsBiomedical ImagingComputer VisionDigital ImagingImage ReconstructionMaximum Likelihood EstimationConvergenceConvergence Rate AnalysisEm AlgorithmGlobal Convergence AnalysisPenalized LikelihoodPenalized Likelihood EstimationPenalized Maximum Likelihood EstimationRandom Coincidences
Most expectation-maximization (EM) type algorithms for penalized maximum-likelihood image reconstruction converge slowly, particularly when one incorporates additive background effects such as scatter, random coincidences, dark current, or cosmic radiation. In addition, regularizing smoothness penalties (or priors) introduce parameter coupling, rendering intractable the M-steps of most EM-type algorithms. This paper presents space-alternating generalized EM (SAGE) algorithms for image reconstruction, which update the parameters sequentially using a sequence of small "hidden" data spaces, rather than simultaneously using one large complete-data space. The sequential update decouples the M-step, so the maximization can typically be performed analytically. We introduce new hidden-data spaces that are less informative than the conventional complete-data space for Poisson data and that yield significant improvements in convergence rate. This acceleration is due to statistical considerations, not numerical overrelaxation methods, so monotonic increases in the objective function are guaranteed. We provide a general global convergence proof for SAGE methods with nonnegativity constraints.
40
William H. Press, Saul A. Teukolsky, William T. Vetterling et al. · 1994 · 15.4K citations
Maximum likelihood estimation via the ECM algorithm: A general framework
Xiao‐Li Meng, Donald B. Rubin · Biometrika · 1993 · 1.8K citations