SIAM Journal on Applied Mathematics · 1978 · 82 citations · 15 references
BusinessBiostatisticsOptimizationStatistical ModelingStochastic ModelingDensity EstimationInferential StatisticsLikelihood EstimationMaximum Likelihood EstimationStatistical InferenceIterative Maximum Likelihood AlgorithmsLikelihood ApproximationLikelihood EquationsLikelihood For Mixture ModelsOptimal Convergence Rates
This paper addresses the problem of obtaining numerically maximum-likelihood estimates of the parameters for a mixture of normal distributions. In recent literature, a certain successive-approximations procedure, based on the likelihood equations, was shown empirically to be effective in numerically approximating such maximum-likelihood estimates; however, the reliability of this procedure was not established theoretically. Here, we introduce a general iterative procedure, of the generalized steepest-ascent (deflected-gradient) type, which is just the procedure known in the literature when the step-size is taken to be 1. We show that, with probability 1 as the sample size grows large, this procedure converges locally to the strongly consistent maximum-likelihood estimate whenever the step-size lies between 0 and 2. We also show that the step-size which yields optimal local convergence rates for large samples is determined in a sense by the “separation” of the component normal densities and is bounded below by a number between 1 and 2.
15
Optimization by Vector Space Methods
Students Quarterly Journal · 1970 · 6.1K citations
Natural Sciences, Industrial Engineering, Design Optimization +6
Mathematical Methods of Statistics.
R. C. Geary, H. Leslie Cramer · The Economic Journal · 1947 · 6K citations