Journal of the Royal Statistical Society Series B (Statistical Methodology) · 1994 · 235 citations · 24 references
BusinessBiostatisticsProbability TheoryStatistical ModelingStochastic ModelingBayesian StatisticsLikelihood EstimationMaximum Likelihood EstimationMonte Carlo MethodsMonte Carlo SimulationStatistical InferenceAsymptotic NormalityFisher InformationIntegrability ConditionsLikelihood ApproximationLikelihood TheoryLog-likelihood FunctionsMaximum Likelihood EstimatorMonte Carlo Error Analysis
SUMMARY Monte Carlo maximum likelihood for normalized families of distributions can be used for an extremely broad class of models. Given any family {hθ: θ ∈ θ} of non-negative integrable functions, maximum likelihood estimates in the family obtained by normalizing the functions to integrate to 1 can be approximated by Monte Carlo simulation, the only regularity conditions being a compactification of the parameter space such that the evaluation maps θ → hθ(x) remain continuous. Then with probability 1 the Monte Carlo approximant to the log-likelihood hypoconverges to the exact log-likelihood, its maximizer converges to the exact maximum likelihood estimate, approximations to profile likelihoods hypoconverge to the exact profile and level sets of the approximate likelihood (support regions) converge to the exact sets (in Painlevé-Kuratowski set convergence). The same results hold when there are missing data if a Wald-type integrability condition is satisfied. Asymptotic normality of the Monte Carlo error and convergence of the Monte Carlo approximation to the observed Fisher information are also shown.
24
Equation of State Calculations by Fast Computing Machines
N. Metropolis, Arianna W. Rosenbluth, M. N. Rosenbluth et al. · The Journal of Chemical Physics · 1953 · 37.1K citations
Monte Carlo sampling methods using Markov chains and their applications
W. Keith Hastings · Biometrika · 1970 · 15.2K citations
Markov Chains for Exploring Posterior Distributions
Luke Tierney · The Annals of Statistics · 1994 · 3.5K citations · Full text