IEEE Transactions on Signal Processing · 2016 · 14 citations · 59 references
Natural SciencesMathematicsOptimizationProbability TheoryStatisticsEstimation TheoryLikelihood EstimationMaximum Likelihood EstimationParameter EstimationParameter Estimation Under UncertaintyStatistical InferenceDeterministic EstimationDeterministic ModelsLower BoundsMaximum Likelihood EstimatorNonstandard ModelsProbability Density Function EstimationProbability Density Function ModelingRelative Performance Analysis
We consider deterministic parameter estimation and the situation where the probability density function (p.d.f.) parameterized by unknown deterministic parameters results from the marginalization of a joint p.d.f. depending on random variables as well. Unfortunately, in the general case, this marginalization is mathematically intractable, which prevents from using the known standard deterministic lower bounds (LBs) on the mean squared error (MSE). Actually the general case can be tackled by embedding the initial observation space in a hybrid one where any standard LB can be transformed into a modified one fitted to nonstandard deterministic estimation, at the expense of tightness however. Furthermore, these modified LBs (MLBs) appears to include the submatrix of hybrid LBs which is an LB for the deterministic parameters. Moreover, since in the nonstandard estimation, maximum likelihood estimators (MLEs) can be no longer derived, suboptimal nonstandard MLEs (NSMLEs) are proposed as being a substitute. We show that any standard LB on the MSE of MLEs has a nonstandard version lower bounding the MSE of NSMLEs. We provide an analysis of the relative performance of the NSMLEs, as well as a comparison with the MLBs for a large class of estimation problems. Last, the general approach introduced is exemplified, among other things, with a new look at the well-known Gaussian complex observation models.
59
Fundamentals of Statistical Signal Processing: Estimation Theory
Sailes K. Sengijpta · Technometrics · 1995 · 11.3K citations
Optimization by Vector Space Methods
Students Quarterly Journal · 1970 · 6.1K citations
Natural Sciences, Industrial Engineering, Design Optimization +6
Mathematical Methods of Statistics.
R. C. Geary, H. Leslie Cramer · The Economic Journal · 1947 · 6K citations
The EM Algorithm and Extensions
Debashis Kushary, Geoffrey J. McLachlan, Thriyambakam Krishnan · Technometrics · 1998 · 5.1K citations