Natural SciencesMathematicsInformation TheoryOptimizationProbability TheoryConstrained OptimizationConvex OptimizationDensity EstimationEntropyLikelihood EstimationMaximum Likelihood EstimationConcavity AnalysisConstrained Maximum Likelihood EstimationEntropy MaximizationLog-concave Density EstimationMaximum Entropy EstimationRényi EntropyShannon Entropy
Abstract. Maximum likelihood estimation of a log-concave probability density is formulated as a convex optimization problem and shown to have an equivalent dual formulation as a constrained maximum Shannon entropy problem. Closely related maximum Renyi entropy estimators that impose weaker concavity restrictions on the fitted density are also considered, notably a minimum Hellinger discrepancy estimator that constrains the reciprocal of the square-root of the density to be concave. A limiting form of these estimators constrains solutions to the class of quasi-concave densities. 1.
43
On Measures of Entropy and Information
A. Rényi · Project Euclid (Cornell University) · 1961 · 4K citations
Biometrika · 1908 · 3.9K citations
Density Estimation for Statistics and Data Analysis
Khosrow Dehnad, Bernard W. Silverman · Technometrics · 1987 · 3.8K citations