1990 · 81 citations · 5 references
ComputingComputer ScienceArtificial IntelligenceMachine LearningStatistical LearningBayesian InferenceBayesian LearningBayesian ModelingBayesian StatisticsNeural NetworksProbabilistic Machine LearningBayes EstimationConvergenceIterative LearningKullback-leibler DivergencePosterior Distribution EstimationPosterior EstimationProbability EstimationStatistical Learning Theory
The authors introduce an error criterion for training which improves the performance of neural nets as posterior probability estimators, as compared to using least squares. The proposed criterion is similar to the Kullback-Leibler information measure and is simple to use. A straightforward iterative algorithm for the minimization of the error criterion which has been shown to have good convergence properties is described. The authors applied the proposed technique to some classification examples and showed it to produce better posterior probability estimates than least squares, especially for low probabilities
5
Information theory and statistics
Journal of the Franklin Institute · 1959 · 7.2K citations
Linear and nonlinear programming.
Mathematics and Computers in Simulation · 1986 · 4.9K citations
Information Theory and Statistics.
Meyer Dwass, S. Kullback · American Mathematical Monthly · 1960 · 1.5K citations