The latent maximum entropy principle

Abstract

We present an extension of Jaynes' maximum entropy principle to handle latent variables. We use an EM algorithm that incorporates nested iterative scaling to approximately calculate maximum entropy solutions for this principle, and give a proof of its convergence.