National Conference on Artificial Intelligence · 1997 · 48 citations · 10 references
ComputingComputer ScienceData ScienceBayesian Data AnalysisMachine LearningStatistical LearningBayesian InferenceBayesian LearningBayesian ModelingBayesian StatisticsMissing Data HandlingMissing Data MethodsBayesian Network Structure LearningBayesian NetworksData ImputationExpectation-maximization ImputationHandling Missing ValuesIterative ImputationMissing Data InferenceMissing Value Imputation
Much of the current research in learning Bayesian Networks fails to effectively deal with missing data. Most of the methods assume that the data is complete, or make the data complete using fairly ad-hoc methods; other methods do deal with missing data but learn only the conditional probabilities, assuming that the structure is known. We present a principled approach to learn both the Bayesian network structure as well as the conditional probabilities from incomplete data. The proposed algorithm is an iterative method that uses a combination of Expectation-Maximization (EM) and Imputation techniques. Results are presented on synthetic data sets which show that the performance of the new algorithm is much better than ad-hoc methods for handling missing data.
10
On Information and Sufficiency
S. Kullback, R. A. Leibler · The Annals of Mathematical Statistics · 1951 · 20K citations · Full text