IEEE Transactions on Cybernetics · 2015 · 51 citations · 31 references
ComputingCloud ComputingComputer ScienceDistributed SystemsKnowledge RepresentationMachine LearningBayesian InferenceBayesian LearningBayesian ModelingDistributed ComputingMachine Learning For Big DataProbabilistic Machine LearningData-intensive ComputingDistributed Machine LearningGraphical Model LearningIncremental LearningMapreduceMapreduce AlgorithmsMinimum Description LengthParallel Inference
Bayesian network (BN) has been adopted as the underlying model for representing and inferring uncertain knowledge. As the basis of realistic applications centered on probabilistic inferences, learning a BN from data is a critical subject of machine learning, artificial intelligence, and big data paradigms. Currently, it is necessary to extend the classical methods for learning BNs with respect to data-intensive computing or in cloud environments. In this paper, we propose a parallel and incremental approach for data-intensive learning of BNs from massive, distributed, and dynamically changing data by extending the classical scoring and search algorithm and using MapReduce. First, we adopt the minimum description length as the scoring metric and give the two-pass MapReduce-based algorithms for computing the required marginal probabilities and scoring the candidate graphical model from sample data. Then, we give the corresponding strategy for extending the classical hill-climbing algorithm to obtain the optimal structure, as well as that for storing a BN by <key, value> pairs. Further, in view of the dynamic characteristics of the changing data, we give the concept of influence degree to measure the coincidence of the current BN with new data, and then propose the corresponding two-pass MapReduce-based algorithms for BNs incremental learning. Experimental results show the efficiency, scalability, and effectiveness of our methods.
31
Artificial intelligence: a modern approach
Choice Reviews Online · 1995 · 22.2K citations · Full text
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text