2012 · 55 citations · 11 references
ComputingComputer ScienceData MiningParallel AlgorithmsParallel ComputingData ParallelismDistributed Data ProcessingFrequent Pattern MiningScalable Data MiningAlgorithm Performance EvaluationDistributed Data MiningFrequent Itemset MiningMapreduceMapreduce AlgorithmsMapreduce-based MiningParallel Data MiningParallel Frequent Pattern Mining
Finding frequent itemsets is one of the most important fields of data mining. Apriori algorithm is the most established algorithm for finding frequent itemsets from a transactional dataset; however, it needs to scan the dataset many times and to generate many candidate itemsets. Unfortunately, when the dataset size is huge, both memory use and computational cost can still be very expensive. In addition, single processor’s memory and CPU resources are very limited, which make the algorithm performance inefficient. Parallel and distributed computing are effective strategies for accelerating algorithms performance. In this paper, we have implemented an efficient MapReduce Apriori algorithm (MRApriori) based on HadoopMapReduce model which needs only two phases (MapReduce Jobs) to find all frequent k-itemsets, and compared our proposed MRApriori algorithm with current two existed algorithms which need either one or k phases (k is maximum length of frequent itemsets) to find the same frequent k-itemsets. Experimental results showed that the proposed MRApriori algorithm outperforms the other two algorithms.
11
Data mining: concepts and techniques
Jiawei Han, Micheline Kamber · Choice Reviews Online · 2012 · 28.9K citations
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Haoyuan Li, Yi Wang, Dong Zhang et al. · 2008 · 441 citations
Parallel Implementation of Apriori Algorithm Based on MapReduce