Concepedia

SHadoop: Improving MapReduce performance by optimizing job execution mechanism in Hadoop clusters

Rong Gu, Xiaoliang Yang, Jinshuang Yan, Yuanhao Sun, Bing Wang, Chunfeng Yuan, Yihua Huang

Journal of Parallel and Distributed Computing · 2013 · 91 citations · 23 references

Concepts

ComputingComputer ScienceComputer SystemsCluster ComputingDistributed SystemsParallel ComputingCompute Resource ManagementData ParallelismDistributed Data ProcessingJob SchedulingResource SchedulingWorkload SchedulingDistributed Job ExecutionJob QueuesMapreduceMapreduce AlgorithmsParallel Data ProcessingParallel Job SchedulingParallel Performance Optimization

References

23

MapReduce

Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text

Computing, Computer Science, Computer Systems +17

Christopher Olston, Benjamin Reed, Utkarsh Srivastava et al. · 2008 · 1.7K citations

Computing, Computer Science, Databases +16

Improving MapReduce performance in heterogeneous environments

Matei Zaharia, Andy Konwinski, Anthony D. Joseph et al. · UC Berkeley · 2008 · 1.6K citations

Computing, Computer Science, Computer Systems +17

Hive

Ashish Thusoo, Joydeep Sen Sarma, Namit Jain et al. · Proceedings of the VLDB Endowment · 2009 · 1.5K citations

Computing, Computer Science, Computer Systems +12

The HiBench benchmark suite: Characterization of the MapReduce-based data analysis

Shengsheng Huang, Jie Huang, Jinquan Dai et al. · 2010 · 711 citations

Computing, Computer Science, High-performance Computing +14