Towards energy proportional cloud for data processing frameworks

Abstract

Energy efficiency in cloud computing is becoming more and more important for IT operators of data centers. Sev-eral effort to use low power machines in the data center level has been explored. Also, data processing frame-works such as MapReduce and Hadoop are frequently used to process data intensive jobs. However, there have not been an extensive study on the impact of low power computers on such data processing frameworks. Actu-ally, development of low power computers is demanding the architectural paradigm shift for cloud applications. In this paper, we evaluate Apache Hadoop on low power machines and study the feasibility of them in cloud sys-tems. We also propose AnSwer (Augmentation and Sub-stitution), an energy saving method to reduce energy con-sumption by introducing low power machines. In An-Swer, augmentation and substitution complement each other to prevent data loss and to improve overall power consumption. 1