2019 · 14 citations · 32 references
ComputingComputer ScienceComputer SystemsDistributed SystemsOperating SystemsVirtualizationCachingCompute Resource ManagementCpu SchedulingLatency OptimizationPerformance OptimizationPower ManagementCache Performance ModelingLatency ReductionLatency Trade-offsPower-aware Operating SystemsTail LatencyTail Latency Reduction
Idle-state governors partially turn off idle CPUs, allowing them to go to states known as idle-states to save power. Exiting from these idle-sates, however, imposes delays on the execution of tasks and aggravates tail latency. Menu, the default idle-state governor of Linux, predicts periods of idleness based on the historical data and the disk I/O information to choose proper idle-sates. Our experiments show that Menu can save power, but at the cost of sacrificing tail latency, making Menu an inappropriate governor for data centers that host latency-sensitive applications. In this paper, we present the initial design of Yawn, an idle-state governor that aims to mitigate tail latency without sacrificing power. Yawn leverages online machine learning techniques to predict the idle periods based on information gathered from all parameters affecting idleness, including network I/O, resulting in more accurate predictions, which in turn leads to reduced response times. Preliminary benchmarking results demonstrate that Yawn reduces the 99th latency percentile of Memcached requests by up to 40%.
32
The Case for Energy-Proportional Computing
Luiz André Barroso, Urs Hölzle · Computer · 2007 · 2.5K citations
Luiz André Barroso · Communications of the ACM · 2013 · 1.7K citations
David Meisner, Brian T. Gold, Thomas F. Wenisch · 2009 · 904 citations
Yiping Kang, Johann Hauswald, Cao Gao et al. · 2017 · 681 citations