2023 · 28 citations · 52 references
ComputingCloud ComputingComputer ScienceCloud ArchitectureCloud InfrastructureCloud Performance OptimizationCloud Resource ManagementCompute Resource ManagementJob SchedulingResource ProvisioningResource SchedulingWorkload SchedulingBatch Data ProcessingCloud Data CentersCloud Resource Performance ModelingCloud SchedulingCloud Workload ManagementResource Contention ManagementResource Utilization OptimizationResource Utilization Prediction
To fully utilize computing resources, cloud providers such as Google and Alibaba choose to co-locate online services with batch processing applications in their data centers. By implementing unified resource management policies, different types of complex computing jobs request resources in a consistent way, which can help data centers achieve global optimal scheduling and provide computing power with higher quality. To understand this new scheduling paradigm, in this paper, we first present an in-depth study of Alibaba's unified scheduling workloads. Our study focuses on the characterization of resource utilization, the application running performance, and scheduling scalability. We observe that although computing resources are significantly over-committed under unified scheduling, the resource utilization in Alibaba data centers is still low. In addition, existing resource usage predictors tend to make severe overestimations. At the same time, tasks within the same application behave fairly consistently, and the running performance of tasks can be well-profiled with respect to resource contention on the corresponding physical host.
52
Sanjay Ghemawat · Communications of the ACM · 2008 · 18.5K citations · Full text
Vinod Kumar Vavilapalli, Arun C. Murthy, Chris Douglas et al. · 2013 · 1.8K citations
Large-scale cluster management at Google with Borg
Abhishek Verma, Luis Pedrosa, Madhukar Korupolu et al. · 2015 · 1.3K citations · Full text
Heterogeneity and dynamicity of clouds at scale
Charles Reiss, Alexey Tumanov, Gregory R. Ganger et al. · 2012 · 1K citations
Christina Delimitrou, Christos Kozyrakis · 2014 · 698 citations