2023 · 11 citations · 18 references
ComputingComputer EngineeringComputer ScienceEnergy ManagementHeterogeneous ComputingSchedulingContainer OrchestrationHardware AccelerationHeterogeneous System ArchitecturePower ManagementResource SchedulingTask SchedulingAcceleratorsEnergy ConsumptionEnergy-aware Resource SchedulingEnergy-aware SchedulingEnergy-aware Task SchedulingHardware HeterogeneityHardware ResourcesHeterogeneous Task Scheduling
The growing convergence of high-performance, data analytics, and machine-learning applications is increasingly pushing computing systems toward heterogeneous processors and specialized hardware accelerators. Hardware heterogeneity, in turn, leads to finer-grained workflows. State-of-the-art server-less computing resource managers do not currently provide efficient scheduling of such fine-grained tasks on systems with heterogeneous CPUs and specialized hardware accelerators (e.g., GPUs and FPGAs). Working with fine-grained tasks presents an opportunity for more efficient energy use via new scheduling models. Our proposed scheduler enables technologies like Nvidia's Multi-Process Service (MPS) to pack multiple fine-grained tasks on GPUs efficiently. Its advantages include better co-location of jobs and better sharing of hardware resources such as GPUs that were not previously possible on container orchestration systems. We propose a Kubernetes-native energy-aware scheduler that integrates with our heterogeneous framework. Combining fine-grained resource scheduling on heterogeneous hardware and energy-aware scheduling results in up to 17.6% improvement in makespan, up to 20.16% reduction in energy consumption for CPU workloads, and up to 58.15% improvement in makespan, and up to 28.92% reduction in energy consumption for GPU workloads.
18
Deep Residual Learning for Image Recognition
Kaiming He, Xiangyu Zhang, Shaoqing Ren et al. · 2016 · 222.1K citations · Full text
funcX: A Federated Function Serving Fabric for Science
Ryan Chard, Yadu Babuji, Zhuozhao Li et al. · 2020 · 191 citations · Full text
Suresh Marru, Lahiru Gunathilake, Chathura Herath et al. · 2011 · 136 citations