Applied Sciences · 2024 · 18 citations · 24 references
ComputingCloud ComputingComputer SystemsCloud ArchitectureCloud InfrastructureCloud Performance OptimizationCloud Resource ManagementCompute Resource ManagementPerformance OptimizationPerformance TuningResource ProvisioningScalability ArchitectureAutoscalingAutoscaling OptimizationCloud Computing ArchitecturesLoad Profile ModelingMaximum Entropy PrincipleResource Utilization OptimizationThreshold Parameter EstimationWorkload
In the context of scaling a business-critical medical service that involves electronic medical record storage deployed in Kubernetes clusters, this research addresses the need to optimize the configuration parameters of horizontal pod autoscalers for maintaining the required performance and system load constraints. The maximum entropy principle was used for calculating a load profile to satisfy workload constraints. By observing the fluctuations in the existing workload and applying a kernel estimator to smooth its trends, we propose a methodology for calculating the threshold parameter of a maximum number of pods managed by individual autoscalers. The results obtained indicate significant computing resource savings compared to autoscalers operating without predefined constraints. The proposed optimization method enables significant savings in computational resource utilization during peak loads in systems managed by Kubernetes. For the investigated case study, applying the calculated vector of maximum pod count parameter values for individual autoscalers resulted in about a 15% reduction in the number of instantiated nodes. The findings of this study provide valuable insights for efficiently scaling services while meeting performance demands, thus minimizing resource consumption when deploying to computing clouds. The results enhance our comprehension of resource optimization strategies within cloud-based microservice architectures, transcending the confines of specific domains or geographical locations.
24
Michael Armbrust, Armando Fox, Rean Griffith et al. · Communications of the ACM · 2010 · 9K citations · Full text
On the rationale of maximum-entropy methods
E. T. Jaynes · Proceedings of the IEEE · 1982 · 1.7K citations
Brendan Burns, Brian Grant, David Oppenheimer et al. · Communications of the ACM · 2016 · 573 citations · Full text