The Design of Multi-Metric Load Balancer for Kubernetes

Abstract

Load balancer is an important component in the distributed system. Load balancing can offload external access to different service instances, thereby increasing the overall system throughput. In kubernetes, the built-in load balancing component functions has few functions, only supports simple static load balancing strategies, and it has design flaws and cannot adapt to complex business needs. For solving those problems, this paper designs a load balancer for kubernetes. In addition to the static load balancing strategy, the load balancer can also dynamically distribute requests based on the running status of the server and applications, such as CPU, network status, and so on. As a result, a more complex dynamic load balancing strategy is implemented, which can more flexibly configure the load balancing strategy according to the actual business needs.