2021 · 36 citations · 32 references
ComputingCloud ComputingComputer SystemsContainerizationEdge ComputingServerless ComputingCold Start PerformanceContainer RuntimesContainerization At The EdgeEdge Serverless ComputingServerless ArchitectureServerless Runtime ManagementAutomatic ScalingCold Start LatencyContainer Performance AnalysisContainer Resource ManagementContainer Runtime ManagementContainersLightweight Container RuntimeServerless Containers
During the past few years, serverless computing has changed the paradigm of application development and deployment in the cloud and edge due to its unique advantages, including easy administration, automatic scaling, built-in fault tolerance, etc. Nevertheless, serverless computing is also facing challenges such as long latency due to the cold start. In this paper, we present an in-depth performance analysis of cold start in the serverless framework and propose HotC, a container-based runtime management framework that leverages the lightweight containers to mitigate the cold start and improve the network performance of serverless applications. HotC maintains a live container runtime pool, analyzes the user input or configuration file, and provides available runtime for immediate reuse. To precisely predict the request and efficiently manage the hot containers, we design an adaptive live container control algorithm combining the exponential smoothing model and Markov chain method. Our evaluation results show that HotC introduces negligible overhead and can efficiently improve the performance of various applications with different network traffic patterns in both cloud servers and edge devices.
32
Rethinking the Inception Architecture for Computer Vision
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe et al. · 2016 · 30.9K citations
Peeking behind the curtains of serverless platforms
Liang Wang, Mengyuan Li, Yinqian Zhang et al. · 2018 · 290 citations
Serverless Computing: An Investigation of Factors Influencing Microservice Performance
Wes Lloyd, Shruti Ramesh, Swetha Chinthalapati et al. · 2018 · 281 citations