Towards a container scheduling policy for alleviating total startup latency in serverless computing platform

Chang Wang; Zhiqiong Liu; Jin Liu; Wang Li; Junxin Chen

doi:10.1117/12.3032003

8 June 2024 Towards a container scheduling policy for alleviating total startup latency in serverless computing platform

Chang Wang, Zhiqiong Liu, Jin Liu, Wang Li, Junxin Chen

Author Affiliations +

Proceedings Volume 13171, Third International Conference on Algorithms, Microchips, and Network Applications (AMNA 2024); 131711W (2024) https://doi.org/10.1117/12.3032003
Event: 3rd International Conference on Algorithms, Microchips and Network Applications (AMNA 2024), 2024, Jinan, China

Abstract

FaaS enables users to focus on developing function codes rather than managing complex infrastructure, as the serverless computing platform takes responsibility for resource management and dynamically scales computing resources for serverless functions. While serverless computing platform provides efficient hardware resource management and provisioning, they suffer from weaker computing performance due to the latency associated with serverless function startup. Startup latency refers to the time required to prepare execution environments for user functions. To alleviate this latency, this paper proposes a container scheduling policy aimed at reducing startup latency by reducing the likelihood of container cold starts. This is achieved by unifying language runtime images, creating pre-warm container pools, and warm containers. We formulate the startup latency problem and implement a scheduling policy in a serverless computing platform. Simulation results demonstrate that our proposed scheduling policy effectively reduces overall startup latency while ensuring optimal computing performance for user functions.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Chang Wang, Zhiqiong Liu, Jin Liu, Wang Li, and Junxin Chen "Towards a container scheduling policy for alleviating total startup latency in serverless computing platform", Proc. SPIE 13171, Third International Conference on Algorithms, Microchips, and Network Applications (AMNA 2024), 131711W (8 June 2024); https://doi.org/10.1117/12.3032003

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available