Paper
13 April 2023 Research on application containerized deployment workflow for high performance computing environment
Boyan Li, Lei Zhang, Menglong Hu, Hang Yang, Zhuoheng Lv
Author Affiliations +
Proceedings Volume 12605, 2022 2nd Conference on High Performance Computing and Communication Engineering (HPCCE 2022); 126050S (2023) https://doi.org/10.1117/12.2673281
Event: Second Conference on High Performance Computing and Communication Engineering, 2022, Harbin, China
Abstract
The deployment of scientific computing software in a high-performance computing environment is very complicated and often requires many dependent libraries. How to quickly build a scientific computing environment is very important. Containers provide a flexible way to deploy software due to their lightweight and easy portability. Taking the deployment of material simulation software VASP as an example, this paper proposes a standardized process for building HPC containerized applications. Use Docker and Singularity container technology to realize containerized packaging of applications, solve complex application deployment, and realize the goal of "manufacture once, run anywhere". Based on the original Slurm workload on HPC, combined with the message passing interface technology, it can realize multi-machine parallel processing of containerized jobs in a high-performance environment without changing the user's habit of submitting jobs. The lab part starts with HPL benchmarks and then evaluates the performance of VASP applications on containers and physical machines. Experimental results show that the containerization process is feasible and flexible, and the performance overhead after containerization is within 4%. This research is expected to provide an effective solution for the construction and operation of containerized applications in the high-performance computing field.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Boyan Li, Lei Zhang, Menglong Hu, Hang Yang, and Zhuoheng Lv "Research on application containerized deployment workflow for high performance computing environment", Proc. SPIE 12605, 2022 2nd Conference on High Performance Computing and Communication Engineering (HPCCE 2022), 126050S (13 April 2023); https://doi.org/10.1117/12.2673281
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Parallel computing

Computing systems

Operating systems

Parallel processing

Computer simulations

Back to Top