Full text loading...
-
Containerizing Parallel MPI-based HPC Applications
- Publisher: European Association of Geoscientists & Engineers
- Source: Conference Proceedings, Third EAGE Workshop on High Performance Computing for Upstream, Oct 2017, Volume 2017, p.1 - 6
Abstract
Software container technology based on Docker is a lightweight packaging and virtualization technology. These containers are used to package and run the application with all its dependencies in a portable image with minimum requirements. Because of the complexity and dependencies of HPC (High performance computing) applications, this concept can be used to pre-package HPC applications. Although Docker is already used in cloud computing, HPC implementations are lagging due to, what we believe, the nature of most HPC applications: inter-process communications and the shortcomings of spawning containerized MPI-based applications on compute resources. This paper shows our solution for containerizing HPC MPI applications and running them across multiple hosts connected with Infiniband interconnect.