1887

Abstract

Summary

Software container technology based on Docker is a lightweight packaging and virtualization technology. These containers are used to package and run the application with all its dependencies in a portable image with minimum requirements. Because of the complexity and dependencies of HPC (High performance computing) applications, this concept can be used to pre-package HPC applications. Although Docker is already used in cloud computing, HPC implementations are lagging due to, what we believe, the nature of most HPC applications: inter-process communications and the shortcomings of spawning containerized MPI-based applications on compute resources. This paper shows our solution for containerizing HPC MPI applications and running them across multiple hosts connected with Infiniband interconnect.

Loading

Article metrics loading...

/content/papers/10.3997/2214-4609.201702320
2017-10-01
2024-03-29
Loading full text...

Full text loading...

References

  1. A.Bu-khamsin and A.Schonewille
    . Docker for hpc. https://github.com/ambu50/docker-ib-mpi, April 2016.
    [Google Scholar]
  2. P.Di Tommaso, E.Palumbo, M.Chatzou, P.Prieto, M. L.Heuer, and C.Notredame
    . The impact of docker containers on the performance of genomic pipelines. PeerJ, 3:e1273, 2015.
    [Google Scholar]
  3. A. H.Dogru, L. S.Fung, T. M.Al-Shaalan, U.Middya, J. A.Pita, et al.
    From mega cell to giga cell reservoir simulation. In SPE Annual Technical Conference and Exhibition.Society of Petroleum Engineers, 2008.
    [Google Scholar]
  4. W.Felter, A.Ferreira, R.Rajamony, and J.Rubio
    . An updated performance comparison of virtual machines and linux containers. In Performance Analysis of Systems and Software (ISPASS), 2015 IEEE International Symposium On, pages 171–172. IEEE, 2015.
    [Google Scholar]
  5. HPL. High performance linpack
    . http://www.netlib.org/benchmark/hpl, -.
  6. D. M.Jacobsen and R. S.Canon
    . Contain this, unleashing docker for hpc. Proceedings of the Cray User Group, 2015.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/papers/10.3997/2214-4609.201702320
Loading
/content/papers/10.3997/2214-4609.201702320
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error