Embedding Cloud Computing inside Supercomputer Architectures

Patrick Dreher, Mladen Vouk

2016

Abstract

Recently there has been a surge of interest in several prototype software systems that can embed a cloud computing image with user applications into a supercomputer’s hardware architecture. This position paper will summarize these efforts and comment on the advantages of each design and will also discuss some of the challenges that one faces with such software systems. This paper takes the position that specific types of user applications may favor one type of design over another. Different designs may have potential advantages for specific user applications and each design also brings a considerable cost to assure operability and overall computer security. A “one size fits all design” for a cost effective and portable solution for Supercomputer/cloud delivery is far from being a solved problem. Additional research and development should continue exploring various design approaches. In the end several different types of supercomputer/cloud implementations may be needed to optimally satisfy the complexity and diversity of user needs, requirements and security concerns. The authors also recommend that the community recognize a distinction when discussing cluster-type HPC/Cloud versus Supercomputer/Cloud implementations because of the substantive differences between these systems.

References

  1. AbdelBaky, et. al. “Enabling High-Performance Computing as a Service”, Computer, Issue No.10, vol 45, (Oct. (2012) pp 72-80.
  2. Apache VCL (2016), http://vcl.apache.org, and http://vcl.ncsu.edu,
  3. Appavoo, J. Uhlig, V., Stoess, J., Waterland, A., Rosenburg, B., Wisniewski, R., DaSilva, D., Van Hensbergen, E., Steinberg, U, 2010. “Providing a Cloud Network Infrastructure on a Supercomputer”, Science Cloud 2010: 1st Workshop on Scientific Cloud Computing, Chicago, Illinois.
  4. Appavoo, J., Uhlig, V., Waterland, A., Rosenburg, B., Stoess, J., Steinberg, U., DaSilva, D., Wisniewski, B., IBM Research, 2008, http://researcher.watson. ibm.com/researcher/view_group.php?id=1326
  5. Appavoo, J. Uhlig, V., Waterland, A., Rosenburg, B., DaSilva, D., Moreira, J., 2009. "Kittyhawk: Enabling Cooperation and Competition in a Global Shared Computational System", IBM Journal of Research and Development.
  6. Cloud Foundry Warden documentation http://docs. cloudfoundry.org/concepts/architecture/warden.html 2012.
  7. Dreher, P., Mathew, G., 2014. Toward Implementation of a Software Defined Cloud on a Supercomputer. IEEE Transactions on Cloud Computing IEEE 2014 International Conference on Cloud Engineering, Boston, Massachusetts.
  8. Dreher, P., Scullin, W., Vouk, M., 2015. “Toward a Proof of Concept Implementation of a Cloud Infrastructure on the Blue Gene/Q”, International Journal of Grid and High Performance Computing, 7(1), 32-41.
  9. Felter, W., Ferreira, A., Rajamony, R., Rubio, J., 2014 “An updated performance comparison of virtual machines and Linux containers,” IBM Research Report, RC25482.
  10. Higgins, J., Holmes, V., Colin, V., 2015 “Orchestrating Docker Containers in the HPC Environment”, High Performance Computing, Vol 9137, Lecture Notes in Computer science, pp.506-513.
  11. Jacobsen, D., Canon, S., 2015. “Contain This, Unleashing Docker for HPC”, Cray User Group.
  12. Kim, H., Parashar, M., "CometCloud: An Autonomic Cloud Engine." Cloud Computing: Principles and Paradigms., R. Buyya, J. Broberg, and A. Goscinski, eds., Wiley, 2011, pp. 275-297.
  13. M. Parashar et al., Cloud Paradigms and Practices for CDS&E, Research Report, Cloud and Autonomic Computing Center, Rurgers Univ., 2012.
  14. Poettering, L., Sievers, K., Leemhuis. T., 2012. Control centre: The systemd Linux init system. http://www.honline.com/open/features/Control-Centre-Thesystemd-Linux-init-system-1565543.html
  15. Shae, Z, et. al., “On the Design of a Deep Computing Service Cloud”, RC24991 (W1005-053), 2010
  16. Soltesz, S., Potzl, H., Fiuczynski, M., Bavier, A., Peterson, L., 2007 Container-based operating system virtualization: A scalable, high-performance alternative to hypervisors. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, EuroSys 7807, pages 275-287.
  17. Vouk, M., 2008, “Cloud Computing - Issues, Research and implementation”, Journal of Computing and Information Technology, Vol 16(4), pp. 235-246.
  18. Vouk, M., Rindos, A., Averitt, S., Bass, J., Bugaev, M., Peeler, A., Schaffer, H., Sills, E., Stein, S., Thompson, J., Valenzisi, M., 2009. “Using VCL Technology to Implement Distributed Reconfigurable Data Centers and Computational Services for Educational Institutions,” IBM Journal of Research and Development, Vol. 53, No. 4, pp. 2:1-18.
  19. Vouk, M., Sills, E., Dreher, P., 2010, “Integration of High Performance Computing Into Cloud Computing Services”, Handbook of Cloud Computing, ed. Furht and Escalante.
  20. K. Yelick et al., The Magellan Report on Cloud Computing for Science, US Dept. of Energy, 2011; www.nersc.gov/assets/StaffPublications/2012/Magella nFinaIReport.pdf.
Download


Paper Citation


in Harvard Style

Dreher P. and Vouk M. (2016). Embedding Cloud Computing inside Supercomputer Architectures . In Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: CLOSER, ISBN 978-989-758-182-3, pages 296-301. DOI: 10.5220/0005912302960301


in Bibtex Style

@conference{closer16,
author={Patrick Dreher and Mladen Vouk},
title={Embedding Cloud Computing inside Supercomputer Architectures},
booktitle={Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: CLOSER,},
year={2016},
pages={296-301},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005912302960301},
isbn={978-989-758-182-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: CLOSER,
TI - Embedding Cloud Computing inside Supercomputer Architectures
SN - 978-989-758-182-3
AU - Dreher P.
AU - Vouk M.
PY - 2016
SP - 296
EP - 301
DO - 10.5220/0005912302960301