Easing Scientific Computing and Federated Management in the Cloud with OCCI

Zdeněk Šustr, Diego Scardaci, Jiří Sitera, Boris Parák, Víctor Méndez Muñoz

2016

Abstract

One of the benefits of OCCI stems from simplifying the life of developers aiming to integrate multiple cloud managers. It provides them with a single protocol to abstract the differences between cloud service implementations used on sites run by different providers. This comes particularly handy in federated clouds, such as the EGI Federated Cloud Platform, which bring together providers who run different cloud management platforms on their sites: most notably OpenNebula, OpenStack, or Synnefo. Thanks to the wealth of approaches and tools now available to developers of virtual resource management solutions, different paths may be chosen, ranging from a small-scale use of an existing command line client or single-user graphical interface, to libraries ready for integration with large workload management frameworks and job submission portals relied on by large science communities across Europe. From lone wolves in the long-tail of science to virtual organizations counting thousands of users, OCCI simplifies their life through standardization, unification, and simplification. Hence cloud applications based on OCCI can focus on user specifications, saving cost and reaching a robust development life-cycle. To demonstrate this, the paper shows several EGI Federated Cloud experiences, demonstrating the possible approaches and design principles.

References

  1. AppDB (2016). [Online] https://appdb.egi.eu/. Accessed: March, 2016
  2. Ardizzone, V., Barbera, R., Calanducci, A., Fargetta, M., Ingrà, E., Porro, I., La Rocca, G., Monforte, S., Ricceri, R., Rotondo, R., Scardaci, D., and Schenone, A. (2012). The decide science gateway. Journal of Grid Computing, 10(4):689-707.
  3. Bencivenni, M., Michelotto, D., Alfieri, R., Brunetti, R., Ceccanti, A., Cesini, D., Costantini, A., Fattibene, E., Gaido, L., Misurelli, G., Ronchieri, E., Salomoni, D., Veronesi, P., Venturi, V., and Vistoli, M. C. (2014). Accessing grid and cloud services through a scientific web portal. Journal of Grid Computing,13(2):159- 175
  4. CANFAR (2016). [Online] http://www.canfar.phys. uvic.ca/canfar/. Accessed: March, 2016
  5. Carusi, A. and Reimer, T. (2010). Virtual research environment collaborative landscape study.
  6. Casajus, A., Graciani, R., Paterson, S., Tsaregorodtsev, A., and the Lhcb Dirac Team (2010). Dirac pilot framework and the dirac workload management system. Journal of Physics: Conference Series, 219(6):062049.
  7. CESNET (2016). rOCCI ec2 backend documentation. [Online] https://wiki.egi.eu/ wiki/rOCCI:EC2 Backend. Accessed: March, 2016
  8. D4Science (2016). [Online] https://www.d4science.org/. Accessed: March 10, 2016.
  9. del Castillo, E. F., Scardaci, D., and Ílvaro Lopéz García (2015). The egi federated cloud e-infrastructure. Procedia Computer Sceince, (68):196-205.
  10. ECEO (2016). [Online] http://www.ca3-uninova.org/ project eceo. Accessed: March, 2016
  11. EGI (2014). Egi federated cloud blueprint. [Online] https:// documents.egi.eu/document/2091. Accessed: March, 2016
  12. EGI-CM (2016). [Online] https://appdb.egi.eu/browse/ cloud. Accessed: March, 2016.
  13. EPOS (2016). [Online] http://www.epos-eu.org/. Accessed: March, 2016.
  14. ESA (2016). [Online] http://www.esa.int/ESA. Accessed: March, 2016.
  15. Fernandez, E., Scardaci, D., Sipos, G., Chen, Y., and Wallom, D. C. (2015). The user support programme and the training infrastructure of the egi federated cloud. In the 2015 International Conference on High Performance Computing & Simulation (HPCS 2015). IEEE.
  16. Fogbow (2016). [Online] http://www.fogbowcloud.org/. Accessed: March, 2016.
  17. Foster, I. and Kesselman, C., editors (1999). The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
  18. Foster, I. T., Zhao, Y., Raicu, I., and Lu, S. (2009). Cloud computing and grid computing 360-degree compared. CoRR, abs/0901.0131.
  19. García, A. L., del Castillo, E. F., and Fern ández, P. O. (2016). ooi: Openstack occi interface. In SoftwareX(2016). ScienceDirect.
  20. GRNET (2016). Synnefo OCCI documentation. [Online] https://www.synnefo.org/docs/snf-occi/latest/. Accessed: March, 2016.
  21. Helix-Nebula (2016). [Online] nebula.eu/. Accessed: Helix-Nebula
  22. Jaghoori, M. M., Altena, A. J. V., Bleijlevens, B., Ramezani, S., Font, J. L., and Olabarriaga, S. D. (2015). A multi-infrastructure gateway for virtual drug screening. Concurrency and Computation: Practice and Experience, 27(16):4478-4490.
  23. Kimle, M., Parák, B., and S?ustr, Z. (2015). jOCCI - general-purpose OCCI client library in java. In ISGC15, The International Symposium on Grids and Clouds 2015. PoS.
  24. Lezzi, D., Lordan, F., Rafanell, R., and Badia, R. M. (2014). Euro-Par 2013: Parallel Processing Workshops: BigDataCloud, DIHC, FedICI, HeteroPar, HiBB, LSDVE, MHPC, OMHI, PADABS, PROPER, Resilience, ROME, and UCHPC 2013, Aachen, Germany, August 26-27, 2013. Revised Selected Papers, chapter Execution of Scientific Workflows on Federated Multi-cloud Infrastructures, pages 136-145. Springer Berlin Heidelberg, Berlin, Heidelberg.
  25. Limmer, S., Srba, M., and Fey, D. (2014). Euro-Par 2014: Parallel Processing Workshops: Euro-Par 2014 International Workshops, Porto, Portugal, August 25-26, 2014, Revised Selected Papers, Part II, chapter Performance Investigation and Tuning in the Interoperable Cloud4E Platform, pages 85-96. Springer International Publishing, Cham.
  26. Méndez, V., Casaju's, A., Graciani, R., and Fernández, V. (2013). How to run scientific applications with dirac in federated hybrid clouds. ADVCOMP.
  27. Mendez, V., Casajus Ramo, A., Graciani Diaz, R., and Tsaregorodstsev, A. (2014). Powering Distributed Applications with DIRAC Engine. In Proceedings of the symposium ”International Symposium on Grids and Clouds (ISGC) 2014”(ISGC2014). 23-28 March, 2014. Academia Sinica, Taipei, Taiwan, page 42.
  28. Metsch, T. and Edmonds, A. (2011a). Open cloud computing interface - http rendering. [Online] http://ogf.org/documents/GFD.185.pdf. Accessed: March 10, 2016.
  29. Metsch, T. and Edmonds, A. (2011b). Open cloud computing interface - infrastructure. [Online] http://ogf.org/documents/GFD.184.pdf. Accessed: March 10, 2016.
  30. Nyrén, R., Edmonds, A., Papaspyrou, A., and Metsch, T. (2011). OCCI specification. [Online] http://occiwg.org/about/specification. Accessed: March, 2016.
  31. Nyrén, R., Edmonds, A., Papaspyrou, A., and Metsch, T. (2011). Open cloud computing interface - core. [Online] http://ogf.org/documents/GFD.183.pdf. Accessed: March, 2016.
  32. occi os (2016). [Online] https://wiki.openstack.org/ wiki/Occi. Accessed: March, 2016.
  33. OGF (2016). Open grid forum. [Online] http://www. ogf.org. Accessed: March, 2016.
  34. Parák, B., S?ustr, Z., Feldhaus, F., Kasprzak, P., and Srba, M. (2014). The rOCCI project - providing cloud interoperability with OCCI 1.1. In ISGC14, The International Symposium on Grids and Clouds 2014. PoS.
  35. Parák, B. and S?ustr, Z. (2014). Challenges in achieving iaas cloud interoperability across multiple cloud management frameworks. In Utility and Cloud Computing (UCC), 2014 IEEE/ACM 7th International Conference on, pages 404-411.
  36. PySSF (2016). [Online] http://pyssf.sourceforge.net/. Accessed: March, 2016.
  37. Slipstream (2016). [Online] http://sixsq.com/products/ slipstream/. Accessed: March, 2016.
  38. VCycle (2016). [Online] https://www.gridpp.ac.uk/vcycle/. Accessed: March, 2016.
  39. VMDirac (2016). [Online] https://github.com/ DIRACGrid/VMDIRAC/wiki. Accessed: March, 2016.
  40. Wallom, D., Turilli, M., Drescher, M., Scardaci, D., and Newhouse, S. (2015). Federating infrastructure as a service cloud computing systems to create a uniform e-infrastructure for research. In IEEE 11th International Conference on e-Science, 2015. IEEE.
  41. Wilkins-Diehr, N. (2007). Special issue: Science gateways - common community interfaces to grid resources. Concurrency and Computation: Practice and Experience, 19(6):743-749.
  42. WS-PGRADE (2016). [Online] https://guse-cloudgateway.sztaki.hu/. Accessed: March, 2016.
Download


Paper Citation


in Harvard Style

Šustr Z., Scardaci D., Sitera J., Parák B. and Muñoz V. (2016). Easing Scientific Computing and Federated Management in the Cloud with OCCI . In Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: OCCI, (CLOSER 2016) ISBN 978-989-758-182-3, pages 347-354. DOI: 10.5220/0005934403470354


in Bibtex Style

@conference{occi16,
author={Zdeněk Šustr and Diego Scardaci and Jiří Sitera and Boris Parák and Víctor Méndez Muñoz},
title={Easing Scientific Computing and Federated Management in the Cloud with OCCI},
booktitle={Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: OCCI, (CLOSER 2016)},
year={2016},
pages={347-354},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005934403470354},
isbn={978-989-758-182-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 6th International Conference on Cloud Computing and Services Science - Volume 2: OCCI, (CLOSER 2016)
TI - Easing Scientific Computing and Federated Management in the Cloud with OCCI
SN - 978-989-758-182-3
AU - Šustr Z.
AU - Scardaci D.
AU - Sitera J.
AU - Parák B.
AU - Muñoz V.
PY - 2016
SP - 347
EP - 354
DO - 10.5220/0005934403470354