Anything to Topology - A Method and System Architecture to Topologize Technology-specific Application Deployment Artifacts

Christian Endres, Uwe Breitenbücher, Frank Leymann, Johannes Wettinger

2017

Abstract

In recent years, many application deployment technologies have emerged such as configuration management tools, e.g., Chef and Juju, infrastructure and platform technologies, e.g., Cloud Foundry and OpenStack, as well as container-based approaches, e.g., Docker. As a result, many repositories exist which contain executable and heavily used artifacts that can be used with these technologies, e.g., to deploy a WordPress application. However, to automate the deployment of more complex applications, typically, multiple of these technologies have to be used in combination. Thus, often, diverse artifacts stored in different repositories need to be integrated. This requires expertise about each technology and leads to a manual, complex, and error-prone integration step. In this paper, we tackle these issues: We present a method and system architecture that enables crawling repositories in order to transform the contained artifacts into technology-agnostic topology models, each describing the components that get installed as well as their dependencies. We show how these topologies can be combined to model the deployment of complex applications and how the resulting topology can be deployed automatically by one runtime. To prove the feasibility, we developed and evaluated a prototype based on the TOSCA standard and conducted a case study for Chef artifacts.

References

  1. Arshad, N., Heimbigner, D., and Wolf, A. L. (2007). Deployment and Dynamic Reconfiguration Planning For Distributed Software Systems. Software Quality Journal, 15(3).
  2. Bellavista, P., Corradi, A., Foschini, L., and Pernafini, A. (2013). Towards an Automated BPEL-based SaaS Provisioning Support for OpenStack IaaS. Scalable Computing, 14(4).
  3. Binz, T., Breitenbücher, U., Haupt, F., Kopp, O., Leymann, F., Nowak, A., and Wagner, S. (2013a). OpenTOSCA - A Runtime for TOSCA-based Cloud Applications. In Proceedings of the 11th International Conference on Service-Oriented Computing. Springer.
  4. Binz, T., Breitenbücher, U., Kopp, O., and Leymann, F. (2013b). Automated Discovery and Maintenance of Enterprise Topology Graphs. In Proceedings of the 6th IEEE International Conference on Service Oriented Computing & Applications. IEEE.
  5. Binz, T., Fehling, C., Leymann, F., Nowak, A., and Schumm, D. (2012a). Formalizing the Cloud through Enterprise Topology Graphs. In Proceedings of 2012 IEEE International Conference on Cloud Computing. IEEE.
  6. Boldi, P., Codenotti, B., Santini, M., and Vigna, S. (2004). Ubicrawler: A Scalable Fully Distributed Web Crawler. Software: Practice and Experience, 34(8).
  7. Breitenbücher, U., Binz, T., Képes, K., Kopp, O., Leymann, F., and Wettinger, J. (2014). Combining Declarative and Imperative Cloud Application Provisioning based on TOSCA. In International Conference on Cloud Engineering. IEEE.
  8. Breitenbücher, U., Binz, T., Kopp, O., Leymann, F., and Schumm, D. (2012). Vino4TOSCA: A Visual Notation for Application Topologies based on TOSCA. In On the Move to Meaningful Internet Systems: OTM 2012. Springer.
  9. Breitenbücher, U., Binz, T., Kopp, O., Leymann, F., and Wettinger, J. (2013). Integrated Cloud Application Provisioning: Interconnecting Service-Centric and Script-Centric Management Technologies. In On the Move to Meaningful Internet Systems: OTM 2013 Conferences. Springer.
  10. Brown, A. B. and Hellerstein, J. L. (2005). Reducing the cost of IT operations: is automation always the answer? In Proceedings of the 10th Conference on Hot Topics in Operating Systems. USENIX.
  11. Chakrabarti, S., Van den Berg, M., and Dom, B. (1999). Focused crawling: A new approach to topic-specific web resource discovery. Computer Networks, 31(11).
  12. Da Silva, A. S., Veloso, E. A., Golgher, P. B., Ribeiro-Neto, B., Laender, A. H., and Ziviani, N. (1999). Cobweb - a crawler for the brazilian web. In Proceedings of the String Processing and Information Retrieval Symposium and International Workshop on Groupware. IEEE.
  13. Edwards, J., McCurley, K., and Tomlin, J. (2001). An adaptive model for optimizing performance of an incremental web crawler. In Proceedings of the 10th International Conference on World Wide Web. ACM.
  14. Eilam, T., Elder, M., Konstantinou, A., and Snible, E. (2011). Pattern-based Composite Application Deployment. In Proceedings of the 12th IFIP/IEEE International Symposium on Integrated Network Management. IEEE.
  15. Heydon, A. and Najork, M. (1999). Mercator: A Scalable, Extensible Web Crawler. World Wide Web, 2(4).
  16. Hirmer, P., Breitenbücher, U., Binz, T., and Leymann, F. (2014). Automatic Topology Completion of TOSCAbased Cloud Applications. In Proceedings des CloudCycle14 Workshops auf der 44. Jahrestagung der Gesellschaft für Informatik e.V.
  17. Keller, A. and Badonnel, R. (2004). Automating the Provisioning of Application Services with the BPEL4WS Workflow Language. In Proceedings of the 15th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management. Springer.
  18. Kopp, O., Binz, T., Breitenbücher, U., and Leymann, F. (2013). Winery - A Modeling Tool for TOSCA-based Cloud Applications. In Proceedings of the 11th International Conference on Service-Oriented Computing. Springer.
  19. Leymann, F. (2009). Cloud Computing: The Next Revolution in IT. In Proceedings of the 52th Photogrammetric Week. Wichmann Verlag.
  20. Leymann, F., Fehling, C., Wagner, S., and Wettinger, J. (2016). Native Cloud Applications: Why Virtual Machines, Images and Containers Miss the Point! In Proceedings of the 6th International Conference on Cloud Computing and Service Science. SciTePress.
  21. Matsudaira, K. (2014). Capturing and structuring data mined from the web. Communications of the ACM, 57(3).
  22. Mietzner, R., Unger, T., and Leymann, F. (2009). Cafe: A Generic Configurable Customizable Composite Cloud Application Framework. In On the Move to Meaningful Internet Systems: OTM 2009. Springer.
  23. Mohaan, M. and Raithatha, R. (2014). Learning Ansible. Packt Publishing.
  24. OASIS (2013a). Topology and Orchestration Specification for Cloud Applications (TOSCA) Primer Version 1.0. Organization for the Advancement of Structured Information Standards (OASIS).
  25. OASIS (2013b). Topology and Orchestration Specification for Cloud Applications (TOSCA) Version 1.0. Organization for the Advancement of Structured Information Standards (OASIS).
  26. OASIS (2015). TOSCA Simple Profile in YAML Version 1.0. Organization for the Advancement of Structured Information Standards (OASIS).
  27. Shkapenyuk, V. and Suel, T. (2002). Design and Implementation of a High-Performance Distributed Web Crawler. In Proceedings of the 18th International Conference on Data Engineering. IEEE.
  28. Tarjan, R. (1972). Depth-first search and linear graph algorithms. SIAM journal on computing, 1(2).
  29. Taylor, M. and Vargo, S. (2014). Learning Chef: A Guide to Configuration Management and Automation . O'Reilly.
  30. Thelwall, M. (2001). A Web Crawler Design for Data Mining. Journal of Information Science, 27(5).
  31. Uphill, T. (2014). Mastering Puppet. Packt Publishing.
  32. Wettinger, J., Binz, T., Breitenbücher, U., Kopp, O., Leymann, F., and Zimmermann, M. (2014a). Unified Invocation of Scripts and Services for Provisioning, Deployment, and Management of Cloud Applications Based on TOSCA. In Proceedings of the 4th International Conference on Cloud Computing and Services Science. SciTePress.
  33. Wettinger, J., Breitenbücher, U., and Leymann, F. (2014b). Standards-based DevOps Automation and Integration Using TOSCA. In Proceedings of the 7th International Conference on Utility and Cloud Computing. IEEE.
  34. Wettinger, J., Breitenbücher, U., and Leymann, F. (2015). Any2API - Automated APIfication. InProceedings of the 5th International Conference on Cloud Computing and Service Science. SciTePress.
Download


Paper Citation


in Harvard Style

Endres C., Breitenbücher U., Leymann F. and Wettinger J. (2017). Anything to Topology - A Method and System Architecture to Topologize Technology-specific Application Deployment Artifacts . In Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-758-243-1, pages 208-218. DOI: 10.5220/0006305302080218


in Bibtex Style

@conference{closer17,
author={Christian Endres and Uwe Breitenbücher and Frank Leymann and Johannes Wettinger},
title={Anything to Topology - A Method and System Architecture to Topologize Technology-specific Application Deployment Artifacts},
booktitle={Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2017},
pages={208-218},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006305302080218},
isbn={978-989-758-243-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - Anything to Topology - A Method and System Architecture to Topologize Technology-specific Application Deployment Artifacts
SN - 978-989-758-243-1
AU - Endres C.
AU - Breitenbücher U.
AU - Leymann F.
AU - Wettinger J.
PY - 2017
SP - 208
EP - 218
DO - 10.5220/0006305302080218