Michael Hauck, Jens Happe, Ralf Reussner


Scalability and performance are critical quality attributes of applications developed for the cloud. Many of these applications have to support hundreds or thousands of concurrent users with strongly fluctuating workloads. Existing approaches for software performance evaluation do not address the new challenges that arise for applications executed in cloud computing environments. The effects of virtualization on response times, throughput, and resource utilisation as well as the massive number of resources available require new platform and resource models for software performance evaluation. Modelling cloud environments using established approaches for software performance prediction is a cumbersome task that requires a detailed understanding of virtualization techniques and their effect on software performance. Additional complexity comes from the fact that cloud environments may combine multiple virtualization platforms which differ in implementation and performance properties. In this position paper, we propose an approach to infer performance models of cloud computing environments automatically through goal-oriented measurements. The resulting performance models can be directly combined with established model-driven performance prediction approaches. We outline the research challenges that have to be addressed in order to employ the approach for design-time performance predictions of software systems running in cloud computing environments.


  1. Adams, K. and Agesen, O. (2006). A Comparison of Software and Hardware Techniques for x86 Virtualization. In ASPLOS-XII: Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems. ACM.
  2., I. (2006). Amazon EC2. Amazon Elastic Compute Cloud.
  3. Balsamo, S., Di Marco, A., Inverardi, P., and Simeoni, M. (2004). Model-based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering, 30(5):295-310.
  4. Becker, S., Koziolek, H., and Reussner, R. (2009). The Palladio Component Model for Model-driven Performance Prediction. Journal of Systems and Software, 82:3-22.
  5. Cherkasova, L. and Gardner, R. (2005). Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor. In USENIX 2005: Proceedings of the USENIX Annual Technical Conference.
  6. Cherkasova, L., Gupta, D., and Vahdat, A. (2007). Comparison of the Three CPU Schedulers in Xen. SIGMETRICS Performance Evaluation Review, 35(2):42-51.
  7. Gropp, W. and Lusk, E. (1999). Reproducible Measurements of MPI Performance Characteristics. In PVM/MPI 1999: Proceedings of the 6th European PVM/MPI Users' Group Meeting. Springer-Verlag.
  8. Gupta, D., Cherkasova, L., Gardner, R., and Vahdat, A. (2006). Enforcing Performance Isolation Across Virtual Machines in Xen. In Middleware 2006: Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, New York, NY, USA. Springer-Verlag.
  9. Happe, J., Becker, S., Rathfelder, C., Friedrich, H., and Reussner, R. H. (2010). Parametric Performance Completions for Model-driven Performance Prediction. Performance Evaluation, 67(8):694-716.
  10. Hauck, M., Happe, J., and Reussner, R. H. (2010). Automatic Derivation of Performance Prediction Models for Load-balancing Properties Based on Goal-oriented Measurements. In MASCOTS 2010: Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE Computer Society.
  11. Kalibera, T., Lehotsky, J., Majda, D., Repcek, B., Tomcanyi, M., Tomecek, A., Tuma, P., and Urban, J. (2006). Automated Benchmarking and Analysis Tool. In VALUETOOLS 2006: Proceedings of the 1st International Conference on Performance Evaluation Methodolgies and Tools. ACM.
  12. Koziolek, H. (2010). Performance Evaluation of Component-based Software Systems: A Survey. Performance Evaluation, 67(8):634-658.
  13. Matthews, J. N., Hu, W., Hapuarachchi, M., Deshane, T., Dimatos, D., Hamilton, G., McCabe, M., and Owens, J. (2007). Quantifying the Performance Isolation Properties of Virtualization Systems. In ExpCS 2007: Proceedings of the 2007 Workshop on Experimental Computer Science. ACM.
  14. Menasce, D. (2005). Virtualization: Concepts, Applications, and Performance Modeling. In CMG 2005: Proceedings of the International CMG Conference.
  15. Menasce, D. and Bennani, M. (2006). Autonomic Virtualized Environments. In ICAS 2006: Proceedings of the 2nd International Conference on Autonomic and Autonomous Systems.
  16. Schroeder, B., Wierman, A., and Harchol-Balter, M. (2006). Open Versus Closed: A Cautionary Tale. In NSDI 2006: Proceedings of the 3rd Conference on Networked Systems Design & Implementation. USENIX Association.
  17. Sotomayor, B., Keahey, K., and Foster, I. (2006). Overhead Matters: A Model for Virtual Resource Management. In VTDC 2006: Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing.
  18. Tsouloupas, G. and Dikaiakos, M. D. (2006). Characterization of Computational Grid Resources Using LowLevel Benchmarks. In E-SCIENCE 2006: Proceedings of the 2nd IEEE International Conference on eScience and Grid Computing. IEEE Computer Society.
  19. Wood, T., Cherkasova, L., Ozonat, K., and Shenoy, P. (2008). Profiling and Modeling Resource Usage of Virtualized Applications. In Middleware 2008: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag.
  20. Woodside, C. M., Vetland, V., Courtois, M., and Bayarov, S. (2001). Resource Function Capture for Performance Aspects of Software Components and Sub-Systems. In Performance Engineering, State of the Art and Current Trends, pages 239-256. Springer-Verlag.
  21. Yamasaki, S., Maruyama, N., and Matsuoka, S. (2007). Model-based Resource Selection for Efficient Virtual Cluster Deployment. In VTDC 2007: Proceedings of the 3rd International Workshop on Virtualization Technology in Distributed Computing.
  22. Zheng, T., Woodside, C. M., and Litoiu, M. (2008). Performance Model Estimation and Tracking Using Optimal Filters. IEEE Transactions of Software Engineering, 34(3):391-406.

Paper Citation

in Harvard Style

Hauck M., Happe J. and Reussner R. (2011). TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS . In Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8425-52-2, pages 616-622. DOI: 10.5220/0003387406160622

in Bibtex Style

author={Michael Hauck and Jens Happe and Ralf Reussner},
booktitle={Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},

in EndNote Style

JO - Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
SN - 978-989-8425-52-2
AU - Hauck M.
AU - Happe J.
AU - Reussner R.
PY - 2011
SP - 616
EP - 622
DO - 10.5220/0003387406160622