TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS

Michael Hauck, Jens Happe, Ralf Reussner

2011

Abstract

Scalability and performance are critical quality attributes of applications developed for the cloud. Many of these applications have to support hundreds or thousands of concurrent users with strongly fluctuating workloads. Existing approaches for software performance evaluation do not address the new challenges that arise for applications executed in cloud computing environments. The effects of virtualization on response times, throughput, and resource utilisation as well as the massive number of resources available require new platform and resource models for software performance evaluation. Modelling cloud environments using established approaches for software performance prediction is a cumbersome task that requires a detailed understanding of virtualization techniques and their effect on software performance. Additional complexity comes from the fact that cloud environments may combine multiple virtualization platforms which differ in implementation and performance properties. In this position paper, we propose an approach to infer performance models of cloud computing environments automatically through goal-oriented measurements. The resulting performance models can be directly combined with established model-driven performance prediction approaches. We outline the research challenges that have to be addressed in order to employ the approach for design-time performance predictions of software systems running in cloud computing environments.

References

  1. Adams, K. and Agesen, O. (2006). A Comparison of Software and Hardware Techniques for x86 Virtualization. In ASPLOS-XII: Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems. ACM.
  2. Adams, K. and Agesen, O. (2006). A Comparison of Software and Hardware Techniques for x86 Virtualization. In ASPLOS-XII: Proceedings of the 12th International Conference on Architectural Support for Programming Languages and Operating Systems. ACM.
  3. Amazon.com, I. (2006). Amazon EC2. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.
  4. Amazon.com, I. (2006). Amazon EC2. Amazon Elastic Compute Cloud. http://aws.amazon.com/ec2.
  5. Balsamo, S., Di Marco, A., Inverardi, P., and Simeoni, M. (2004). Model-based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering, 30(5):295-310.
  6. Balsamo, S., Di Marco, A., Inverardi, P., and Simeoni, M. (2004). Model-based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering, 30(5):295-310.
  7. Becker, S., Koziolek, H., and Reussner, R. (2009). The Palladio Component Model for Model-driven Performance Prediction. Journal of Systems and Software, 82:3-22.
  8. Becker, S., Koziolek, H., and Reussner, R. (2009). The Palladio Component Model for Model-driven Performance Prediction. Journal of Systems and Software, 82:3-22.
  9. Cherkasova, L. and Gardner, R. (2005). Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor. In USENIX 2005: Proceedings of the USENIX Annual Technical Conference.
  10. Cherkasova, L. and Gardner, R. (2005). Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor. In USENIX 2005: Proceedings of the USENIX Annual Technical Conference.
  11. Cherkasova, L., Gupta, D., and Vahdat, A. (2007). Comparison of the Three CPU Schedulers in Xen. SIGMETRICS Performance Evaluation Review, 35(2):42-51.
  12. Cherkasova, L., Gupta, D., and Vahdat, A. (2007). Comparison of the Three CPU Schedulers in Xen. SIGMETRICS Performance Evaluation Review, 35(2):42-51.
  13. Gropp, W. and Lusk, E. (1999). Reproducible Measurements of MPI Performance Characteristics. In PVM/MPI 1999: Proceedings of the 6th European PVM/MPI Users' Group Meeting. Springer-Verlag.
  14. Gropp, W. and Lusk, E. (1999). Reproducible Measurements of MPI Performance Characteristics. In PVM/MPI 1999: Proceedings of the 6th European PVM/MPI Users' Group Meeting. Springer-Verlag.
  15. Gupta, D., Cherkasova, L., Gardner, R., and Vahdat, A. (2006). Enforcing Performance Isolation Across Virtual Machines in Xen. In Middleware 2006: Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, New York, NY, USA. Springer-Verlag.
  16. Gupta, D., Cherkasova, L., Gardner, R., and Vahdat, A. (2006). Enforcing Performance Isolation Across Virtual Machines in Xen. In Middleware 2006: Proceedings of the ACM/IFIP/USENIX 2006 International Conference on Middleware, New York, NY, USA. Springer-Verlag.
  17. Happe, J., Becker, S., Rathfelder, C., Friedrich, H., and Reussner, R. H. (2010). Parametric Performance Completions for Model-driven Performance Prediction. Performance Evaluation, 67(8):694-716.
  18. Happe, J., Becker, S., Rathfelder, C., Friedrich, H., and Reussner, R. H. (2010). Parametric Performance Completions for Model-driven Performance Prediction. Performance Evaluation, 67(8):694-716.
  19. Hauck, M., Happe, J., and Reussner, R. H. (2010). Automatic Derivation of Performance Prediction Models for Load-balancing Properties Based on Goal-oriented Measurements. In MASCOTS 2010: Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE Computer Society.
  20. Hauck, M., Happe, J., and Reussner, R. H. (2010). Automatic Derivation of Performance Prediction Models for Load-balancing Properties Based on Goal-oriented Measurements. In MASCOTS 2010: Proceedings of the 18th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems. IEEE Computer Society.
  21. Kalibera, T., Lehotsky, J., Majda, D., Repcek, B., Tomcanyi, M., Tomecek, A., Tuma, P., and Urban, J. (2006). Automated Benchmarking and Analysis Tool. In VALUETOOLS 2006: Proceedings of the 1st International Conference on Performance Evaluation Methodolgies and Tools. ACM.
  22. Kalibera, T., Lehotsky, J., Majda, D., Repcek, B., Tomcanyi, M., Tomecek, A., Tuma, P., and Urban, J. (2006). Automated Benchmarking and Analysis Tool. In VALUETOOLS 2006: Proceedings of the 1st International Conference on Performance Evaluation Methodolgies and Tools. ACM.
  23. Koziolek, H. (2010). Performance Evaluation of Component-based Software Systems: A Survey. Performance Evaluation, 67(8):634-658.
  24. Koziolek, H. (2010). Performance Evaluation of Component-based Software Systems: A Survey. Performance Evaluation, 67(8):634-658.
  25. Matthews, J. N., Hu, W., Hapuarachchi, M., Deshane, T., Dimatos, D., Hamilton, G., McCabe, M., and Owens, J. (2007). Quantifying the Performance Isolation Properties of Virtualization Systems. In ExpCS 2007: Proceedings of the 2007 Workshop on Experimental Computer Science. ACM.
  26. Matthews, J. N., Hu, W., Hapuarachchi, M., Deshane, T., Dimatos, D., Hamilton, G., McCabe, M., and Owens, J. (2007). Quantifying the Performance Isolation Properties of Virtualization Systems. In ExpCS 2007: Proceedings of the 2007 Workshop on Experimental Computer Science. ACM.
  27. Menasce, D. (2005). Virtualization: Concepts, Applications, and Performance Modeling. In CMG 2005: Proceedings of the International CMG Conference.
  28. Menasce, D. (2005). Virtualization: Concepts, Applications, and Performance Modeling. In CMG 2005: Proceedings of the International CMG Conference.
  29. Menasce, D. and Bennani, M. (2006). Autonomic Virtualized Environments. In ICAS 2006: Proceedings of the 2nd International Conference on Autonomic and Autonomous Systems.
  30. Menasce, D. and Bennani, M. (2006). Autonomic Virtualized Environments. In ICAS 2006: Proceedings of the 2nd International Conference on Autonomic and Autonomous Systems.
  31. Schroeder, B., Wierman, A., and Harchol-Balter, M. (2006). Open Versus Closed: A Cautionary Tale. In NSDI 2006: Proceedings of the 3rd Conference on Networked Systems Design & Implementation. USENIX Association.
  32. Schroeder, B., Wierman, A., and Harchol-Balter, M. (2006). Open Versus Closed: A Cautionary Tale. In NSDI 2006: Proceedings of the 3rd Conference on Networked Systems Design & Implementation. USENIX Association.
  33. Sotomayor, B., Keahey, K., and Foster, I. (2006). Overhead Matters: A Model for Virtual Resource Management. In VTDC 2006: Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing.
  34. Sotomayor, B., Keahey, K., and Foster, I. (2006). Overhead Matters: A Model for Virtual Resource Management. In VTDC 2006: Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing.
  35. Tsouloupas, G. and Dikaiakos, M. D. (2006). Characterization of Computational Grid Resources Using LowLevel Benchmarks. In E-SCIENCE 2006: Proceedings of the 2nd IEEE International Conference on eScience and Grid Computing. IEEE Computer Society.
  36. Tsouloupas, G. and Dikaiakos, M. D. (2006). Characterization of Computational Grid Resources Using LowLevel Benchmarks. In E-SCIENCE 2006: Proceedings of the 2nd IEEE International Conference on eScience and Grid Computing. IEEE Computer Society.
  37. Wood, T., Cherkasova, L., Ozonat, K., and Shenoy, P. (2008). Profiling and Modeling Resource Usage of Virtualized Applications. In Middleware 2008: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag.
  38. Wood, T., Cherkasova, L., Ozonat, K., and Shenoy, P. (2008). Profiling and Modeling Resource Usage of Virtualized Applications. In Middleware 2008: Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware. Springer-Verlag.
  39. Woodside, C. M., Vetland, V., Courtois, M., and Bayarov, S. (2001). Resource Function Capture for Performance Aspects of Software Components and Sub-Systems. In Performance Engineering, State of the Art and Current Trends, pages 239-256. Springer-Verlag.
  40. Woodside, C. M., Vetland, V., Courtois, M., and Bayarov, S. (2001). Resource Function Capture for Performance Aspects of Software Components and Sub-Systems. In Performance Engineering, State of the Art and Current Trends, pages 239-256. Springer-Verlag.
  41. Yamasaki, S., Maruyama, N., and Matsuoka, S. (2007). Model-based Resource Selection for Efficient Virtual Cluster Deployment. In VTDC 2007: Proceedings of the 3rd International Workshop on Virtualization Technology in Distributed Computing.
  42. Yamasaki, S., Maruyama, N., and Matsuoka, S. (2007). Model-based Resource Selection for Efficient Virtual Cluster Deployment. In VTDC 2007: Proceedings of the 3rd International Workshop on Virtualization Technology in Distributed Computing.
  43. Zheng, T., Woodside, C. M., and Litoiu, M. (2008). Performance Model Estimation and Tracking Using Optimal Filters. IEEE Transactions of Software Engineering, 34(3):391-406.
  44. Zheng, T., Woodside, C. M., and Litoiu, M. (2008). Performance Model Estimation and Tracking Using Optimal Filters. IEEE Transactions of Software Engineering, 34(3):391-406.
Download


Paper Citation


in Harvard Style

Hauck M., Happe J. and Reussner R. (2011). TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS . In Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8425-52-2, pages 616-622. DOI: 10.5220/0003387406160622


in Harvard Style

Hauck M., Happe J. and Reussner R. (2011). TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS . In Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8425-52-2, pages 616-622. DOI: 10.5220/0003387406160622


in Bibtex Style

@conference{closer11,
author={Michael Hauck and Jens Happe and Ralf Reussner},
title={TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS},
booktitle={Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2011},
pages={616-622},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003387406160622},
isbn={978-989-8425-52-2},
}


in Bibtex Style

@conference{closer11,
author={Michael Hauck and Jens Happe and Ralf Reussner},
title={TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS},
booktitle={Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2011},
pages={616-622},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003387406160622},
isbn={978-989-8425-52-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS
SN - 978-989-8425-52-2
AU - Hauck M.
AU - Happe J.
AU - Reussner R.
PY - 2011
SP - 616
EP - 622
DO - 10.5220/0003387406160622


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - TOWARDS PERFORMANCE PREDICTION FOR CLOUD COMPUTING ENVIRONMENTS BASED ON GOAL-ORIENTED MEASUREMENTS
SN - 978-989-8425-52-2
AU - Hauck M.
AU - Happe J.
AU - Reussner R.
PY - 2011
SP - 616
EP - 622
DO - 10.5220/0003387406160622