A Multi-Cloud Framework for Measuring and Describing Performance Aspects of Cloud Services Across Different Application Types

G. Kousiouris, G. Giammatteo, A. Evangelinou, N. Galante, E. Kevani, C. Stampoltas, A. Menychtas, A. Kopaneli, K. Ramasamy Balraj, D. Kyriazis, T. Varvarigou, P. Stuer, L. Orue-Echevarria Arrieta

2014

Abstract

Cloud services have emerged as an innovative IT provisioning model in the recent years. However, after their usage severe considerations have emerged with regard to their varying performance due to multitenancy and resource sharing issues. These issues make it very difficult to provide any kind of performance estimation during application design or deployment time. The aim of this paper is to present a mechanism and process for measuring the performance of various Cloud services and describing this information in machine understandable format. The framework is responsible for organizing the execution and can support multiple Cloud providers. Furthermore we present approaches for measuring service performance with the usage of specialized metrics for ranking the services according to a weighted combination of cost, performance and workload.

References

  1. ARTIST Consortium (2013), Deliverable D7.2 v1.0- PaaS/IaaS Metamodelling Requirements and SOTA, Available at: http://www.artist-project.eu/sites/default/ files/D7.2%20PaaS%20IaaS%20metamodeling%20re quirements%20and%20SOTA_M4_31012013.pdf.
  2. REMICS Consortium (2012), Deliverable D4.1 v2.0 - PIM4Cloud, Available at: http://www.remics.eu/ system/files/REMICS_D4.1_V2.0_LowResolution.pdf.
  3. Kousiouris, George; Vafiadis, George; Varvarigou, Theodora, "Enabling Proactive Data Management in Virtualized Hadoop Clusters Based on Predicted Data Activity Patterns," P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC), 2013 Eighth International Conference on, vol., no., pp.1,8, 28-30 Oct. 2013.
  4. doi: 10.1109/3PGCIC.2013.8.
  5. George Kousiouris, Dimosthenis Kyriazis, Andreas Menychtas and Theodora Varvarigou, "Legacy Applications on the Cloud: Challenges and enablers focusing on application performance analysis and providers characteristics", in Proceedings of the 2012 2nd IEEE International Conference on Cloud Computing and Intelligence Systems (IEEE CCIS 2012), Oct. 30th Nov. 1st,Hangzhou, China.
  6. Hauck, M., Huber, M., Klems, M., Kounev, S., MullerQuade, J., Pretschner, A., Reussner, R., and Tai, S. Challenges and opportunities of Cloud computing. Karlsruhe Reports in Informatics 19, Karlsruhe Institute of Technology - Faculty of Informatics, 2010.
  7. Zhonghong Ou, Hao Zhuang, Jukka K. Nurminen, Antti Ylä-Jääski, and Pan Hui. 2012. Exploiting hardware heterogeneity within the same instance type of Amazon EC2. In Proceedings of the 4th USENIX conference on Hot Topics in Cloud Ccomputing (HotCloud'12). USENIX Association, Berkeley, CA, USA, 4-4.
  8. George Kousiouris, Tommaso Cucinotta, Theodora Varvarigou, "The Effects of Scheduling, Workload Type and Consolidation Scenarios on Virtual Machine Performance and their Prediction through Optimized Artificial Neural Networks , The Journal of Systems and Software (2011),Volume 84, Issue 8, August 2011, pp. 1270-1291, Elsevier, doi:10.1016/ j.jss.2011.04.013.
  9. Y. Koh, R. Knauerhase, P. Brett, M. Bowman, Z. Wen, and C. Pu. An analysis of performance interference effects in virtual environments. In IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), pages 200-209, April 2007.
  10. Schaffrath, Gregor and Schmid, Stefan and Vaishnavi, Ishan and Khan, Ashiq AND Feldmann, Anja, 2012. A Resource Description Language with Vagueness Support for Multi-Provider Cloud Networks. Munich, Germany: International Conference on Computer Communication Networks (ICCCN 7812).
  11. Charlton, S. (2009). Model driven design and operations for the cloud. In OOPSLA09, 14th conference companion on Object Oriented Programming Systems Languages and Applications, pages 17-26.
  12. Koslovski, G., Primet, P.V.-B., Charao, A. S.: VXDL: Virtual Resources and Interconnection Networks Description Language. In: GridNets 2008 (October 2008).
  13. Mirkovic, J., Faber, T., Hsieh, P., Malayandisamu, G., Malavia, R.: DADL: Distributed Application Description Language. USC/ISI Technical Report ISITR-664 (2010).
  14. Saurabh Kumar Garg, Steve Versteeg, Rajkumar Buyya, A framework for ranking of Cloud computing services, Future Generation Computer Systems, Volume 29, Issue 4, June 2013, Pages 1012-1023, ISSN 0167- 739X, http://dx.doi.org/10.1016/j.future.2012.06.006.
  15. A. Iosup, R. Prodan, and D. Epema, “Iaas Cloud Benchmarking: Approaches, Challenges, and Experience,” Proc. of the Int'l Conf. on High Performance Networking and Computing (SC), MTAGS 2012 . IEEE/ACM, pp. 1-8.
  16. Ang Li, Xiaowei Yang, Srikanth Kandula, and Ming Zhang. 2010. CloudCmp: comparing public Cloud providers. In Proceedings of the 10th ACM SIGCOMM conference on Internet measurement (IMC 7810). ACM, New York, NY, USA, 1-14. DOI=10.1145/1879141.1879143 http://doi.acm.org/10.1145/1879141.1879143.
  17. ARTIST Consortium (2013), Deliverable D7.2.1 v1.0- Cloud services modelling and performance analysis framework, Available at: http://www.artistproject.eu/sites/default/files/D7.2.1%20Cloud%20serv ices%20modeling%20and%20performance%20analysi s%20framework_M12_30092013.pdf.
Download


Paper Citation


in Harvard Style

Kousiouris G., Giammatteo G., Evangelinou A., Galante N., Kevani E., Stampoltas C., Menychtas A., Kopaneli A., Ramasamy Balraj K., Kyriazis D., Varvarigou T., Stuer P. and Orue-Echevarria Arrieta L. (2014). A Multi-Cloud Framework for Measuring and Describing Performance Aspects of Cloud Services Across Different Application Types . In Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: MultiCloud, (CLOSER 2014) ISBN 978-989-758-019-2, pages 714-721. DOI: 10.5220/0004975407140721


in Bibtex Style

@conference{multicloud14,
author={G. Kousiouris and G. Giammatteo and A. Evangelinou and N. Galante and E. Kevani and C. Stampoltas and A. Menychtas and A. Kopaneli and K. Ramasamy Balraj and D. Kyriazis and T. Varvarigou and P. Stuer and L. Orue-Echevarria Arrieta},
title={A Multi-Cloud Framework for Measuring and Describing Performance Aspects of Cloud Services Across Different Application Types},
booktitle={Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: MultiCloud, (CLOSER 2014)},
year={2014},
pages={714-721},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004975407140721},
isbn={978-989-758-019-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 4th International Conference on Cloud Computing and Services Science - Volume 1: MultiCloud, (CLOSER 2014)
TI - A Multi-Cloud Framework for Measuring and Describing Performance Aspects of Cloud Services Across Different Application Types
SN - 978-989-758-019-2
AU - Kousiouris G.
AU - Giammatteo G.
AU - Evangelinou A.
AU - Galante N.
AU - Kevani E.
AU - Stampoltas C.
AU - Menychtas A.
AU - Kopaneli A.
AU - Ramasamy Balraj K.
AU - Kyriazis D.
AU - Varvarigou T.
AU - Stuer P.
AU - Orue-Echevarria Arrieta L.
PY - 2014
SP - 714
EP - 721
DO - 10.5220/0004975407140721