CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization

Django Armstrong, Karim Djemame

2011

Abstract

Cloud Computing continues to be a rapidly evolving and prevalent paradigm where Quality of Service has a pivotal role to play in guaranteeing performance and provisioning of resources on-demand in a timely fashion. Improvements to the performance of Cloud technology ensure provider profitability and an increased number of applications that can make use of a Cloud where overheads would have otherwise limited usage. This paper presents the results of a quantitative evaluation into the performance overheads of propagating Virtual Machine images to physical resources, at the Infrastructure as a Service layer and then accessing the images, via a Hypervisor’s virtual block I/O device. Two Virtual Infrastructure Managers are evaluated: Nimbus and OpenNebula, along side two Virtual Machine Managers: XEN and KVM. Benchmark results demonstrate Nimbus out of the box outperforming OpenNebula and the performance of XEN exceeding KVM in a greater number of benchmark tests. Conclusions are drawn from the results on the suitability of these technologies for data intensive applications and applications requiring highly dynamic resource sets, where making an uninformed decision on what technology to use could prevent an application reaching its full potential.

References

  1. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield, A. (2003). Xen and the art of virtualization. SIGOPS Oper. Syst. Rev., 37(5):164 - 177.
  2. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield, A. (2003). Xen and the art of virtualization. SIGOPS Oper. Syst. Rev., 37(5):164 - 177.
  3. Bonnie++ (2010). Bonnie++ - Benchmark Suite. Website. http://www.coker.com.au/bonnie++/.
  4. Bonnie++ (2010). Bonnie++ - Benchmark Suite. Website. http://www.coker.com.au/bonnie++/.
  5. BWM-NG (2010). Bandwidth Monitor NG. Website. http://www.gropp.org/?id=projects&sub=bwm-ng.
  6. BWM-NG (2010). Bandwidth Monitor NG. Website. http://www.gropp.org/?id=projects&sub=bwm-ng.
  7. Chen, Y., Wo, T., and Li, J. (2009). An Efficient Resource Management System for On-line Virtual Cluster Provision. In IEEE 2009 International Conference on Cloud Computing.
  8. Chen, Y., Wo, T., and Li, J. (2009). An Efficient Resource Management System for On-line Virtual Cluster Provision. In IEEE 2009 International Conference on Cloud Computing.
  9. Deshane, T., Shepherd, Z., Matthews, J., Ben Yehuda, M., Shah, A., and Rao, B. (2008). Quantitative comparison of Xen and KVM. In Xen Summit, Berkeley, CA, USA. USENIX Association.
  10. Deshane, T., Shepherd, Z., Matthews, J., Ben Yehuda, M., Shah, A., and Rao, B. (2008). Quantitative comparison of Xen and KVM. In Xen Summit, Berkeley, CA, USA. USENIX Association.
  11. Dong, Y., Dai, J., Huang, Z., Guan, H., Tian, K., and Jiang, Y. (2009). Towards high-quality I/O virtualization. In ACM International Conference Proceeding Series, pages 12 - 22, Haifa, Israel.
  12. Dong, Y., Dai, J., Huang, Z., Guan, H., Tian, K., and Jiang, Y. (2009). Towards high-quality I/O virtualization. In ACM International Conference Proceeding Series, pages 12 - 22, Haifa, Israel.
  13. Dong-Jae Kang, Chei-Yol Kim, Kang-Ho Kim, and SungIn Jung (2008). Proportional disk I/O bandwidth management for server virtualization environment. In 2008 International Conference on Computer Science and Information Technology, pages 647 - 53, Piscataway, NJ, USA.
  14. Dong-Jae Kang, Chei-Yol Kim, Kang-Ho Kim, and SungIn Jung (2008). Proportional disk I/O bandwidth management for server virtualization environment. In 2008 International Conference on Computer Science and Information Technology, pages 647 - 53, Piscataway, NJ, USA.
  15. Eucalyptus (2010). Eucalyptus - Elastic Utility Computing Architecture. Website. http://www.eucalyptus.com/.
  16. Eucalyptus (2010). Eucalyptus - Elastic Utility Computing Architecture. Website. http://www.eucalyptus.com/.
  17. Goiri, I., Julia, F., Ejarque, J., de Palol, M., Badia, R., Guitart, J., and Torres, J. (2009). Introducing virtual execution environments for application lifecycle management and SLA-driven resource distribution within service providers. In Proceedings 2009 Eighth IEEE International Symposium on Network Computing and Applications (NCA), pages 211 - 18, Piscataway, NJ, USA.
  18. Goiri, I., Julia, F., Ejarque, J., de Palol, M., Badia, R., Guitart, J., and Torres, J. (2009). Introducing virtual execution environments for application lifecycle management and SLA-driven resource distribution within service providers. In Proceedings 2009 Eighth IEEE International Symposium on Network Computing and Applications (NCA), pages 211 - 18, Piscataway, NJ, USA.
  19. Goldberg, R. (1972). Architectural Principles for Virtual Computer Systems. PhD thesis, Harvard University, Cambridge, MA.
  20. Goldberg, R. (1972). Architectural Principles for Virtual Computer Systems. PhD thesis, Harvard University, Cambridge, MA.
  21. Hansen, J. G. and Jul, E. (2010). Lithium: virtual machine storage for the cloud. In SoCC 7810: Proceedings of the 1st ACM symposium on Cloud computing, pages 15 - 26, New York, NY, USA. ACM.
  22. Hansen, J. G. and Jul, E. (2010). Lithium: virtual machine storage for the cloud. In SoCC 7810: Proceedings of the 1st ACM symposium on Cloud computing, pages 15 - 26, New York, NY, USA. ACM.
  23. Imada, T., Sato, M., and Kimura, H. (2009). Power and QoS performance characteristics of virtualized servers. In Proceedings of the 2009 10th IEEE/ACM International Conference on Grid Computing (GRID), pages 232 - 40, Piscataway, NJ, USA.
  24. Imada, T., Sato, M., and Kimura, H. (2009). Power and QoS performance characteristics of virtualized servers. In Proceedings of the 2009 10th IEEE/ACM International Conference on Grid Computing (GRID), pages 232 - 40, Piscataway, NJ, USA.
  25. IOzone (2010). IOzone - Filesystem Benchmark. Website. http://www.iozone.org/.
  26. IOzone (2010). IOzone - Filesystem Benchmark. Website. http://www.iozone.org/.
  27. Jianhua Che, Qinming He, Qinghua Gao, and Dawei Huang (2008). Performance measuring and comparing of virtual machine monitors. In 2008 IEEE/IFIP 5th International Conference on Embedded and Ubiquitous Computing. EUC 2008, volume 2, pages 381 - 6, Piscataway, NJ, USA.
  28. Jianhua Che, Qinming He, Qinghua Gao, and Dawei Huang (2008). Performance measuring and comparing of virtual machine monitors. In 2008 IEEE/IFIP 5th International Conference on Embedded and Ubiquitous Computing. EUC 2008, volume 2, pages 381 - 6, Piscataway, NJ, USA.
  29. Jun Zhu, Wei Dong, Zhefu Jiang, Xiaogang Shi, Zhen Xiao, and Xiaoming Li (2010). Improving the Performance of Hypervisor-Based Fault Tolerance. In Proceedings of the 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), pages 10 - 20, Piscataway, NJ, USA.
  30. Jun Zhu, Wei Dong, Zhefu Jiang, Xiaogang Shi, Zhen Xiao, and Xiaoming Li (2010). Improving the Performance of Hypervisor-Based Fault Tolerance. In Proceedings of the 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), pages 10 - 20, Piscataway, NJ, USA.
  31. Kate Keahey, Tim Freeman, Jerome Lauret, and Doug Olson (2007). Virtual workspaces for scientific applications. In SciDAC 2007 Conference, Boston, MA.
  32. Kate Keahey, Tim Freeman, Jerome Lauret, and Doug Olson (2007). Virtual workspaces for scientific applications. In SciDAC 2007 Conference, Boston, MA.
  33. Keahey, K. and Freeman, T. (2008). Contextualization: Providing One-Click Virtual Clusters. In ESCIENCE 7808: Proceedings of the 2008 Fourth IEEE International Conference on eScience, pages 301 - 308, Washington, DC, USA. IEEE Computer Society.
  34. Keahey, K. and Freeman, T. (2008). Contextualization: Providing One-Click Virtual Clusters. In ESCIENCE 7808: Proceedings of the 2008 Fourth IEEE International Conference on eScience, pages 301 - 308, Washington, DC, USA. IEEE Computer Society.
  35. Kesavan, M., Gavrilovska, A., and Schwan, K. (2010). Differential virtual time (DVT): rethinking I/O service differentiation for virtual machines. In SoCC 7810: Proceedings of the 1st ACM symposium on Cloud computing, pages 27 - 38, New York, NY, USA. ACM.
  36. Kesavan, M., Gavrilovska, A., and Schwan, K. (2010). Differential virtual time (DVT): rethinking I/O service differentiation for virtual machines. In SoCC 7810: Proceedings of the 1st ACM symposium on Cloud computing, pages 27 - 38, New York, NY, USA. ACM.
  37. Kossmann, D., Kraska, T., and Loesing, S. (2010). An evaluation of alternative architectures for transaction processing in the cloud. In SIGMOD 7810: Proceedings of the 2010 international conference on Management of data, pages 579 - 590, New York, NY, USA. ACM.
  38. Kossmann, D., Kraska, T., and Loesing, S. (2010). An evaluation of alternative architectures for transaction processing in the cloud. In SIGMOD 7810: Proceedings of the 2010 international conference on Management of data, pages 579 - 590, New York, NY, USA. ACM.
  39. KVM (2010). KVM - Kernel Based Virtual Machine. Website. http://www.linux-kvm.org.
  40. KVM (2010). KVM - Kernel Based Virtual Machine. Website. http://www.linux-kvm.org.
  41. Nakajima, J. and Mallick Asit K. (2007). Hybrid Virtualization - Enhanced Virtualization for Linux. In Proceedings of the Linux Symposium.
  42. Nakajima, J. and Mallick Asit K. (2007). Hybrid Virtualization - Enhanced Virtualization for Linux. In Proceedings of the Linux Symposium.
  43. Padala, P., Zhu, X., Wang, Z., Singhal, S., and Shin, K. G. (2008). Performance Evaluation of Virtualization Technologies for Server Consolidation. Technical report, HP Labs.
  44. Padala, P., Zhu, X., Wang, Z., Singhal, S., and Shin, K. G. (2008). Performance Evaluation of Virtualization Technologies for Server Consolidation. Technical report, HP Labs.
  45. Popek, G. and Goldberg, R. (1974). Formal requirements for virtualizable third generation architectures. Communications of the ACM, 17(7):412 - 21.
  46. Popek, G. and Goldberg, R. (1974). Formal requirements for virtualizable third generation architectures. Communications of the ACM, 17(7):412 - 21.
  47. QEMU (2010). QEMU - Open Source Processor Emulation. Website. http://www.qemu.org.
  48. QEMU (2010). QEMU - Open Source Processor Emulation. Website. http://www.qemu.org.
  49. Rochwerger, B., Caceres, J., Montero, R., Breitgand, D., Elmroth, E., Galis, A., Levy, E., Llorente, I., Nagin, K., and Wolfstha, Y. (2009). The Reservoir model and architecture for open federated cloud computing. IBM Journal of Research and Development, 53(4):Online.
  50. Rochwerger, B., Caceres, J., Montero, R., Breitgand, D., Elmroth, E., Galis, A., Levy, E., Llorente, I., Nagin, K., and Wolfstha, Y. (2009). The Reservoir model and architecture for open federated cloud computing. IBM Journal of Research and Development, 53(4):Online.
  51. Russell, R. (2008). Virtio: towards a de-facto standard for virtual I/O devices. SIGOPS Oper. Syst. Rev., 42(5):95 - 103.
  52. Russell, R. (2008). Virtio: towards a de-facto standard for virtual I/O devices. SIGOPS Oper. Syst. Rev., 42(5):95 - 103.
  53. Sotomayor, B., Rubé andn, Llorente, I. M., and Foster, I. (2009). Virtual Infrastructure Management in Private and Hybrid Clouds. Internet Computing, IEEE, 13(5):14 - 22.
  54. Sotomayor, B., Rubé andn, Llorente, I. M., and Foster, I. (2009). Virtual Infrastructure Management in Private and Hybrid Clouds. Internet Computing, IEEE, 13(5):14 - 22.
  55. Stantchev, V. (2009). Performance evaluation of cloud computing offerings. In Proceedings of the 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences (ADVCOMP 2009), pages 187 - 92, Piscataway, NJ, USA.
  56. Stantchev, V. (2009). Performance evaluation of cloud computing offerings. In Proceedings of the 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences (ADVCOMP 2009), pages 187 - 92, Piscataway, NJ, USA.
  57. Van, H. N., Tran, F. D., and Menaud, J.-M. (2009). SLAaware virtual resource management for cloud infrastructures. In Proceedings - IEEE 9th International Conference on Computer and Information Technology, CIT 2009, volume 1, pages 357 - 362, Xiamen, China.
  58. Van, H. N., Tran, F. D., and Menaud, J.-M. (2009). SLAaware virtual resource management for cloud infrastructures. In Proceedings - IEEE 9th International Conference on Computer and Information Technology, CIT 2009, volume 1, pages 357 - 362, Xiamen, China.
  59. Vouk, M. (2008). Cloud computing - Issues, research and implementations. In 2008 30th International Conference on Information Technology Interfaces (ITI), pages 31 - 40, Piscataway, NJ, USA.
  60. Vouk, M. (2008). Cloud computing - Issues, research and implementations. In 2008 30th International Conference on Information Technology Interfaces (ITI), pages 31 - 40, Piscataway, NJ, USA.
  61. Xianghua Xu, Feng Zhou, Jian Wan, and Yucheng Jiang (2008). Quantifying performance properties of virtual machine. In Linux;program testing;software performance evaluation;systems analysis;virtual machines;, volume 1, pages 24 - 8, Piscataway, NJ, USA.
  62. Xianghua Xu, Feng Zhou, Jian Wan, and Yucheng Jiang (2008). Quantifying performance properties of virtual machine. In Linux;program testing;software performance evaluation;systems analysis;virtual machines;, volume 1, pages 24 - 8, Piscataway, NJ, USA.
  63. Xiong, K. and Perros, H. (2009). Service performance and analysis in cloud computing. In SERVICES 2009 - 5th 2009 World Congress on Services, pages 693 - 700, Bangalore, India.
  64. Xiong, K. and Perros, H. (2009). Service performance and analysis in cloud computing. In SERVICES 2009 - 5th 2009 World Congress on Services, pages 693 - 700, Bangalore, India.
  65. Xu, C., Bai, Y., and Luo, C. (2009). Performance evaluation of parallel programming in virtual machine environment. In NPC 2009 - 6th International Conference on Network and Parallel Computing, pages 140 - 147, Gold Coast, QLD, Australia.
  66. Xu, C., Bai, Y., and Luo, C. (2009). Performance evaluation of parallel programming in virtual machine environment. In NPC 2009 - 6th International Conference on Network and Parallel Computing, pages 140 - 147, Gold Coast, QLD, Australia.
  67. Yigitbasi, N., Iosup, A., Epema, D., and Ostermann, S. (2009). C-Meter: A framework for performance analysis of computing clouds. In 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009, pages 472 - 477, Shanghai, China.
  68. Yigitbasi, N., Iosup, A., Epema, D., and Ostermann, S. (2009). C-Meter: A framework for performance analysis of computing clouds. In 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, CCGRID 2009, pages 472 - 477, Shanghai, China.
  69. Yu Liang, S. and Lu, X. (2008). An efficient disk I/O characteristics collection method based on virtual machine technology. In Proceedings - 10th IEEE International Conference on High Performance Computing and Communications, HPCC 2008, pages 943 - 949, Dalian, China.
  70. Yu Liang, S. and Lu, X. (2008). An efficient disk I/O characteristics collection method based on virtual machine technology. In Proceedings - 10th IEEE International Conference on High Performance Computing and Communications, HPCC 2008, pages 943 - 949, Dalian, China.
Download


Paper Citation


in Harvard Style

Armstrong D. and Djemame K. (2011). CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization . In Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8425-52-2, pages 539-550. DOI: 10.5220/0003388305390550


in Harvard Style

Armstrong D. and Djemame K. (2011). CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization . In Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER, ISBN 978-989-8425-52-2, pages 539-550. DOI: 10.5220/0003388305390550


in Bibtex Style

@conference{closer11,
author={Django Armstrong and Karim Djemame},
title={CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization},
booktitle={Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2011},
pages={539-550},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003388305390550},
isbn={978-989-8425-52-2},
}


in Bibtex Style

@conference{closer11,
author={Django Armstrong and Karim Djemame},
title={CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization},
booktitle={Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,},
year={2011},
pages={539-550},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003388305390550},
isbn={978-989-8425-52-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization
SN - 978-989-8425-52-2
AU - Armstrong D.
AU - Djemame K.
PY - 2011
SP - 539
EP - 550
DO - 10.5220/0003388305390550


in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Cloud Computing and Services Science - Volume 1: CLOSER,
TI - CULTIVATING CLOUD COMPUTING - A Performance Evaluation of Virtual Image Propagation & I/O Paravirtualization
SN - 978-989-8425-52-2
AU - Armstrong D.
AU - Djemame K.
PY - 2011
SP - 539
EP - 550
DO - 10.5220/0003388305390550