ble to observe that Amazon instance presented bet-
ter performance in all cases, compared with instance
Google. Due to the inherent characteristics of cloud
environments, this results may change within certain
limits when we chose different service/billing plans,
so this remain to be investigated. Also, it may be use-
ful to gather more performance metrics from specific
cases of Moodle usage, according to the characteris-
tics of each educational institution. To encourage re-
productibility and further work, we made our data and
scripts available in a public repository.
Our choice of a IaaS service model granted us au-
tonomy to install different benchmarks and to perform
measurements directly from our instances. This may
not be possible when Moodle is provided in a SaaS
model, but such alternative still deserves to be inves-
tigated. Obviously, performance is not the only fac-
tor when deciding to migrate Moodle to the cloud,
but simplicity and cost effectiveness are useless when
we are not sure how the system will perform under a
cloud environment.
As a suggestion of future work, it is intended to
conduct experiments with other cloud providers not
contemplated in the study, use other benchmarks for
performance evaluation. Another important aspect is
the possibility, if there are financial resources, to per-
form the cost-benefit comparison on a paid way. For
the customer, may need to hire a service that performs
best, but that fits within your budget.
REFERENCES
Abadi, D. (2009). Data management in the cloud: Limita-
tions and opportunities. IEEE Data Eng. Bull., 32:3–
12.
Ahmed, M., Uddin, M. M., Azad, M. S., and Haseeb, S.
(2010). MySQL performance analysis on a limited
resource server: Fedora vs. Ubuntu Linux. In Pro-
ceedings of the 2010 Spring Simulation Multiconfer-
ence, SpringSim ’10, pages 99:1–99:7, San Diego,
CA, USA. Society for Computer Simulation Interna-
tional.
Amazon (2013). AWS marketplace: Moodle cloud. Ac-
cessed: 2018-09-26.
Amazon (2020). Amazon EC2. Accessed: 2020-02-14.
Bitnami (2020). Moodle Cloud Hosting, Deploy Moodle.
Accessed: 2020-02-16.
Caminero, A. C., Hernandez, R., Ros, S., Robles-G
´
omez,
A., and Tobarra, L. (2013). Choosing the right LMS:
A performance evaluation of three open-source LMS.
In 2013 IEEE Global Engineering Education Confer-
ence (EDUCON), pages 287–294.
Google (2020a). Google Compute Engine documentation.
Accessed: 2020-02-14.
Google (2020b). Why use Google Cloud Platform? Ac-
cessed: 2018-02-14.
Guo, X., Shi, Q., and Zhang, D. (2014). A study on Moodle
virtual cluster in cloud computing. In 2013 Seventh
International Conference on Internet Computing for
Engineering and Science(ICICSE), volume 00, pages
15–20.
Jamsa, K. (2013). Cloud Computing: SaaS, PaaS, IaaS,
Virtualization, Business Models, Mobile, Security and
More. Burlington, MA : Jones & Bartlett Learning.
Kasae, Y. and Oguchi, M. (2013). Proposal for an optimal
job allocation method for data-intensive applications
based on multiple costs balancing in a hybrid cloud
environment. In Proceedings of the 7th International
Conference on Ubiquitous Information Management
and Communication, ICUIMC ’13, pages 5:1–5:8,
New York, NY, USA. ACM.
Kopytov, A. (2019). Sysbench manual.
Liu, X. X., Qiu, J., and Zhang, J. M. (2014). High avail-
ability benchmarking for cloud management infras-
tructure. In 2014 International Conference on Service
Sciences, pages 163–168.
Mahmood, Z. and Hill, R. (2011). Cloud Computing for
Enterprise Architectures.
Mell, P. and Grance, T. (2011). The NIST definition of
cloud computing. Accessed: 2018-10-12.
Miller, M. (2008). Cloud Computing: Web-Based Applica-
tions That Change the Way You Work and Collaborate
Online. Que Publishing Company, 1 edition.
Moodle (2016). Arguments in favour of PostgreSQL. Ac-
cessed: 2020-01-12.
Moodle (2019). Moodle hosting from the people that make
Moodle. Accessed: 2019-09-26.
Pannequin, M. (2016). Moodle benchmark. Accessed:
2018-10-12.
PostgreSQL (2020). PostgreSQL documentation: devel pg-
bench. Accessed: 2020-02-16.
Scalzo, B., Kline, K., Fernandez, C., Ault, M., and
Burleson, D. (2007). Database Benchmarking: Prac-
tical Methods for Oracle & SQL Server (IT In-Focus
series). Rampant Techpress; Pap-Cdr edition.
Scheuner, J., Leitner, P., Cito, J., and Gall, H. (2014).
Cloud work bench – Infrastructure-as-Code based
cloud benchmarking. In 2014 IEEE 6th International
Conference on Cloud Computing Technology and Sci-
ence, pages 246–253.
SourceForge (2018). Hdparm. Accessed: 2018-10-10.
Sul, W., Yeom, H. Y., and Jung, H. (2018). Towards sus-
tainable high-performance transaction processing in
cloud-based DBMS. Cluster Computing.
Investigating the Performance of Moodle Database Queries in Cloud Environments
275