TASSA: A Testing as a Service Framework for Web Service Compositions

Dessislava Petrova-Antonova, Sylvia Ilieva, Denitsa Manova

2016

Abstract

Testing-as-a-Service (TaaS) is a new quality assurance model addressing the challenges of software testing in the cloud. The missing access to the hardware or different software configurations as well as the difficulties of building a test environment are examples for common problems in the testing process. This paper addresses such problems by proposing a TaaS-enabled framework offering testing services on as-needed basis. The framework, called Testing as a Service Software Architecture (TASSA), supports testing of web service compositions described with Business Process Execution Language for Web Services (WS-BPEL). Its core functionality includes fault injection and dependencies isolation of the application under test. It is implemented as web services deployed on cloud infrastructure. In addition, the TASSA Graphical User Interface (GUI) for test case design and execution is implemented as a plugin for Eclipse IDE. It could be accessed from a local computer or used for building a cloud test lab on a virtual machine. Sample business process from wine industry is used for proving the feasibility of TASSA framework.

References

  1. Candea G., S. Bucur, Cristian Z, 2010. Automated Software Testing as a Service (TaaS). In Proceedings of the 1st ACM Symposium on Cloud Computing. pp. 155-160.
  2. Parveen T., Tilley S., 2010. When to Migrate Software Testing to the Cloud?. In Third International Conference on Software Testing. Verification, and Validation Workshops (ICSTW), pp.424-427.
  3. Yu L., W. Tsai, X. Chen, L. Liu, Y. Zhao, L. Tang, Zhao W., 2010. Testing as a Service over Cloud. In Proceedings of the Fifth IEEE International Symposium on Service Oriented Sys-tem Engineering. pp. 181-188.
  4. Gao J., X. Bai, Tsai W., 2013. Testing as a Service (TaaS) on Clouds. In Proceedings of the Seventh IEEE International Symposium on Service-Oriented System Engineering. pp. 212-222.
  5. Yu L., L. Zhang, Xiang H., Su Y., Zhao W., Zhu J., 2009. A Framework of Testing as a Service. In Proceeding of the Conference of Information System Management.
  6. Sathe A., Kulkarni R., 2013. Study of testing as a service (TaaS) - cost effective framework for TaaS in cloud environment. In International Journal of Application or Innovation in Engineering & Management (IJAIEM), Volume 2, Issue 5, pp.239-243.
  7. Yan M, Sun H., Wang X., Liu X., 2012. Building a TaaS Platform for Web Service Load Testing. In Proceeding of the IEEE International Conference on Cluster Computing. pp. 576-579.
  8. Apache JMeter, http://jmeter.apache.org/, last accessed on 11.06.2015.
  9. Herbold S. et al., 2015. The MIDAS Cloud Platform for Testing SOA Applications. In Proceedings of the IEEE 8th International Conference on Software Testing, Verification and Validation (ICST), pp. 1-8.
  10. SOASTA CloudTest, https://www.soasta.com/wpcontent/uploads/2015/05/CT-Data-Sheet.pdf, last accessed on 12.06.2015.
  11. SOASTA CloudTest, https://saucelabs.com/downloads/ one_pager_sales_sheet.pdf, last accessed on 12.06.2015.
  12. IBM Rational Performance Tester, https://www.ibm.com/ developerworks/cloud/library/cl-loadtest-softlayer-trs/, last ac-cessed on 12.06.2015.
  13. Oracle Testing as a Service, http://www.oracle.com/ technetwork/oem/cloud-mgmt/ds-oracletesting-as-aservice-1905796.pdf, last accessed on 12.06.2015.
  14. Parasoft Cloud Testing, http://www.parasoft.com/ capability/cloud-testing/, last accessed on 12.06.2015.
  15. Amazon EC2, http://aws.amazon.com/ec2/, last accessed on 18.06.2015.
  16. Bartolini, C., Bertolino, A., Lonetti, F. and Marchetti, E., 2012. Approaches to functional, structural and security SOA testing. In Performance and Dependability in Service Computing: Concepts, Techniques and Research Directions, Valeria Cardellini, Emiliano Casalicchio, Kalinka Regina Lucas Jaquie Castelo Branco, Julio Cezar Estrella, Francisco Josè Mona-co (eds.). Hershey, PA, USA: IGI Global, pp. 381-401.
  17. Bucchiarone, A.; Melgratti, H., Severoni, F., 2007. Testing Service Composition. In Proceedings of the 8th Argentine Symposium on Software Engineering (ASSE).
  18. Bartolini, C., Bertolino, A., Marchetti, E., Polini, A., 2008. Towards Automated WSDL Based Testing of Web Services. In Proceedings of the 6th International Conference on Service-Oriented Computing. Volume 5364 of LNCS, pp. 524-529.
  19. Dong, W., 2009. Testing WSDL_based Web service automatically. In Proceedings of the WRI World Congress on Software Engineering. pp. 521-5.
  20. Noikajana, S., Suwannasart, T. An improved test case generation method for Web service testing from WSDL-S and OCL with pair-wise testing technique. Proceeding of the 33rd Annual IEEE International Computer Software and Applications Conference, 2009, p 115-23.
  21. Bai, X., Dong, W., Tsai, W.-T., Chen, Y., 2005. WSDLbased automatic test case generation for Web Services testing. In Proceedings of the IEEE International Workshop on Service-Oriented System Engineering. pp. 215-220.
  22. Lopez, M., Ferreiro, H., Francisco, M.A., Castro, L.M., 2013. Automatic Generation of Test Models for Web Services Using WSDL and OCL. In Proceedings of the 11th International Conference on Service-Oriented Computing (ICSOC). pp. 483-490.
  23. Masood, T., Nadeem, A., Ali, S., 2013. An automated approach to regression testing of Web services based on WSDL operation changes. In Proceeding of the IEEE 9th International Conference on Emerging Technologies (ICET). pp. 1-5.
  24. García-Fanjul J., J. Tuya, de la Riva Cl., 2006. Generating Test Cases Specifications for BPEL Compositions of Web Services Using SPIN. In International Workshop on Web Services Modelling and Testing. pp. 83-94.
  25. Hou, S.-S., Zhang, L., Lan, Q., Mei, H. Sun, J.-S., 2009 Generating effective test sequences for BPEL testing. In Proceeding of QSIC'09. pp. 331-340.
  26. Yuan, Y., Li, Z. Sun, W., 2006. A graph-search based approach to BPEL4WS test generation. In Proceeding of ICSEA. pp. 14-22.
  27. Cao, T.-D., Felix, P., Castanet, R. Berrada, I., 2010 Online testing framework for web services. In Proceeding of ICST. pp. 363-372.
  28. Karam M., H. Safa, H. Artail., 2007. An abstract workflowbased framework for testing composed web services. In Proc. of Int. Conf. on Computer Systems and Applications. pp. 901-908.
  29. Li Z. J., Tan H. F., Liu H. H., Zhu J., Mitsumori N. M., 2008. Business-process-driven gray-box SOA testing. In IBM Systems Journal 47. pp. 457-472.
  30. Zhu H. Zhang Y., 2012. Collaborative Testing of Web Services. In IEEE Transactions on Services Computing, vol. 5, no. 1, pp. 116-130.
Download


Paper Citation


in Harvard Style

Petrova-Antonova D., Petrova-Antonova D., Ilieva S., Ilieva S., Manova D. and Manova D. (2016). TASSA: A Testing as a Service Framework for Web Service Compositions . In Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016) ISBN 978-989-758-166-3, pages 33-42. DOI: 10.5220/0005844400330042


in Bibtex Style

@conference{amaretto16,
author={Dessislava Petrova-Antonova and Dessislava Petrova-Antonova and Sylvia Ilieva and Sylvia Ilieva and Denitsa Manova and Denitsa Manova},
title={TASSA: A Testing as a Service Framework for Web Service Compositions},
booktitle={Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)},
year={2016},
pages={33-42},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005844400330042},
isbn={978-989-758-166-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)
TI - TASSA: A Testing as a Service Framework for Web Service Compositions
SN - 978-989-758-166-3
AU - Petrova-Antonova D.
AU - Petrova-Antonova D.
AU - Ilieva S.
AU - Ilieva S.
AU - Manova D.
AU - Manova D.
PY - 2016
SP - 33
EP - 42
DO - 10.5220/0005844400330042