Metasearch Services Composition in WS-BPEL - An Application of Metamorphic Testing

Carmen Castro, Inmaculada Medina-Bulo, Azahara Camacho


Nowadays, the impact of Web Services is quickly increasing because of transactions through Internet. The OASIS WS-BPEL 2.0 standard language allows to develop business processes by means of pre-existing Web Services and to offer themselves as a new Web Service. This makes it necessary to pay special attention to testing this type of software and presents a challenge for traditional testing techniques, due to the inclusion of specific instructions for concurrency, fault and compensation handling, and dynamic service discovery and invocation. Metamorphic Testing has proved useful to test and improve the quality of traditional imperative programs. However, it has not been applied to languages for composingWeb Services such a WS-BPEL. This work presents an procedure for applying Metamorphic Testing to Web Services compositions, proposes an architecture and analyzes a case study with promising results.


  1. ActiveVOS (2009). ActiveBPEL WS-BPEL Engine.
  2. Andrews, J. H., Briand, L. C., and Labiche, Y. (2005). Is mutation an appropriate tool for testing experiments? In Proceedings of the 27th International Conference on Software Engineering (ICSE 2005), pages 402- 411. ACM Press.
  3. Beizer, B. (1990). Software Testing Techniques, 2nd Edition. International Thomson Computer Press, 2 sub edition.
  4. Bozkurt, M., Harman, M., and Hassoun, Y. (2010). TR-10- 01: testing web services: A survey. Technical Report TR-10-01, King's College, London.
  5. Castro-Cabrera, C. and Medina-Bulo, I. (2011). An approach to metamorphic testing for ws-bpel compositions. In Proceedings of the International Conference on e-Business (ICE-B 2011).
  6. Chan, W. K., Cheung, S. C., and Leung, K. R. (2007). A metamorphic testing approach for online testing of service-oriented software applications. International Journal of Web Services Research, 4(2):61-81.
  7. Chen, T. Y. (1998). Metamorphic testing: A new approach for generating next test cases. HKUSTCS98-01.
  8. Chen, T. Y. (2010). Metamorphic testing: A simple approach to alleviate the oracle problem. In Proceedings of the 5th IEEE International Symposium on Service Oriented System Engineering. IEEE Computer Society.
  9. Chen, T. Y., Huang, D. H., Tse, T. H., and Zhou, Z. Q. (2004). Case studies on the selection of useful relations in metamorphic testing. In Proceedings of the 4th Ibero-American Symposium on Software Engineering and Knowledge Engineering (JIISIC 2004), pages 569-583.
  10. García-Domínguez, A., Medina-Bulo, I., and MarcosBárcena, M. (2011). Model-driven design of performance requirements with UML and MARTE. In Proceedings of the 6th International Conference on Software and Data Technologies, Seville, Spain.
  11. García-Fanjul, J., Tuya, J., and de la Riva, C. (2007). Generación sistemática de pruebas para composiciones de servicios utilizando criterios de suficiencia basados en transiciones. In JISBD 2007: Actas de las XII Jornadas de Ingeniería del Software y Bases de Datos.
  12. Gotlieb, A. and Botella, B. (2003). Automated metamorphic testing. Computer Software and Applications Conference, Annual International, 0:34-40.
  13. IDC (2008). Research reports.
  14. Leveson, N. G. (1995). Safeware: system safety and computers. ACM.
  15. Mayer, P. and Lübke, D. (2006). Towards a BPEL unit testing framework. In TAV-WEB'06: Proceedings of the 2006 workshop on Testing, Analysis, and Verification of Web Services and Applications, pages 33-42. ACM.
  16. Murphy, C., Kaiser, G., Hu, L., and Wu, L. (2008). Properties of machine learning applications for use in metamorphic testing. In Proc. of the 20th international conference on software engineering and knowledge engineering (SEKE), pages 867-872.
  17. Murphy, C., Shen, K., and Kaiser, G. (2009). Using JML runtime assertion checking to automate metamorphic testing in applications without test oracles. In Software Testing Verification and Validation, 2009. ICST'09. International Conference on, pages 436- 445.
  18. Myers, G.J., Sandler, C., Badgett, T., and Thomas, T. M. (2004). The Art of Software Testing, 2nd ed. Wiley - Interscience.
  19. OASIS (2007). Web Services Business Process Execution Language 2.0. Organization for the Advancement of Structured Information Standards.
  20. Palomo-Duarte, M. (2011). Service composition verification and validation. In Jonathan Lee, S.-P. M. and Liu, A., editors, Service Life Cycle Tools and Technologies: Methods, Trends and Advances, pages 200- 219. IGI Global.
  21. Palomo-Duarte, M., García-Domínguez, A., Medina-Bulo, I., Í lvarez-Ayllón, A., and Santacruz, J. (2010). Takuan: a tool for WS-BPEL composition testing using dynamic invariant generation. In et al., B. B., editor, ICWE, volume 6189 of Lecture Notes in Computer Science, pages 532-535. Springer.
  22. Segura, S., Galindo, J., Benavides, D., Parejo, J., and RuizCorts, A. (2012). Betty: Benchmarking and testing on the automated analysis of feature models. In Eisenecker, U., Apel, S., and Gnesi, S., editors, Sixth International Workshop on Variability Modelling of Software-intensive Systems (VaMoS'12), pages 63-71, Leipzig, Germany. ACM.
  23. UCASE Research Group (2010). GAmera home site.˜gamera.
  24. Weyuker, E. (1982). On testing Non-Testable programs. The Computer Journal, 25(4):465-470.
  25. Xie, X., Ho, J. W. K., Murphy, C., Kaiser, G., Xu, B., and Chen, T. Y. (2011). Testing and validating machine learning classifiers by metamorphic testing. J. Syst. Softw., 84:544-558.
  26. Zhang, Z.-Y., Chan, W. K., Tse, T. H., and Hu, P.-F. (2009). An experimental study to compare the use of metamorphic testing and assertion checking. Journal of Software, 20(10):2637-2654.
  27. Zheng, Y., Zhou, J., and Krause, P. (2007). An automatic test case generation framework for web services. Journal of Software, 2(3):64-77.
  28. Zhou, Z. Q., Huang, D. H., Tse, T. H., Yang, Z., Huang, H., and Chen, T. Y. (2004). Metamorphic testing and its applications. In Proceedings of the 8th International Symposium on Future Software Technology (ISFST 2004). Software Engineers Association.

Paper Citation

in Harvard Style

Castro C., Medina-Bulo I. and Camacho A. (2012). Metasearch Services Composition in WS-BPEL - An Application of Metamorphic Testing . In Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT, ISBN 978-989-8565-19-8, pages 427-432. DOI: 10.5220/0004026004270432

in Bibtex Style

author={Carmen Castro and Inmaculada Medina-Bulo and Azahara Camacho},
title={Metasearch Services Composition in WS-BPEL - An Application of Metamorphic Testing},
booktitle={Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,},

in EndNote Style

JO - Proceedings of the 7th International Conference on Software Paradigm Trends - Volume 1: ICSOFT,
TI - Metasearch Services Composition in WS-BPEL - An Application of Metamorphic Testing
SN - 978-989-8565-19-8
AU - Castro C.
AU - Medina-Bulo I.
AU - Camacho A.
PY - 2012
SP - 427
EP - 432
DO - 10.5220/0004026004270432