An Application of Software Fault Injection for Assessment of Quality of Test Sets for Business Processes Orchestrating Web-Services

Damian Grela, Krzysztof Sapiecha, Joanna Strug

2013

Abstract

The paper presents an experiment of the application of software fault injection to assess quality of test sets for business processes orchestrating web-services. The mutation testing, usually used to this end, suffers from high computational costs of generating and running mutants. In contrast to mutation testing, faults injection can be performed at a run-time. Run-time changes are introduced by a Software Fault Injector for BPEL Processes (SFIBP). SFIBP is implemented as a special service that manipulates invocations of web-services and values of their internal variables. As for time requirements, the experiment proved high superiority of the application of the SFIBP over the mutation testing.

References

  1. OASIS, 2007, Web Services Business Process Execution Language 2.0, http://docs.oasis-open.org/wsbpel/2.0/. Organization for the Advancement of Structured Information Standards.
  2. W.-L. Dong, H. Yu, Y.-B. Zhang, 2006. Testing BPELbased web service composition using high-level Petri nets. In EDOC 2006: Tenth IEEE International Enterprise Distributed Object Computing Conference. Hong Kong, China: IEEE Computer Society, 2006, pp. 441-444.
  3. J. Yan, Z. Li, Y. Yuan, W. Sun, J. Zhang, 2006. BPEL4WS unit testing: Test case generation using a concurrent path analysis approach. In ISSRE 2006: 17th International Symposium on Software Reliability Engineering. Raleigh, North Carolina, USA: IEEE Computer Society, pp. 75-84.
  4. Y. Yuan, Z. Li, W. Sun, 2006. A graph-search based approach to BPEL4WS test generation. In ICSEA 2006: International Conference on Software Engineering Advances. Papeete, Tahiti, French Polynesia: IEEE Computer Society, p. 14.
  5. K. Sapiecha, D. Grela, 2008a. Test scenarios generation for certain class of processes defined in BPEL language. In Annales UMCS - Informatica, vol.8, number 2/2008, pp.75-87
  6. K. Sapiecha, D. Grela, 2008b. Automating test case generation for requirements specification for processes orchestrating web services. In Information Systems Analysis and Specification vol.1, 10th International Conference on Enterprise Information Systems (ICEIS), Barcelona, pp. 381-384.
  7. S. Wagner, J. Gericke, M. Wiemann, 2008. MultiDimensional Measures for Test Case Quality. In ICSTW 7808. IEEE International Conference on Software Testing Verification and Validation Workshop.
  8. U. Farooq, C. P. Lam, 2009. Evolving the Quality of a Model Based Test Suite. In ICSTW 7809. International Conference on Software Testing, Verification and Validation Workshops.
  9. A. J. Offutt, R. H. Untch, 2000. Mutation testing for the new century. Norwell, Massachusetts, USA: Kluwer Academic Publishers, 2001, ch. Mutation, Uniting the Orthogonal, pp. 34-44.
  10. M. R. Woodward, 1993. Mutation testing - its origin and evolution. In Information and Software Technology, vol. 35, no. 3, pp. 163-169
  11. M. C. Hsueh, T. K. Tsai, R. K. Iyer, 1997. Fault Injection Techniques and Tools. In IEEE Computer, vol. 30, no. 4, pp. 75-82.
  12. P. Reinecke, K. Wolter, 2008. Towards a multi-level faultinjection test-bed for service-oriented architectures - requirements for parameterisations. In 27th International Symposium on Reliable Distributed Systems, Napoli, Italy.
  13. L. Juszczyk, S. Dustdar, 2010. Programmable fault injection testbeds for complex SOA. In 8th International Conference on Service Oriented Computing (ICSOC'10), San Francisco, USA.
  14. A. Estero-Botaro, F. Palomo-Lozano, I. Medina-Bulo, 2008. Mutation operators for WS-BPEL 2.0. In ICSSEA 2008: 21th International Conference on Software & Systems Engineering and their Applications, Paris, France.
  15. P. Mayer, D.Lubke, 2006. Towards a BPEL unit testing framework. In TAV-WEB'06: Proceedings of the workshop on Testing, analysis, and verification of web services and applications, pp. 33-42. ACM, New York.
  16. A. Benso, P. Prinetto, 2003. Fault injection techniques and tools for embedded systems reliability evaluation. Kluwer Academic Publishers, Holland.
Download


Paper Citation


in Harvard Style

Grela D., Sapiecha K. and Strug J. (2013). An Application of Software Fault Injection for Assessment of Quality of Test Sets for Business Processes Orchestrating Web-Services . In Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-8565-62-4, pages 56-62. DOI: 10.5220/0004422000560062


in Bibtex Style

@conference{enase13,
author={Damian Grela and Krzysztof Sapiecha and Joanna Strug},
title={An Application of Software Fault Injection for Assessment of Quality of Test Sets for Business Processes Orchestrating Web-Services},
booktitle={Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,},
year={2013},
pages={56-62},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004422000560062},
isbn={978-989-8565-62-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Evaluation of Novel Approaches to Software Engineering - Volume 1: ENASE,
TI - An Application of Software Fault Injection for Assessment of Quality of Test Sets for Business Processes Orchestrating Web-Services
SN - 978-989-8565-62-4
AU - Grela D.
AU - Sapiecha K.
AU - Strug J.
PY - 2013
SP - 56
EP - 62
DO - 10.5220/0004422000560062