On Mutating UPPAAL Timed Automata to Assess Robustness of Web Services

Faezeh Siavashi, Dragos Truscan, Jüri Vain

2016

Abstract

We present a model-based mutation technique for testing the robustness of Web service compositions. Specifi- cations of a Web service composition is modeled by UPPAAL Timed Automata and the conformance between the model and the implementation is validated by online model-based testing with the UPPAAL TRON tool. By applying a set of well-defined mutation operators, we generated model mutations. We validate all generate mutants and exclude the invalid ones. The remaining mutants are used for online robustness testing providing invalid test inputs and revealing vulnerabilities of the implementation under test. We experimented our method on a Booking System web service composition. The results show that from a total of 1346 generated mutants, 393 are found suitable for online model-based testing. After running the tests, 40 of the mutants revealed 3 new errors in the implementation. The experiment shows that our approach of mutating specifications is effective in detecting errors that were not revealing in the conventional conformance testing methods.

References

  1. Aboutrab, M. et al. (2012). Specification mutation analysis for validating timed testing approaches based on timed automata. In 36th Annual IEEE Computer Software and Applications Conference, COMPSAC 2012, Izmir, Turkey, July 16-20, 2012, pages 660-669.
  2. Aichering, B. et al. (2013). Time for MutantsModel-Based Mutation Testing with Timed Automata. In Tests and Proofs, pages 20-38. Springer.
  3. Alur, R. et al. (1990). Model-checking for real-time systems. In Logic in Computer Science, 1990. LICS'90, Proceedings., Fifth Annual IEEE Symposium on e, pages 414-425. IEEE.
  4. Beharmann, G. et al. (2004). A tutorial on uppaal. In Formal methods for the design of real-time systems, pages 200-236. Springer.
  5. Belli, F. et al. (2016). Model-based mutation testingapproach and case studies. Science of Computer Programming, 120:25 - 48.
  6. Bozkurt, M. and other (2010). Testing web services: A survey. Department of Computer Science, King's College London, Tech. Rep. TR-10-01.
  7. Budd, T. A. and Gopal, A. S. (1985). Program testing by specification mutation. Computer Languages, 10(1):63 - 73.
  8. Cambronero, M. E. et al. (2011). Validation and verification of web services choreographies by using timed automata. Journal of Logic and Algebraic Programming, 80(1):25-49.
  9. Diaz, G. et al. (2007). Model checking techniques applied to the design of web services. CLEI Electronic Journal, 10(2).
  10. Gargantini, A. and Heitmeyer, C. (1999). Using model checking to generate tests from requirements specifications. In Software EngineeringESEC/FSE99, pages 146-162. Springer.
  11. Hessel, A. et al. (2008). Testing Real-time Systems Using UPPAAL. In Hierons, R. M., Bowen, J. P., and Harman, M., editors, Formal Methods and Testing, pages 77-117. Springer-Verlag, Berlin, Heidelberg.
  12. Jia, Y. and Harman, M. (2011). An analysis and survey of the development of mutation testing. Software Engineering, IEEE Transactions on, 37(5):649-678.
  13. Larsen, K. et al. (2005a). Testing real-time embedded software using UPPAAL-TRON: an industrial case study. In Proceedings of the 5th ACM international conference on Embedded software, pages 299-306. ACM.
  14. Larsen, K., Mikucionis, M., and Nielsen, B. (2005b). Online testing of real-time systems using uppaal. In Grabowski, J. and Nielsen, B., editors, Formal Approaches to Software Testing, volume 3395 of Lecture Notes in Computer Science, pages 79-94. Springer Berlin Heidelberg.
  15. Lee, S. et al. (2008). Automatic Mutation Testing and Simulation on OWL-S Specified Web Services. In Simulation Symposium, 2008. ANSS 2008. 41st Annual, pages 149-156.
  16. Lee, S. C. and Offutt, J. (2001). Generating test cases for XML-based Web component interactions using mutation analysis. In Software Reliability Engineering, 2001. ISSRE 2001. Proceedings. 12th International Symposium on, pages 200-209.
  17. Li, J.-h., Dai, G.-x., and Li, H.-h. (2009). Mutation analysis for testing finite state machines. In Electronic Commerce and Security, 2009. ISECS'09. Second International Symposium on, volume 1, pages 620-624. IEEE.
  18. Rauf, I. et al. (2014). An Integrated Approach for Designing and Validating REST Web Service Compositions. In Monfort, V. and Krempels, K.-H., editors, 10th International Conference on Web Information Systems and Technologies, volume 1, page 104115. SCITEPRESS Digital Library.
  19. Richardson, L. and Ruby, S. (2008). RESTful web services. O'Reilly.
  20. Rusli, H. M. et al. (2011). Testing Web services composition: a mapping study. Communications of the IBIMA, 2007:34-48.
  21. Sheng, Q. et al. (2014). Web services composition: A decades overview . Information Sciences, 280:218 - 238.
  22. Wang, R. and Huang, N. (2008). Requirement Model-Based Mutation Testing for Web Service. In Next Generation Web Services Practices, 2008. NWESP 7808. 4th International Conference on, pages 71-76.
Download


Paper Citation


in Harvard Style

Siavashi F., Truscan D., Rauf I. and Vain J. (2016). On Mutating UPPAAL Timed Automata to Assess Robustness of Web Services . In Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016) ISBN 978-989-758-194-6, pages 15-26. DOI: 10.5220/0005970800150026


in Bibtex Style

@conference{icsoft-ea16,
author={Faezeh Siavashi and Dragos Truscan and Irum Rauf and Jüri Vain},
title={On Mutating UPPAAL Timed Automata to Assess Robustness of Web Services},
booktitle={Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016)},
year={2016},
pages={15-26},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005970800150026},
isbn={978-989-758-194-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2016)
TI - On Mutating UPPAAL Timed Automata to Assess Robustness of Web Services
SN - 978-989-758-194-6
AU - Siavashi F.
AU - Truscan D.
AU - Rauf I.
AU - Vain J.
PY - 2016
SP - 15
EP - 26
DO - 10.5220/0005970800150026