Extending UML Testing Profile Towards Non-functional Test Modeling

Federico Toledo Rodríguez, Francesca Lonetti, Antonia Bertolino, Macario Polo Usaola, Beatriz Pérez Lamancha

2014

Abstract

The research community has broadly recognized the importance of the validation of non-functional properties including performance and dependability requirements. However, the results of a systematic survey we carried out evidenced the lack of a standard notation for designing non-functional test cases. For some time, the greatest attention of Model-Based Testing (MBT) research has focused on functional aspects. The only exception is represented by the UML Testing Profile (UML-TP) that is a lightweight extension of UML to support the design of testing artifacts, but it only provides limited support for non-functional testing. In this paper we provide a first attempt to extend UML-TP for improving the design of non-functional tests. The proposed extension deals with some important concepts of non-functional testing such as the workload and the global verdicts. As a proof of concept we show how the extended UML-TP can be used for modeling non-functional test cases of an application example.

References

  1. Abbors, F., Ahmad, T., Truscan, D., and Porres, I. (2012). MBPeT: a model-based performance testing tool. In Proc. of the Fourth International Conference on Advances in System Testing and Validation Lifecycle (VALID), pages 1-8.
  2. Abbors, F., Ahmad, T., Truscan, D., and Porres, I. (2013). Model-Based Performance Testing in the Cloud Using the MBPeT Tool. In Proc. of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE), pages 423-424.
  3. Afzal, W., Torkar, R., and Feldt, R. (2009). A systematic review of search-based testing for non-functional system properties. Information and Software Technology, 51(6):957-976.
  4. Apache (2001). Jmeter. http://jmeter.apache.org/.
  5. Baker, P., Dai, Z. R., Grabowski, J., Haugen, O., Schieferdecker, I., and Williams, C. (2007). Model-Driven Testing: Using the UML Testing Profile. SpringerVerlag New York, Inc.
  6. Balsamo, S., Di Marco, A., Inverardi, P., and Simeoni, M. (2004). Model-based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering, 30(5):295-310.
  7. Bennett, A. J. and Field, A. J. (2004). Performance engineering with the UML profile for schedulability, performance and time: a case study. In Proc. of the 12th IEEE Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS), pages 67-75.
  8. Cai, Y., Grundy, J., and Hosking, J. (2004). Experiences integrating and scaling a performance test bed generator with an open source CASE tool. In Proc. of the 19th IEEE International Conference on Automated Software Engineering (ASE), pages 36-45.
  9. da Silveira, M. B., Rodrigues, E. d. M., Zorzo, A. F., Costa, L. T., Vieira, H. V., and de Oliveira, F. M. (2011). Generation of scripts for performance testing based on UML models. In Proc. of the Twenty-Third International Conference on Software Engineering and Knowledge Engineering (SEKE), pages 258-263.
  10. de Oliveira, F. M., Menna, R. d. S., Vieira, H. V., and Ruiz, D. D. (2007). Performance testing from UML models with resource descriptions. In Proc. of 1st Brazilian Workshop on Systematic and Automated Software Testing, pages 1-8.
  11. Dias Neto, A. C., Subramanyan, R., Vieira, M., and Travassos, G. H. (2007). A survey on model-based testing approaches: a systematic review. In Proc. of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies (WEASELTech), in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering, pages 31-36.
  12. Kitchenham, B. (2004). Procedures for performing systematic reviews. In Joint Technical Report, Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1.
  13. Krishnamurthy, D., Rolia, J. A., and Majumdar, S. (2006). A synthetic workload generation technique for stress testing session-based systems. IEEE Transactions on Software Engineering, 32(11):868-882.
  14. McMinn, P. (2004). Search-based software test data generation: a survey: Research articles. Softw. Test. Verif. Reliab., 14(2):105-156.
  15. Mercury, H. (2001). Loadrunner. http://www8. hp.com/us/en/software-solutions/software.html?comp URI=1175451.
  16. OMG (1997). Unified Modeling Language. http:// www.uml.org/.
  17. OMG (2004). UML 2.0 Testing Profile Specification. http://utp.omg.org/.
  18. OMG (2011). UML Profile for Modeling and Analysis of Real-Time and Embedded systems (MARTE). http://www.omgmarte.org/.
  19. Pozin, B. A. and Galakhov, I. V. (2011). Models in performance testing. Programming and Computer Software, 37(1):15-25.
  20. Rodríguez, F. T., Lonetti, F., Bertolino, A., Usaola, M. P., and Lamancha, B. P. (2013). Extending the NonFunctional Modeling of UML-TP. Technical Report. http://pumalab.isti.cnr.it/index.php/en/.
  21. Smith, C. U., Llado, C. M., and Puigjaner, R. (2010). Performance Model Interchange Format (PMIF 2): A comprehensive approach to Queueing Network Model interoperability. Performance Evaluation, 67(7):548- 568.
  22. Utting, M. and Legeard, B. (2007). Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann Publishers Inc.
  23. Zhu, L., Bui, N. B., Liu, Y., and Gorton, I. (2007). MDABench: customized benchmark generation using MDA. Journal of Systems and Software, 80(2):265- 282.
Download


Paper Citation


in Harvard Style

Toledo Rodríguez F., Lonetti F., Bertolino A., Polo Usaola M. and Pérez Lamancha B. (2014). Extending UML Testing Profile Towards Non-functional Test Modeling . In Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-007-9, pages 488-497. DOI: 10.5220/0004878204880497


in Bibtex Style

@conference{modelsward14,
author={Federico Toledo Rodríguez and Francesca Lonetti and Antonia Bertolino and Macario Polo Usaola and Beatriz Pérez Lamancha},
title={Extending UML Testing Profile Towards Non-functional Test Modeling},
booktitle={Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},
year={2014},
pages={488-497},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004878204880497},
isbn={978-989-758-007-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Extending UML Testing Profile Towards Non-functional Test Modeling
SN - 978-989-758-007-9
AU - Toledo Rodríguez F.
AU - Lonetti F.
AU - Bertolino A.
AU - Polo Usaola M.
AU - Pérez Lamancha B.
PY - 2014
SP - 488
EP - 497
DO - 10.5220/0004878204880497