Extending UML Testing Profile Towards Non-functional Test Modeling

Federico Toledo Rodríguez, Francesca Lonetti, Antonia Bertolino, Macario Polo Usaola, Beatriz Pérez Lamancha


The research community has broadly recognized the importance of the validation of non-functional properties including performance and dependability requirements. However, the results of a systematic survey we carried out evidenced the lack of a standard notation for designing non-functional test cases. For some time, the greatest attention of Model-Based Testing (MBT) research has focused on functional aspects. The only exception is represented by the UML Testing Profile (UML-TP) that is a lightweight extension of UML to support the design of testing artifacts, but it only provides limited support for non-functional testing. In this paper we provide a first attempt to extend UML-TP for improving the design of non-functional tests. The proposed extension deals with some important concepts of non-functional testing such as the workload and the global verdicts. As a proof of concept we show how the extended UML-TP can be used for modeling non-functional test cases of an application example.


  1. Abbors, F., Ahmad, T., Truscan, D., and Porres, I. (2012). MBPeT: a model-based performance testing tool. In Proc. of the Fourth International Conference on Advances in System Testing and Validation Lifecycle (VALID), pages 1-8.
  2. Abbors, F., Ahmad, T., Truscan, D., and Porres, I. (2013). Model-Based Performance Testing in the Cloud Using the MBPeT Tool. In Proc. of the 4th ACM/SPEC International Conference on Performance Engineering (ICPE), pages 423-424.
  3. Afzal, W., Torkar, R., and Feldt, R. (2009). A systematic review of search-based testing for non-functional system properties. Information and Software Technology, 51(6):957-976.
  4. Apache (2001). Jmeter. http://jmeter.apache.org/.
  5. Baker, P., Dai, Z. R., Grabowski, J., Haugen, O., Schieferdecker, I., and Williams, C. (2007). Model-Driven Testing: Using the UML Testing Profile. SpringerVerlag New York, Inc.
  6. Balsamo, S., Di Marco, A., Inverardi, P., and Simeoni, M. (2004). Model-based Performance Prediction in Software Development: A Survey. IEEE Transactions on Software Engineering, 30(5):295-310.
  7. Bennett, A. J. and Field, A. J. (2004). Performance engineering with the UML profile for schedulability, performance and time: a case study. In Proc. of the 12th IEEE Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems (MASCOTS), pages 67-75.
  8. Cai, Y., Grundy, J., and Hosking, J. (2004). Experiences integrating and scaling a performance test bed generator with an open source CASE tool. In Proc. of the 19th IEEE International Conference on Automated Software Engineering (ASE), pages 36-45.
  9. da Silveira, M. B., Rodrigues, E. d. M., Zorzo, A. F., Costa, L. T., Vieira, H. V., and de Oliveira, F. M. (2011). Generation of scripts for performance testing based on UML models. In Proc. of the Twenty-Third International Conference on Software Engineering and Knowledge Engineering (SEKE), pages 258-263.
  10. de Oliveira, F. M., Menna, R. d. S., Vieira, H. V., and Ruiz, D. D. (2007). Performance testing from UML models with resource descriptions. In Proc. of 1st Brazilian Workshop on Systematic and Automated Software Testing, pages 1-8.
  11. Dias Neto, A. C., Subramanyan, R., Vieira, M., and Travassos, G. H. (2007). A survey on model-based testing approaches: a systematic review. In Proc. of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies (WEASELTech), in conjunction with the 22nd IEEE/ACM International Conference on Automated Software Engineering, pages 31-36.
  12. Kitchenham, B. (2004). Procedures for performing systematic reviews. In Joint Technical Report, Keele University Technical Report TR/SE-0401 and NICTA Technical Report 0400011T.1.
  13. Krishnamurthy, D., Rolia, J. A., and Majumdar, S. (2006). A synthetic workload generation technique for stress testing session-based systems. IEEE Transactions on Software Engineering, 32(11):868-882.
  14. McMinn, P. (2004). Search-based software test data generation: a survey: Research articles. Softw. Test. Verif. Reliab., 14(2):105-156.
  15. Mercury, H. (2001). Loadrunner. http://www8. hp.com/us/en/software-solutions/software.html?comp URI=1175451.
  16. OMG (1997). Unified Modeling Language. http:// www.uml.org/.
  17. OMG (2004). UML 2.0 Testing Profile Specification. http://utp.omg.org/.
  18. OMG (2011). UML Profile for Modeling and Analysis of Real-Time and Embedded systems (MARTE). http://www.omgmarte.org/.
  19. Pozin, B. A. and Galakhov, I. V. (2011). Models in performance testing. Programming and Computer Software, 37(1):15-25.
  20. Rodríguez, F. T., Lonetti, F., Bertolino, A., Usaola, M. P., and Lamancha, B. P. (2013). Extending the NonFunctional Modeling of UML-TP. Technical Report. http://pumalab.isti.cnr.it/index.php/en/.
  21. Smith, C. U., Llado, C. M., and Puigjaner, R. (2010). Performance Model Interchange Format (PMIF 2): A comprehensive approach to Queueing Network Model interoperability. Performance Evaluation, 67(7):548- 568.
  22. Utting, M. and Legeard, B. (2007). Practical Model-Based Testing: A Tools Approach. Morgan Kaufmann Publishers Inc.
  23. Zhu, L., Bui, N. B., Liu, Y., and Gorton, I. (2007). MDABench: customized benchmark generation using MDA. Journal of Systems and Software, 80(2):265- 282.

Paper Citation

in Harvard Style

Toledo Rodríguez F., Lonetti F., Bertolino A., Polo Usaola M. and Pérez Lamancha B. (2014). Extending UML Testing Profile Towards Non-functional Test Modeling . In Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-007-9, pages 488-497. DOI: 10.5220/0004878204880497

in Bibtex Style

author={Federico Toledo Rodríguez and Francesca Lonetti and Antonia Bertolino and Macario Polo Usaola and Beatriz Pérez Lamancha},
title={Extending UML Testing Profile Towards Non-functional Test Modeling},
booktitle={Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},

in EndNote Style

JO - Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Extending UML Testing Profile Towards Non-functional Test Modeling
SN - 978-989-758-007-9
AU - Toledo Rodríguez F.
AU - Lonetti F.
AU - Bertolino A.
AU - Polo Usaola M.
AU - Pérez Lamancha B.
PY - 2014
SP - 488
EP - 497
DO - 10.5220/0004878204880497