Natural-language Scenario Descriptions for Testing Core Language Models of Domain-Specific Languages

Bernhard Hoisl, Stefan Sobernig, Mark Strembeck

2014

Abstract

The core language model is a central artifact of domain-specific modeling languages (DSMLs) as it captures all relevant domain abstractions and their relations. Natural-language scenarios are a means to capture requirements in a way that can be understood by technical as well as non-technical stakeholders. In this paper, we use scenarios for the testing of structural properties of DSML core language models. In our approach, domain experts and DSML engineers specify requirements via structured natural-language scenarios. These scenario descriptions are then automatically transformed into executable test scenarios providing forward and backward traceability of domain requirements. To demonstrate the feasibility of our approach, we used Eclipse Xtext to implement a requirements language for the definition of semi-structured scenarios. Transformation specifications generate executable test scenarios that run in our test platform which is built on the Eclipse Modeling Framework and the Epsilon language family.

References

  1. Cicchetti, A., Ruscio, D. D., Kolovos, D. S., and Pierantonio, A. (2011). A test-driven approach for metamodel development. In Emerging Tech. for the Evolution and Maintenance of Softw. Models, pages 319-342. IGI Global.
  2. Cockburn, A. (2001). Writing Effective Use Cases. Addison-Wesley.
  3. Czarnecki, K. and Eisenecker, U. W. (2000). Generative Programming - Methods, Tools, and Applications. Addison-Wesley Longman Publishing Co., Inc., 6th edition.
  4. Czarnecki, K. and Helsen, S. (2006). Feature-based survey of model transformation approaches. IBM Systems Journal, 45(3):621-645.
  5. Diethelm, I., Geiger, L., and Zündorf, A. (2005). Applying story driven modeling to the Paderborn shuttle system case study. In Proc. Int. Conf. Scenarios: Models, Transformations and Tools, volume 3466 of LNCS, pages 109-133. Springer.
  6. Dwarakanath, A. and Sengupta, S. (2012). Litmus: Generation of test cases from functional requirements in natural language. In Proc. 17th Int. Conf. Applications of Natural Language Processing and Information Systems, pages 58-69. Springer.
  7. Gervasi, V. and Nuseibeh, B. (2002). Lightweight validation of natural language requirements. SP&E, 32(2):113-133.
  8. Goknil, A., Kurtev, I., and Berg, K. (2008). A metamodeling approach for reasoning about requirements. In Proc. 4th European Conf. Model Driven Architecture: Foundations and Applications, volume 5095 of LNCS, pages 310-325. Springer.
  9. Gomez, J. J. C., Baudry, B., and Sahraoui, H. (2012). Searching the boundaries of a modeling space to test metamodels. In Proc. 5th IEEE Int. Conf. Softw. Testing, Verification and Validation, pages 131-140. IEEE.
  10. Hoisl, B., Sobernig, S., and Strembeck, M. (2013). Higherorder rewriting of model-to-text templates for integrating domain-specific modeling languages. In Proc. 1st Int. Conf. Model-Driven Eng. and Softw. Dev., pages 49-61. SciTePress.
  11. Hoisl, B., Strembeck, M., and Sobernig, S. (2012). Towards a systematic integration of MOF/UML-based domainspecific modeling languages. In Proc. 16th IASTED Int. Conf. on Softw. Eng. and Applications, pages 337- 344. ACTA Press.
  12. Institute of Electrical and Electronics Engineers (2011). Systems and software engineering - life cycle processes - requirements engineering. Available at: http://standards.ieee.org/findstds/ standard/29148-2011.html. ISO/IEC/IEEE 29148:2011.
  13. Jarke, M., Bui, X. T., and Carroll, J. M. (1998). Scenario management: An interdisciplinary approach. Requ. Eng., 3(3-4):155-173.
  14. Kolovos, D., Rose, L., García-Domínguez, A., and Paige, R. (2013). The Epsilon book. Available at: http: //www.eclipse.org/epsilon/doc/book/.
  15. Lisboa, L. B., Garcia, V. C., Lucrédio, D., de Almeida, E. S., de Lemos Meira, S. R., and de Mattos Fortes, R. P. (2010). A systematic review of domain analysis tools. Inform. Softw. Tech., 52(1):1-13.
  16. Marcus, A., Maletic, J. I., and Sergeyev, A. (2005). Recovery of traceability links between software documentation and source code. Int. J. Softw. Eng. and Knowledge Eng., 15(5):811-836.
  17. Merilinna, J. and Pärssinen, J. (2010). Verification and validation in the context of domain-specific modelling. In Proc. 10th Workshop Domain-Specific Modeling, pages 9:1-9:6. ACM.
  18. Merilinna, J., Puolitaival, O.-P., and Pärssinen, J. (2008). Towards model-based testing of domain-specific modelling languages. In Proc. 8th Workshop DomainSpecific Modeling, pages 39-44.
  19. Mugridge, R. and Cunningham, W. (2005). Fit for Developing Software: Framework for Integrated Tests. Prentice Hall.
  20. Neill, C. J. and Laplante, P. A. (2003). Requirements engineering: The state of the practice. IEEE Softw., 20(6):40-45.
  21. Object Management Group (2011). OMG Unified Modeling Language (OMG UML), Superstructure. Available at: http://www.omg.org/spec/UML. Version 2.4.1, formal/2011-08-06.
  22. Object Management Group (2013). OMG Meta Object Facility (MOF) Core Specification. Available at: http://www.omg.org/spec/MOF. Version 2.4.1, formal/2013-06-01.
  23. Sadilek, D. A. and Weißleder, S. (2008). Testing metamodels. In Proc. 4th European Conf. Model Driven Architecture: Foundations and Applications, volume 5095 of LNCS, pages 294-309. Springer.
  24. Santiago Júnior, V. A. D. and Vijaykumar, N. L. (2012). Generating model-based test cases from natural language requirements for space application software. Softw. Quality Control, 20(1):77-143.
  25. Sendall, S. and Kozaczynski, W. (2003). Model transformation: The heart and soul of model-driven software development. IEEE Softw., 20(5):42-45.
  26. Sobernig, S., Hoisl, B., and Strembeck, M. (2013). Requirements-driven testing of domain-specific core language models using scenarios. In Proc. 13th Int. Conf. Quality Softw., pages 163-172. IEEE Computer Society.
  27. Somé, S. (2009). A meta-model for textual use case description. JOT, 8(7):87-106.
  28. Stahl, T. and Völter, M. (2006). Model-Driven Software Development. John Wiley & Sons.
  29. Strembeck, M. (2011). Testing policy-based systems with scenarios. In Proc. 10th IASTED Int. Conf. Softw. Eng., pages 64-71. ACTA Press.
  30. Strembeck, M. and Zdun, U. (2009). An approach for the systematic development of domain-specific languages. SP&E, 39(15):1253-1292.
  31. Sutcliffe, A. (2002). User-Centred Requirements Engineering: Theory and Practice. Springer.
  32. Uchitel, S., Kramer, J., and Magee, J. (2003). Synthesis of behavioral models from scenarios. IEEE Trans. Softw. Eng., 29(2):99-115.
  33. Wimmer, M., Kusel, A., Schönböck, J., Retschitzegger, W., Schwinger, W., and Kappel, G. (2010). On using inplace transformations for model co-evolution. In Proc. 2nd Int. Workshop Model Transformation with ATL, volume 711, pages 65-78. CEUR Workshop Proceedings.
  34. Winkler, S. and Pilgrim, J. (2010). A survey of traceability in requirements engineering and model-driven development. SoSyM, 9(4):529-565.
  35. Wynne, M. and Hellesøy, A. (2012). The Cucumber Book: Behaviour-Driven Development for Testers and Developers. Pragmatic Programmers.
  36. Yue, T., Briand, L. C., and Labiche, Y. (2013). Facilitating the transition from use case models to analysis models: Approach and experiments. ACM Trans. Softw. Eng. and Methodology, 22(1):5:1-5:38.
Download


Paper Citation


in Harvard Style

Hoisl B., Sobernig S. and Strembeck M. (2014). Natural-language Scenario Descriptions for Testing Core Language Models of Domain-Specific Languages . In Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-007-9, pages 356-367. DOI: 10.5220/0004713703560367


in Bibtex Style

@conference{modelsward14,
author={Bernhard Hoisl and Stefan Sobernig and Mark Strembeck},
title={Natural-language Scenario Descriptions for Testing Core Language Models of Domain-Specific Languages},
booktitle={Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},
year={2014},
pages={356-367},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004713703560367},
isbn={978-989-758-007-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Natural-language Scenario Descriptions for Testing Core Language Models of Domain-Specific Languages
SN - 978-989-758-007-9
AU - Hoisl B.
AU - Sobernig S.
AU - Strembeck M.
PY - 2014
SP - 356
EP - 367
DO - 10.5220/0004713703560367