Towards a Method for Combined Model-based Testing and Analysis

Brian Nielsen

2014

Abstract

Efficient and effective verification and validation of complex embedded systems is challenging, and requires the use of various tools and techniques, such as model-based testing and analysis. The aim of this paper is to devise an overall \method{} for how analysis and testing may be used in combination to increase the quality of embedded systems, and reduce development cost. The method is centered on a common verification planning and iteratively exploiting the established results to strengthen the verification activities. We conclude that the proposed method is general enough to capture most interesting combinations and workflows, but also that formulation of more specific combination patterns will be useful to encourage future tool collaborations.

References

  1. Abrial, J.-R. (1996). The B-book: Assigning Programs to Meanings. Cambridge University Press, New York, NY, USA.
  2. Abrial, J.-R. (2010). Modeling in Event-B: System and Software Engineering. Cambridge University Press, New York, NY, USA, 1st edition.
  3. Baier, C. and Katoen, J.-P. (2008). Principles of Model Checking (Representation and Mind Series). The MIT Press.
  4. Blackmore, T., Halliwell, D., Barker, P., Eder, K., and Ramaram, N. (2012). Analysing and closing simulation coverage by automatic generation and verification of formal properties from coverage reports. In Integrated Formal Methods, pages 84-98. Springer.
  5. Bulychev, P., David, A., Guldstrand Larsen, K., Legay, A., Mikuionis, M., and Bgsted Poulsen, D. (2012). Checking and distributing statistical model checking. In Goodloe, A. and Person, S., editors, NASA Formal Methods, volume 7226 of Lecture Notes in Computer Science, pages 449-463. Springer Berlin Heidelberg.
  6. D'Silva, V., Kroening, D., and Weissenbacher, G. (2008). A survey of automated techniques for formal software verification. Computer-Aided Design of Integrated Circuits and Systems, IEEE Transactions on, 27(7):1165-1178.
  7. Eagan, M. E. (1986). Advances in software inspections. IEEE Trans. Softw. Eng., 12(7):744-751.
  8. Elberzhager, F., Münch, J., and Nha, V. T. N. (2012). A systematic mapping study on the combination of static and dynamic quality assurance techniques. Information and Software Technology, 54(1):1-15.
  9. Engel, A. (2010). Verification, Validation, and Testing of Engineered Systems, volume 84. Wiley. com.
  10. Estefan, J. A. et al. (2007). Survey of model-based systems engineering (mbse) methodologies. Incose MBSE Focus Group, 25.
  11. Foster, H., Loh, L., Rabii, B., and Singhal, V. (2006). Guidelines for creating a formal verification testplan. Proc. Design & Verification Conference.
  12. France, R., Ghosh, S., Dinh-Trong, T., and Solberg, A. (2006). Model-driven development using uml 2.0: promises and pitfalls. Computer, 39(2):59 - 66.
  13. Gunter, E. and Peled, D. (2005). Model checking, testing and verification working together. Formal Aspects of Computing, 17(2):201-221.
  14. Henzinger, T. A. and Sifakis, J. (2007). The discipline of embedded systems design. Computer, 40(10):32-40.
  15. IEEE (1998). IEEE 1028-1997; IEEE Standard for Software Reviews. IEEE Standards.
  16. IEEE (2004). IEEE 1012-2004; IEEE Standard for Software Verification and Validation, 2004. IEEE Standards.
  17. INCOSE (2013). What is systems engineering. International Council on Systems Engineering www.incose.org/practice/whatissystemseng.aspx.
  18. Jean-Louis Boulanger, editor (2012a). Industrial Use of Formal Methods Formal Verification. Wiley.
  19. Jean-Louis Boulanger, editor (2012b). Industrial Use of Formal Methods From Model to Code. Wiley.
  20. Jhala, R. and Majumdar, R. (2009). Software model checking. ACM Comput. Surv., 41(4):21:1-21:54.
  21. Kharmeh, S. A., Eder, K., and May, D. (2011). A design-for-verification framework for a configurable performance-critical communication interface. In Formal Modeling and Analysis of Timed Systems, pages 335-351. Springer.
  22. King, J. C. (1976). Symbolic execution and program testing. Commun. ACM, 19(7):385-394.
  23. Legay, A., Delahaye, B., and Bensalem, S. (2010). Statistical model checking: An overview. In Proceedings of the First International Conference on Runtime Verification, RV'10, pages 122-135, Berlin, Heidelberg. Springer-Verlag.
  24. Leucker, M. and Schallhart, C. (2009). A brief account of runtime verification. Journal of Logic and Algebraic Programming, 78(5):293-303.
  25. Mader, A. H., Wupper, H., and Boon, M. (2007). The construction of verification models for embedded systems. Technical Report TR-CTIT-07-02, Centre for Telematics and Information Technology University of Twente, Enschede.
  26. Mellor, S. J., Clark, A. N., and Futagami, T. (2003). Guest editors' introduction: Model-driven development. IEEE Software, 20:14-18.
  27. Namjoshi, K. S. and Trefler, R. J. (2010). On the completeness of compositional reasoning methods. ACM Trans. Comput. Logic, 11(3):16:1-16:22.
  28. Peleska, J. (2010). Integrated and automated abstract interpretation, verification and testing of c/c++ modules. In Dams, D., Hannemann, U., and Steffen, M., editors, Concurrency, Compositionality, and Correctness, volume 5930 of Lecture Notes in Computer Science, pages 277-299. Springer Berlin Heidelberg.
  29. Sharygina, N. and Peled, D. (2001). A combined testing and verification approach for software reliability. In FME 2001: Formal Methods for Increasing Software Productivity, pages 611-628. Springer.
  30. Utting, M., Pretschner, A., and Legeard, B. (2012). A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab., 22(5):297-312.
  31. Wallace, D. R. and Fujii, R. U. (1989). Software verification and validation: An overview. IEEE Softw., 6(3):10- 17.
Download


Paper Citation


in Harvard Style

Nielsen B. (2014). Towards a Method for Combined Model-based Testing and Analysis . In Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MBAT, (MODELSWARD 2014) ISBN 978-989-758-007-9, pages 609-618. DOI: 10.5220/0004873106090618


in Bibtex Style

@conference{mbat14,
author={Brian Nielsen},
title={Towards a Method for Combined Model-based Testing and Analysis},
booktitle={Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MBAT, (MODELSWARD 2014)},
year={2014},
pages={609-618},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004873106090618},
isbn={978-989-758-007-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Model-Driven Engineering and Software Development - Volume 1: MBAT, (MODELSWARD 2014)
TI - Towards a Method for Combined Model-based Testing and Analysis
SN - 978-989-758-007-9
AU - Nielsen B.
PY - 2014
SP - 609
EP - 618
DO - 10.5220/0004873106090618