Automated State-based Online Testing Real-time Embedded Software with RTEdge

Wafa Hasanain, Yvan Labiche, Serban Gheorghe

2015

Abstract

Verifying a real time embedded application is challenging since one has to consider timing requirements in addition to functional ones. During online state-based testing the generation and execution of test cases happen concurrently: test case generation uses information from a state-based test model in combination with observed execution behaviour. This paper describes a practical online testing algorithm that is implemented in the state-based modeling tool RTEdge. Two case studies show that our online testing algorithm produces a test suite that achieves high model coverage, thus facilitating the automated verification of real-time embedded software.

References

  1. P. Ammann and J. Offutt, Introduction to Software Testing, Cambridge University Press, 2008.
  2. A. Arcuri and L. Briand, “Adaptive random testing: an illusion of effectiveness?” Proc. ACM ISSTA, 2011.
  3. A. Arcuri, M. Z. Iqbal and L. Briand, “Formal analysis of the effectiveness and predictability of random testing,” Proc. ACM ISSTA, 2010.
  4. N. Asoudeh and Y. Labiche, “Multi-objective construction of an entire adequate test suite for an EFSM,” IEEE ISSRE, 2014.
  5. A. Burns, “How to Verify a Safe Real-Time System The Application of Model Checking and a Timed Automata to the Production Cell Case Study,” Real-Time Systems Journal, 24 (2), 1998.
  6. T. Y. Chen, H. Leung and I. K. Mak., “Adaptive random testing,” Proc. Asian Computing Science Conf., 2005.
  7. R. Cleaveland, S. A. Smolka and S. T. Sims, “An Instrumentation-Based Approach to Controller Model Validation,” Proc. Automotive Soft. Workshop. 2008.
  8. Conformiq, TTCN-3, Qtronic and SIP: The Model-Based Testing of a Protocol Stack, a TTCN-3 Integrated Approach, http://www.verifysoft.com/ttcn3_qtronic_sip.pdf, [Last checked: May 2014] A. Y. Duale and M. Ü. Uyar, “A method enabling feasible conformance test sequence generation for EFSM models,” IEEE Trans. on Computers, 53 (5), 2004.
  9. J. W. Duran and S. C. Ntafos, “An evaluation of random testing,” IEEE TSE, SE-10 (4), 1984.
  10. P. H. Feiler and D. P. Gluch, Model-Based Engineering with AADL, Addison-Wesley, 2012.
  11. G. Fraser and A. Arcuri, “Whole Test Suite Generation,” IEEE TSE, 39 (2), 2013.
  12. G. Fraser, F. Wotawa and P. E. Ammann, “Testing with model checkers: a survey,” STVR, 19 (3), 2009.
  13. A. Gargantini and C. Heitmeyer, “Using Model Checking to Generate Tests from Requirements Specifications,” Proc. European Soft. Eng. Conf., 1999.
  14. S. Gheorghe, “Integrating Formal Model Checking with the RTEdge™ AADL Microkernel,” SAE Internaional Journal of Aerospace, 4 (2), 2011.
  15. P. Godefroid, N. Klarlund and K. Sen, “DART: directed automated random testing,” Proc. ACM PLDI, 2005.
  16. A. Groce, “Coverage rewarded: Test input generation via adaptation-based programming,” Proc. ASE, 2011.
  17. Q. Guo, R. Hierons, M. Harman, K. Derderian, “Computing Unique Input/Output Sequences Using Genetic Algorithms,” Proc. FATES, 2004.
  18. W. Hasanain, Verifying Real-Time Embedded Software by Means of Automated State-based Online Testing and the SPIN Model Checker-Application to RTEdge Models, Carleton University, 2013. https://curve.carleton.ca/system/files/theses/27490.pdf.
  19. R. L. Haupt and S. E. Haupt, Practical Genetic Algorithms, Wiley, 1998.
  20. G. J. Holzmann, The SPIN Model checker, AddisonWesley, 2003.
  21. X. Jin, G. Ciardo, T.-H. Kim and Y. Zhao., “Symbolic verification and test generation for a network of communicating FSMs.,” Proc. ATVA, 2011.
  22. A. S. Kalaji, R. M. Hierons and S. Swift, “An integrated search-based approach for automatic testing from extended finite state machine (EFSM) models,” IST, 53 (12), 2011.
  23. M. Khalil and Y. Labiche, “On the Round Trip Path Testing Strategy,” IEEE ISSRE, 2010.
  24. K. G. Larsen, M. Mikucionis, B. Nielsen and A. Skou., “Testing real-time embedded software using UPPAAL-TRON: an industrial case study.,” Proc. ACM EMSOFT, 2005.
  25. D. Y. Lee and M. Yannakakis, “Principles and methods of testing finite state machines-a survey,” Proc. of the IEEE, 84 (8), 1996.
  26. C. Lewerentz and T. Lindner (Ed.), Formal Development of Reactive Systems: Case Study Production Cell, LNCS, 1995.
  27. J. J. Li and W. E. Wong, “Automatic test generation from communicating extended finite state machine (CEFSM)-based models,” Proc. IEEE ISORC, 2002.
  28. G. Luo, G. V. Bochmann and A. Petrenko, “Test selection based on communicating nondeterministic finite-state machines using a generalized Wp-method,” IEEE TSE, 20 (2), 1994.
  29. A. P. Mathur, Foundations of Software Testing, Pearson, 2008.
  30. S. Mouchawrab, L.C. Briand, Y. Labiche, M. Di Penta, “Assessing, Comparing, and Combining State Machine-Based Testing and Structural Testing: A Series of Experiments,” IEEE TSE, 37(2), 2011.
  31. C. Pacheco, S. K. Lahiri, M. D. Ernst and T. Ball., “Feedback-directed random test generation,” Proc. ACM/IEEE ICSE, 2007.
  32. T. Pender, UML bible, Wiley, 2003.
  33. R. Sarkar, “Proof-Based Engineering of Real-Time Applications: An RTEdge™ Case Study,” SAE Int. Journal of Aerospace, 3 (1), 2010.
  34. M. Satpathy, A. Yeolekar and S. Ramesh, “Randomized directed testing (redirect) for simulink/stateflow models,” in Proc. ACM EMSOFT, 2008.
  35. C. Schwarzl and B. Peischl, “Test Sequence Generation from Communicating UML State Charts: An Industrial Application of Symbolic Transition Systems,” Proc. IEEE QSIC, 2010.
  36. M. Shafique and Y. Labiche, “A systematic review of state-based test tools,” STTT, 2013.
  37. P. Thévenod-Fosse and H. Waeselynck, “An investigation of statistical software testing,” STVR, 1 (2), 1991.
  38. J. Tretmans, “Model based testing with labelled transition systems,” LNCS, 2008.
  39. J. Vain, A. Kull, M. Kääramees, M. Markvardt and K. Raiend, in J. Zander, I. Schiferdecker, and P. Mosterman, Eds., Model-Based Testing for Embedded Systems, CRC Press, 2011.
Download


Paper Citation


in Harvard Style

Hasanain W., Labiche Y. and Gheorghe S. (2015). Automated State-based Online Testing Real-time Embedded Software with RTEdge . In Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-083-3, pages 294-302. DOI: 10.5220/0005243402940302


in Bibtex Style

@conference{modelsward15,
author={Wafa Hasanain and Yvan Labiche and Serban Gheorghe},
title={Automated State-based Online Testing Real-time Embedded Software with RTEdge},
booktitle={Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},
year={2015},
pages={294-302},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005243402940302},
isbn={978-989-758-083-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Automated State-based Online Testing Real-time Embedded Software with RTEdge
SN - 978-989-758-083-3
AU - Hasanain W.
AU - Labiche Y.
AU - Gheorghe S.
PY - 2015
SP - 294
EP - 302
DO - 10.5220/0005243402940302