Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development

Rakesh Rana, Miroslaw Staron, Christian Berger, Jörgen Hansson, Martin Nilsson, Fredrik Törner

2013

Abstract

The rapid growth of software intensive active safety functions in modern cars resulted in adoption of new safety development standards like ISO 26262 by the automotive industry. Hazard analysis, safety assessment and adequate verification and validation methods for software and car electronics require effort but in the long run save lives. We argue that in the face of complex software development set-up with distributed functionality, Model-Based Development (MBD) and safety-criticality of software embedded in modern cars, there is a need for evolving existing methods of MBD and complementing them with methods already used in the development of other systems (Fault Injection and Mutation Testing). Our position is that significant effectiveness and efficiency improvements can be made by applying fault injection techniques combined with mutation testing approach for verification and validation of automotive software at the model level. The improvements include such aspects as identification of safety related defects early in the development process thus providing enough time to remove the defects. The argument is based on our industrial case studies, the studies of ISO 26262 standard and academic experiments with new verification and validation methods applied to models.

References

  1. Andrews, J. H., Briand, L. C., Labiche, Y., 2005. Is mutation an appropriate tool for testing experiments? [software testing], in: Software Engineering, 2005. ICSE 2005. Proceedings. 27th International Conference On. pp. 402-411.
  2. Boehm, B., Basili, V. R., 2001. Defect Reduction Top 10 List. Computer 135-137.
  3. Brillout, A., He, N., Mazzucchi, M., Kroening, D., Purandare, M., Rümmer, P., Weissenbacher, G., 2010. Mutation-based test case generation for simulink models, in: Formal Methods for Components and Objects. pp. 208-227.
  4. Broy, M., 2006. Challenges in automotive software engineering, in: Proceedings of the 28th International Conference on Software Engineering. pp. 33-42.
  5. Charette, R. N., 2009. This Car Runs on Code. http://spectrum.ieee.org/green-tech/advanced-cars/thiscar-runs-on-code.
  6. DeMillo, R. A., Lipton, R. J., Sayward, F.G., 1978. Hints on test data selection: Help for the practicing programmer. Computer 11, 34-41.
  7. Fennel, H., Bunzel, S., Heinecke, H., Bielefeld, Jü, rgen, Fü, rst, S., Schnelle, K.-P., Grote, W., Maldener, N., Weber, T., Wohlgemuth, F., others, 2006. Achievements and exploitation of the AUTOSAR development partnership. Convergence 2006, 10.
  8. Hillenbrand, M., Heinz, M., Adler, N., Müller-Glaser, K.D., Matheis, J., Reichmann, C., 2010. ISO/DIS 26262 in the context of electric and electronic architecture modeling, in: Architecting Critical Systems. Springer, pp. 179-192.
  9. Hsueh, M. C., Tsai, T. K., Iyer, R. K., 1997. Fault injection techniques and tools. Computer 30, 75-82.
  10. ISO 26262 - 2011, 2011. Road vehicles -- Functional safety -- Part 1-10.
  11. Jia, Y., Harman, M., 2011. An analysis and survey of the development of mutation testing. Softw. Eng. IEEE Trans. 37, 649-678.
  12. Jones, E. L., 2001. Integrating testing into the curriculum-arsenic in small doses, in: ACM SIGCSE Bulletin. pp. 337-341.
  13. Joshi, A., Heimdahl, M. P. E., 2005. Model-based safety analysis of simulink models using SCADE design verifier.
  14. Kakade, R., Murugesan, M., Perugu, B., Nair, M., 2010. Model-Based Development of Automotive Electronic Climate Control Software. Model. Found. Appl. 144- 155.
  15. Megen, R., Meyerhoff, D. B., 1995. Costs and benefits of early defect detection: experiences from developing client server and host applications. Softw. Qual. J. 4, 247-256.
  16. Mellegård, N., Staron, M., Tö, rner, F., 2012. A lightweight defect classification scheme for embedded automotive software and its initial evaluation.
  17. Mellegård, N., Staron, M., Törner, F., 2013. A LightWeight Defect Classification Scheme for Embedded Automotive Software Development.
  18. Offutt, A. J., 1992. Investigations of the software testing coupling effect. Acm Trans. Softw. Eng. Methodol. Tosem 1, 5-20.
  19. Plummer, A., 2006. Model-in-the-loop testing. Proc. Inst. Mech. Eng. Part J. Syst. Control Eng. 220, 183-199.
  20. Rana, R., Staron, M., Berger, C., Hansson, J., Nilsson, M., Törner, F., 2013. Improving Fault Injection in Automotive Model Based Development using Fault Bypass Modeling. Submitted To: 2nd Workshop on Software-Based Methods for Robust Embedded Systems, Informatik 2013, Koblenz, Germany.
  21. Schätz, B., 2010. Certification of Embedded SoftwareImpact of ISO DIS 26262 in the Automotive Domain, in: Leveraging Applications of Formal Methods, Verification, and Validation. Springer, pp. 3-3.
  22. Svenningsson, R., Vinter, J., Eriksson, H., Törngren, M., 2010. MODIFI: a MODel-implemented fault injection tool. Comput. Saf. Reliab. Secur. 210-222.
  23. Vinter, J., Bromander, L., Raistrick, P., Edler, H., n.d. FISCADE - A Fault Injection Tool for SCADE Models, in: Automotive Electronics, 2007 3rd Institution of Engineering and Technology Conference On. pp. 1-9.
  24. Ziade, H., Ayoubi, R. A., Velazco, R., others, 2004. A survey on fault injection techniques. Int Arab J Inf Technol 1, 171-186.
Download


Paper Citation


in Harvard Style

Rana R., Staron M., Berger C., Hansson J., Nilsson M. and Törner F. (2013). Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development . In Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013) ISBN 978-989-8565-68-6, pages 251-257. DOI: 10.5220/0004592002510257


in Bibtex Style

@conference{icsoft-ea13,
author={Rakesh Rana and Miroslaw Staron and Christian Berger and Jörgen Hansson and Martin Nilsson and Fredrik Törner},
title={Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development},
booktitle={Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013)},
year={2013},
pages={251-257},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004592002510257},
isbn={978-989-8565-68-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Joint Conference on Software Technologies - Volume 1: ICSOFT-EA, (ICSOFT 2013)
TI - Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development
SN - 978-989-8565-68-6
AU - Rana R.
AU - Staron M.
AU - Berger C.
AU - Hansson J.
AU - Nilsson M.
AU - Törner F.
PY - 2013
SP - 251
EP - 257
DO - 10.5220/0004592002510257