AUTOMATIC TEST MANAGEMENT OF SAFETY-CRITICAL SYSTEMS: THE COMMON CORE - Behavioural Emulation of Hard-soft Components

Antonio Grillo, Giovanni Cantone, Christian Di Biagio, Guido Pennella

2007

Abstract

In order to solve problems that the usage a human-managed test process caused, the reference company for this paper - Italian branch of a multinational organization which works in the domain of large safety-critical systems - evaluated the opportunity, as offered by major technology that the market provides, of using automatic test management. That technology resulted not sufficiently featured for the company’s quality and productivity improvement goals, and we were charged for investigating in deep and eventually satisfying the company’s test-management needs of automation. Once we had transformed those goals in technical requirements and evaluated that it was possible to realize them conveniently in a software system, we passed to analyze, construct, and eventually evaluate in field the “Automatic Test Management” system, ATM. This paper is concerned with the ATM subsystem’s Common Core, CC. This allows the behavioral emulation of hard-soft components - as part of a distributed real components scenario placed under one or more Unix standard operative systems - once we describe those behaviors by using the Unified Modeling Language. This paper reports on the ATM-CC’s distinctive characteristics and architecture overview. Results from a case study show that, in order to enact a given suite of tests by the ATM-CC, the amount of time required is more or less the same for the first test run, but it becomes around ten times less for the following test runs, than the time required for managing the execution of those tests by hand.

References

  1. Accili, V., Di-Biagio, C., Pennella, G., Cantone, G., 2007. Automatic Test Manager: Console. Submitted for acceptance to Int. Conference.
  2. Apfelbaum, L., and Doyle, J., 1997. Model-Based Testing. In Software Quality Week Conference.
  3. Bagui, S., Earp, R., 2004. Database Design using Entity Relationship Diagram. Auerbach.
  4. Booch, G., Rumbaugh, J., Jacobson, I., 2000. Unified Modeling Language User Guide. Addison-Wesley, 2nd Edition.
  5. Boyapati, C., Khurshid, S., Marinov, D., 2002. Korat: Automated testing based on Java predicates. In International Symposium on Software Testing and Analysis (ISSTA 2002), pp-123-133.
  6. ConformiQ Software Ltd, 2007. ConformiQ Test Generator. http://www.conformiq.com/, March.
  7. Dalal, S. R., Jain, A., Karunanithi, N., Leaton, J. M., Lott, C. M., Patton, G. C., Horowitz, B. M., 1999. ModelBased Testing in Practice. In Proceedings of ICSE'99, ACM Press.
  8. Hager, J. A., 1989. Software Cost Reduction Methods in Practice. In IEEE Press Vol. 15, Issue 12, pp. 1638 - 1644
  9. Harold, E. R., Scott Means, W., 2004. XML in a Nutshell. O'Reilly, 3rd Edition.
  10. Horgan, J. R., London, S., Lyu, M. R., 1994. Achieving Software Quality with Testing Coverage Measures. In IEEE Computer. Vol.27, No. 9, pp. 60-69.
  11. IBM Research Lab in Haifa, 2007. GOTCHA - TCBeans. http://www.haifa.il.ibm.com/projects/verification/gtcb/ index.html.
  12. Microsoft, 2007. Abstract State Machine Language (ASML),http://research.microsoft.com/foundations/As mL/.
  13. MIT, 2007. MulSaw Project on Software Reliability. http://mulsaw.lcs.mit.edu/.
  14. Offutt, A. J., 2007. Software Acquisition Gold Practice: Model Based testing. http://www.goldpractices.com/practices/mbt/index.php
  15. Offutt, A. J., Abdurazik, A., 1999. Generating Tests from UML Specifications. In Second International Conference on the Unified Modeling Language.
  16. SDL Forum Society, 2007. Introduction to SDL. http://www.sdl-forum.org/.
  17. Software Prototype Technologies 2007. Direct To Test (DTT). http://www.softprot.com/ (now http://www.critical-logic.com/).
  18. Telelogic, 2007. Telelogic Tau TTCN Suite. http://www.telelogic.com/.
  19. University of Fribourg, 2007. SDL And MSC based Test case Generation (SAMSTAG). http://www.iam.unibe.ch/publikationen/techreports/19 94/iam-94-005.
  20. Utting, M., Legeard, B., 2007. Practical Model-Based Testing: A Tools Approach. Morgan-Kaufmann.
  21. Utting, M., Pretschner, A., Legeard, B., 2006. A Taxonomy of Model-Based Testing, DCS, University of Waitako, Hailton, New Zeland, Working paper: 04/2006.
  22. Vienneau, R. L., 2003. An Overview of Model-Based Testing for Software. Data and Analysis Center for Software, CR/TA 12.
Download


Paper Citation


in Harvard Style

Grillo A., Cantone G., Di Biagio C. and Pennella G. (2007). AUTOMATIC TEST MANAGEMENT OF SAFETY-CRITICAL SYSTEMS: THE COMMON CORE - Behavioural Emulation of Hard-soft Components . In Proceedings of the Second International Conference on Software and Data Technologies - Volume 2: ICSOFT, ISBN 978-989-8111-06-7, pages 150-155. DOI: 10.5220/0001338701500155


in Bibtex Style

@conference{icsoft07,
author={Antonio Grillo and Giovanni Cantone and Christian Di Biagio and Guido Pennella},
title={AUTOMATIC TEST MANAGEMENT OF SAFETY-CRITICAL SYSTEMS: THE COMMON CORE - Behavioural Emulation of Hard-soft Components},
booktitle={Proceedings of the Second International Conference on Software and Data Technologies - Volume 2: ICSOFT,},
year={2007},
pages={150-155},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001338701500155},
isbn={978-989-8111-06-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Software and Data Technologies - Volume 2: ICSOFT,
TI - AUTOMATIC TEST MANAGEMENT OF SAFETY-CRITICAL SYSTEMS: THE COMMON CORE - Behavioural Emulation of Hard-soft Components
SN - 978-989-8111-06-7
AU - Grillo A.
AU - Cantone G.
AU - Di Biagio C.
AU - Pennella G.
PY - 2007
SP - 150
EP - 155
DO - 10.5220/0001338701500155