A Human-centred Framework for Combinatorial Test Design

Maria Spichkova, Anna Zamansky

2016

Abstract

This paper presents AHR, a formal framework for combinatorial test design that is Agile, Human-centred and Refinement-oriented. The framework (i) allows us to reuse test plans developed for an abstract level at more concrete levels; (ii) has human-centric interface providing queries and alerts whenever the specified test plan is incomplete or invalid; (iii) involves analysis of the testing constraints within combinatorial testing.

References

  1. Blech, J. O., Spichkova, M., Peake, I., and Schmidt, H. (2014). Cyber-virtual systems: Simulation, validation & visualization. In Proc. of the 9th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2014).
  2. Broy, M. (2005). Service-oriented Systems Engineering: Specification and design of services and layered architectures. The JANUS Approach. Engineering Theories of Software Intensive Systems, pages 47-81.
  3. Dalal, S. R., Jain, A., Karunanithi, N., Leaton, J., Lott, C. M., Patton, G. C., and Horowitz, B. M. (1999). Model-based testing in practice. In Proc. of the 21st International Conference on Software Engineering, pages 285-294. ACM.
  4. Farchi, E., Segall, I., and Tzoref-Brill, R. (2013). Using projections to debug large combinatorial models. In Proc. of the International Conference o Software Testing, Verification and Validation Workshops (ICSTW) , pages 311-320. IEEE.
  5. Farchi, E., Segall, I., Tzoref-Brill, R., and Zlotnick, A. (2014). Combinatorial testing with order requirements. In Proc. of the International Conference on Software Testing, Verification and Validation Workshops (ICSTW), pages 118-127. IEEE.
  6. Grieskamp, W. (2006). Multi-paradigmatic model-based testing. In Formal Approaches to Software Testing and Runtime Verification , pages 1-19. Springer.
  7. Hazzan, O. and Dubinsky, Y. (2014). The agile manifesto. In Agile Anywhere, pages 9-14. Springer International Publishing.
  8. Hellmann, T. D., Sharma, A., Ferreira, J., and Maurer, F. (2012). Agile testing: Past, present, and futurecharting a systematic map of testing in agile software development. In Proc. of the Agile Conference (AGILE), 2012, pages 55-63. IEEE.
  9. Kuhn, D. R., Wallace, D. R., and Gallo, Jr., A. M. (2004). Software fault interactions and implications for software testing. IEEE Transactions on Software Engineering, 30(6):418-421.
  10. Kuhn, R., Kacker, R., Lei, Y., and Hunter, J. (2011). Combinatorial software testing. IEEE Computer, 42(8):94- 96.
  11. Nie, C. and Leung, H. (2011). A survey of combinatorial testing. ACM Comput. Surv., 43(2):11:1-11:29.
  12. Pretschner, A. (2005). Model-based testing in practice. In FM 2005: Formal Methods, pages 537-541. Springer.
  13. Rumpe, B. (2006). Agile test-based modeling. In Proc. of the 2006 International Conference on Software Engineering Research & Practice (SERP). CSREA Press.
  14. Sapienza, G., Crnkovic, I., and Seceleanu, T. (2012). Towards a methodology for hardware and software design separation in embedded systems. In Proc. of the ICSEA, pages 557-562. IARIA.
  15. Segall, I. and Tzoref-Brill, R. (2012). Interactive refinement of combinatorial test plans. In Proc. of the 34th International Conference on Software Engineering, pages 1371-1374. IEEE Press.
  16. Segall, I., Tzoref-Brill, R., and Zlotnick, A. (2012). Common patterns in combinatorial models. In Proc. of the International Conference on Software Testing, Verification and Validation (ICST), pages 624-629. IEEE.
  17. Spichkova, M. (2008). Refinement-based verification of interactive real-time systems. Electronic Notes in Theoretical Computer Science, 214:131-157.
  18. Spichkova, M. (2013). Design of formal languages and interfaces: formal does not mean unreadable. In Emerging Research and Trends in Interactivity and the Human-Computer Interface. IGI Global.
  19. Spichkova, M. and Campetelli, A. (2012). Towards system development methodologies: From software to cyberphysical domain. In Proc. of the International Workshop on Formal Techniques for Safety-Critical Systems.
  20. Spichkova, M., Liu, H., and Schmidt, H. (2015a). Towards quality-oriented architecture: Integration in a global context. In Proc. of the European Conference on Software Architecture Workshops, page 64. ACM.
  21. Spichkova, M., Zamansky, A., and Farchi, E. (2015b). Towards a human-centred approach in modelling and testing of cyber-physical systems. In Proc. of the International Workshop on Automated Testing for Cyber-Physical Systems in the Cloud.
  22. Spichkova, M., Zhu, X., and Mou, D. (2013). Do we really need to write documentation for a system? In Proc. of the International Conference on Model-Driven Engineering and Software Development (MODELSWARD'13).
  23. Tai, K.-C. and Lei, Y. (2002). A test generation strategy for pairwise testing. IEEE Transactions on Software Engineering, 28(1):109-111.
  24. Talby, D., Keren, A., Hazzan, O., and Dubinsky, Y. (2006). Agile software testing in a large-scale project. IEEE Software, 23(4):30-37.
  25. Turk, D., France, R. B., and Rumpe, B. (2005). Assumptions underlying agile software development processes. Journal of Database Management, 16:62-87.
  26. Utting, M., Pretschner, A., and Legeard, B. (2012). A taxonomy of model-based testing approaches. Software Testing, Verification and Reliability , 22(5):297-312.
  27. Wojciak, P. and Tzoref-Brill, R. (2014). System level combinatorial testing in practice - the concurrent maintenance case study. In Proc. of the International Conference on Software Testing, Verification, and Validation , ICST 7814, pages 103-112. IEEE Computer Society.
  28. Zamansky, A. and Farchi, E. (2015). Helping the tester get it right: Towards supporting agile combinatorial test design. In Proc. of the Human-Oriented Formal Methods workshop (HOFM 2015).
  29. Zhang, J., Zhang, Z., and Ma, F. (2014). Introduction to combinatorial testing. In Automatic Generation of Combinatorial Test Data, pages 1-16. Springer.
Download


Paper Citation


in Harvard Style

Spichkova M. and Zamansky A. (2016). A Human-centred Framework for Combinatorial Test Design . In Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering - Volume 1: ENASE, ISBN 978-989-758-189-2, pages 228-233. DOI: 10.5220/0005898202280233


in Bibtex Style

@conference{enase16,
author={Maria Spichkova and Anna Zamansky},
title={A Human-centred Framework for Combinatorial Test Design},
booktitle={Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering - Volume 1: ENASE,},
year={2016},
pages={228-233},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005898202280233},
isbn={978-989-758-189-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Evaluation of Novel Software Approaches to Software Engineering - Volume 1: ENASE,
TI - A Human-centred Framework for Combinatorial Test Design
SN - 978-989-758-189-2
AU - Spichkova M.
AU - Zamansky A.
PY - 2016
SP - 228
EP - 233
DO - 10.5220/0005898202280233