Towards World Model-based Test Generation in Autonomous Systems

Anneliese Andrews, Mahmoud Abdelgawad, Ahmed Gario

2015

Abstract

This paper describes a model-based test generation approach for testing autonomous systems interacting with their environment (i.e., world). Unlike other approaches that assume a static world with attributes and values, we present and test the world dynamically. We build the world model in two steps: a structural model that constructs environmental factors (i.e., actors) and a behavioral model that describes actors’ behaviors over a certain landscape (i.e., snippet). Abstract world behavioral test cases (AWBTCs) are then generated by covering the behavioral model using graph coverage criteria. The world model-based test generation technique (WMBTG) is used on an autonomous ground vehicle (AGV).

References

  1. Ammann, P. and Offutt, J. (2008). Introduction to Software Testing. Cambridge University Press, 32 Avenue of the Americas, New York, NY 10013, USA, first edition.
  2. Andrews, A., Offutt, J., Dyreson, C., Mallery, C. J., Jerath, K., and Alexander, R. (2010). Scalability issues with using fsmweb to test web applications. Inf. Softw. Technol., 52(1):52-66.
  3. Arnold, J. and Alexander, R. (2013). Testing autonomous robot control software using procedural content generation. In Bitsch, F., Guiochet, J., and Kaniche, M., editors, Computer Safety, Reliability, and Security, volume 8153 of Lecture Notes in Computer Science, pages 33-44. Springer Berlin Heidelberg.
  4. Brand, D. and Zafiropulo, P. (1983). On communicating finite-state machines. J. ACM, 30(2):323-342.
  5. Carver, R. and Lei, Y. (2013). A modular approach to model-based testing of concurrent programs. In Lourenco, J. and Farchi, E., editors, Multicore Software Engineering, Performance, and Tools, volume 8063 of Lecture Notes in Computer Science, pages 85-96. Springer Berlin Heidelberg.
  6. Cheng, H. (2011). Autonomous Intelligent Vehicles: Theory, Algorithms, and Implementation. SpringerVerlag, Springer London Dordrecht Heidelberg, New York, first edition.
  7. Cheng, K. T. and Krishnakumar, A. (1993). Automatic functional test generation using the extended finite state machine model. In Proceedings of the 30th International Design Automation Conference, DAC 7893, pages 86-91, New York, NY, USA. ACM.
  8. Couceiro, M., Vargas, P., Rocha, R., and Ferreira, N. (2014). Benchmark of swarm robotics distributed techniques in a search task. Robotics and Autonomous Systems, 62(2):200-213.
  9. Dias-Neto, A., Subramanyan, R., Vieira, M., and Travassos, G. H. (2007). A survey on model-based testing approaches: A systematic review. In Proceedings of the 1st ACM International Workshop on Empirical Assessment of Software Engineering Languages and Technologies: Held in Conjunction with the 22Nd IEEE/ACM International Conference on Automated Software Engineering (ASE) 2007, WEASELTech 7807, pages 31-36. ACM.
  10. Fisher, M., Dennis, L., and Webster, M. (2013). Verifying autonomous systems. Commun. ACM, 56(9):84-93.
  11. Furda, A. and Vlacic, L. (2010). An object-oriented design of a world model for autonomous city vehicles. In Intelligent Vehicles Symposium (IV), IEEE, pages 1054-1059.
  12. Garavel, H., Lang, F., Mateescu, R., and Serwe, W. (2013). Cadp 2011: a toolbox for the construction and analysis of distributed processes. International Journal on Software Tools for Technology Transfer, 15(2):89- 107.
  13. Ghete, I., Heizmann, M., Belkin, A., and Beyerer, J. (2010). World modeling for autonomous systems. In Dillmann, R., Beyerer, J., Hanebeck, U., and Schultz, T., editors, KI 2010: Advances in Artificial Intelligence, volume 6359 of Lecture Notes in Computer Science, pages 176-183. Springer Berlin Heidelberg.
  14. Hessel, A., Larsen, K., Mikucionis, M., Nielsen, B., Pettersson, P., and Skou, A. (2008). Formal methods and testing. chapter Testing real-time systems using UPPAAL, pages 77-117. Springer-Verlag, Berlin, Heidelberg.
  15. Hwang, G.-H., Tai, K.-C., and Huang, T. (1994). Reachability testing: an approach to testing concurrent software. In Proceedings of the Software Engineering Conference, 1994 First Asia-Pacific, pages 246-255.
  16. Iqbal, M., Arcuri, A., and Briand, L. (2012). Empirical investigation of search algorithms for environment model-based testing of real-time embedded software. In Proceedings of the 2012 International Symposium on Software Testing and Analysis, ISSTA 2012, pages 199-209, New York, NY, USA. ACM.
  17. Jacoff, A., Messina, E., Weiss, B., Tadokoro, S., and Nakagawa, Y. (2003). Test arenas and performance metrics for urban search and rescue robots. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems (IROS), volume 4, pages 3396- 3403 vol.3.
  18. Lei, Y. and Carver, R. H. (2006). Reachability testing of concurrent programs. IEEE Trans. Softw. Eng., 32(6):382-403.
  19. Li, J. and Wong, W. (2002). Automatic test generation from communicating extended finite state machine (CEFSM)-based models. In Proceedings of 5th IEEE International Symposium on Object-Oriented RealTime Distributed Computing. (ISORC 2002), pages 181-185.
  20. Lill, R. and Saglietti, F. (2012). Model-based testing of autonomous systems based on coloured petri nets. In ARCS Workshops (ARCS), pages 1-5.
  21. Nguyen, C., Perini, A., Bernon, C., Pavon, J., and Thangarajah, J. (2011). Testing in multi-agent systems. In Proceedings of the 10th International Conference on Agent-oriented Software Engineering, AOSE'10, pages 180-190, Berlin, Heidelberg. Springer-Verlag.
  22. Ran, L., Dyreson, C., Andrews, A., Bryce, R., and Mallery, C. (2009). Building test cases and oracles to automate the testing of web database applications. Inf. Softw. Technol., 51(2):460-477.
  23. Rehman, S. and Nadeem, A. (2013). Testing of autonomous agents: A critical analysis. In Proceedings of the 2013 Saudi International Electronics, Communications and Photonics Conference (SIECPC), pages 1-5.
  24. Shafique, M. and Labiche, Y. (2013). A systematic review of state-based test tools. International Journal on Software Tools for Technology Transfer, pages 1-18.
  25. Shirole, M. and Kumar, R. (2013). Uml behavioral model based test case generation: A survey. Softw. Eng. Notes, SIGSOFT, 38(4):1-13.
  26. Sighireanu, M., Chaudet, C., Garavel, H., Herbert, M., Mateescu, R., and Vivien, B. (2000). Lotos nt user manual.
  27. Tretmans, J. (2008). Model based testing with labelled transition systems. In Hierons, R., Bowen, J., and Harman, M., editors, Formal Methods and Testing, volume 4949 of Lecture Notes in Computer Science, pages 1-38. Springer Berlin Heidelberg.
  28. U.S. Department of Transportation, F. H. A. F. (2013). Manual on uniform traffic control devices MUTCD.
  29. Utting, M., Pretschner, A., and Legeard, B. (2012). A taxonomy of model-based testing approaches. Softw. Test. Verif. Reliab., 22(5):297-312.
  30. Yang, R. and Chung, C.-G. (1990). A path analysis approach to concurrent program testing. In Proceedings of the 9th Annual International Phoenix Conference on Computers and Communications, pages 425-432.
  31. Zander, J., Schieferdecker, I., and Mosterman, P. J. (2012). Model-based testing for embedded systems. CRC Press, 6000 Broken Sound Parkway NW,Boca Raton, FL 3348, USA, first edition.
Download


Paper Citation


in Bibtex Style

@conference{modelsward15,
author={Anneliese Andrews and Mahmoud Abdelgawad and Ahmed Gario},
title={Towards World Model-based Test Generation in Autonomous Systems},
booktitle={Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,},
year={2015},
pages={165-176},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005228201650176},
isbn={978-989-758-083-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD,
TI - Towards World Model-based Test Generation in Autonomous Systems
SN - 978-989-758-083-3
AU - Andrews A.
AU - Abdelgawad M.
AU - Gario A.
PY - 2015
SP - 165
EP - 176
DO - 10.5220/0005228201650176


in Harvard Style

Andrews A., Abdelgawad M. and Gario A. (2015). Towards World Model-based Test Generation in Autonomous Systems . In Proceedings of the 3rd International Conference on Model-Driven Engineering and Software Development - Volume 1: MODELSWARD, ISBN 978-989-758-083-3, pages 165-176. DOI: 10.5220/0005228201650176