Testing the Cooperation of Autonomous Robotic Agents

Raimar Lill, Francesca Saglietti

2014

Abstract

This article proposes an approach to testing the cooperative behaviour of autonomous software-based agents with safety-relevant tasks. It includes the definition of different model-based testing criteria based on the coverage of Coloured Petri Net entities as well as the automatic generation of appropriate test cases. The multi-objective optimization problem considered addresses both the maximization of interaction coverage and the minimization of the amount of test cases required. The approach developed for its solution makes use of genetic algorithms. The resulting automatic test case generation process is presented in this article together with the experiences gained by applying it to cooperating autonomous forklifts.

References

  1. Broy, M. et al., 2005. Model-Based Testing of Reactive Systems - Advances Lectures. In Lecture Notes in Computer Science, vol. 3472. Springer.
  2. Freitas, A., 2002. Data Mining and Knowledge Discovery with Evolutionary Algorithms. Springer.
  3. Genrich, H. J., Lautenbach, K, 1981. System Modelling with High-Level Petri Nets. In Theoretical Computer Science, vol. 13(1), pp. 109-136. Elsevier.
  4. Jensen, K., Kristensen, L. M.; Wells, L., 2007. Coloured Petri Nets and CPN Tools for Modelling and Validation of Concurrent Systems. In International Journal on Software Tools for Technology Transfer, vol. 9, no. 3-4, pp. 213-254. Springer.
  5. Jensen, K., Kristensen, L. M., 2009. Coloured Petri Nets: Modelling and Validation of Concurrent Systems. Springer.
  6. Lill, R., Saglietti, F., 2012a. Model-based Testing of Autonomous Systems based on Coloured Petri Nets. In ARCS 2012 Workshops Proceedings, Lecture Notes in Informatics, vol. 200, pp. 241-250. Gesellschaft für Informatik.
  7. Lill, R., Saglietti, F., 2012b. Test Coverage Criteria for Autonomous Mobile Systems based on Coloured Petri Nets. In FORMS/FORMAT 2012 Proceedings, 9th Symposium on Formal Methods for Automation and Safety in Railway and Automotive Systems, pp. 155- 162. Institut für Verkehrssicherheit und Automatisierungstechnik, TU Braunschweig.
  8. Micskei, Z. et al., 2012. Concept for Testing Robustness and Safety of the Context-Aware Behaviour of Autonomous Systems. In Proc. of the 1st Int. Workshop on Trustworthy Multi-Agent Systems (TruMAS), KES-AMSTA 2012, pp. 504-513.
  9. Milner, R. et al., 1997. The Definition of Standard ML (Revised). MIT Press.
  10. Mitchell, M., 1996. An Introduction to Genetic Algorithms. MIT Press.
  11. Nguyen, C. D. et al., 2012. Evolutionary testing of autonomous software agents. In Autonomous Agents and Multi-Agent Systems, vol. 25(2), pp. 260-283. Springer.
  12. Murata, T., 1989. Petri Nets: Properties, Analysis and Applications. In Proceedings of the IEEE, vol. 77, no. 4. pp. 542-543. IEEE.
  13. Pelánek, R., 2009: Fighting state space explosion: Review and evaluation; In Lecture Notes in Computer Science, vol. 5596, pp. 37-52. Springer.
  14. Saglietti, F., Söhnlein, S., Lill, R., 2011. Evolution of Verification Techniques by Increasing Autonomy of Cooperating Agents, In Autonomous Systems: Developments and Trends, Studies in Computational Intelligence, vol. 391, pp. 353-362. Springer.
  15. Utting, M., Legeard, B., 2007. Practical Model-based Testing - a Tools Approach. Elsevier.
  16. Valmari, A., 1998. The state explosion problem. In Lecture Notes in Computer Science, vol. 1491, pp. 429-528. Springer.
  17. Westergaard, M., Kristensen, L. M., 2009. The Access/CPN framework: a tool for interacting with the CPN Tools simulator. In Applications and Theory of Petri Nets, pp.313-322. Springer.
  18. Zhu, H., He, X., 2002. A methodology of testing highlevel Petri nets. In Information and Software Technology, Vol. 44, pp. 473-489. Elsevier.
Download


Paper Citation


in Harvard Style

Lill R. and Saglietti F. (2014). Testing the Cooperation of Autonomous Robotic Agents . In Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014) ISBN 978-989-758-036-9, pages 287-296. DOI: 10.5220/0004990402870296


in Bibtex Style

@conference{icsoft-ea14,
author={Raimar Lill and Francesca Saglietti},
title={Testing the Cooperation of Autonomous Robotic Agents},
booktitle={Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014)},
year={2014},
pages={287-296},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004990402870296},
isbn={978-989-758-036-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Software Engineering and Applications - Volume 1: ICSOFT-EA, (ICSOFT 2014)
TI - Testing the Cooperation of Autonomous Robotic Agents
SN - 978-989-758-036-9
AU - Lill R.
AU - Saglietti F.
PY - 2014
SP - 287
EP - 296
DO - 10.5220/0004990402870296