Mutating OWLs: Semantic Mutation Testing for Ontologies

Cesare Bartolini

2016

Abstract

Ontologies are an essential component of semantic knowledge bases and applications, and nowadays they are used in a plethora of domains. Despite the maturity of ontology languages, support tools and engineering techniques, the testing and validation of ontologies is a field which still lacks consolidated approaches and tools. This paper attempts at partly bridging that gap, taking a first step towards the extension of mutation testing techniques to ontologies expressed in a widely-used format. Mutation testing techniques, revisited in the light of the peculiar features of the ontology language and structure, can help in the engineering and refinement of ontologies and software based on them.

References

  1. Ammann, P. and Offutt, A. J. (2008). Syntax-based testing. In Introduction to Software Testing, chapter 5, pages 170-212. Cambridge University Press.
  2. Antoniou, G. and van Harmelen, F. (2004). Web Ontology Language: OWL. In Staab, S. and Studer, R., editors, Handbook on Ontologies, International Handbooks on Information Systems, pages 67-92. Springer Berlin Heidelberg.
  3. Bartolini, C., Bertolino, A., Marchetti, E., and Parissis, I. (2008). Data flow-based validation of web services compositions: Perspectives and examples. In de Lemos, R., Di Giandomenico, F., Gacek, C., Muccini, H., and Vieira, M., editors, Architecting Dependable Systems V, volume 5135 of Lecture Notes in Computer Science, pages 298-325. Springer Berlin / Heidelberg.
  4. Bartolini, C. and Muthuri, R. (2015). Reconciling data protection rights and obligations: An ontology of the forthcoming EU regulation. In Proceedings of the Workshop on Language and Semantic Technology for Legal Domain (LST4LD), Recent Advances in Natural Language Processing (RANLP).
  5. Bartolini, C., Muthuri, R., and Santos, C. (2015). Using ontologies to model data protection requirements in workflows. In Proceedings of the Ninth International Workshop on Juris-informatics (JURISIN), pages 27- 40.
  6. Blomqvist, E., Seil Sepour, A., and Presutti, V. (2012). Ontology testing - methodology and tool. In ten Teije, A., V ölker, J., Handschuh, S., Stuckenschmidt, H., d'Acquin, M., Nikolov, A., Aussenac-Gilles, N., and Hernandez, N., editors, Knowledge Engineering and Knowledge Management, volume 7603 of Lecture Notes in Computer Science, pages 216-226. Springer Berlin Heidelberg.
  7. Burton-Jones, A., Storey, V. C., Sugumaran, V., and Ahluwalia, P. (2005). A semiotic metrics suite for assessing the quality of ontologies. Data & Knowledge Engineering, 55(1):84-102.
  8. Clark, J. A., Dan, H., and Hierons, R. M. (2010). Semantic mutation testing. In Proceedings of the 3rd IEEE International Conference on Software Testing, Verification, and Validation Workshops (ICSTW), pages 100- 109. IEEE.
  9. DeMillo, R. A., Lipton, R. J., and Sayward, F. G. (1978). Hints on test data selection: Help for the practicing programmer. Computer, 11(4):34-41.
  10. Denny Vrandec?ic, A. G. (2006). Unit tests for ontologies. In Meersman, R., Tari, Z., and Herrero, P., editors, On the Move to Meaningful Internet Systems 2006: OTM
  11. Gangemi, A., Catenacci, C., Ciaramita, M., and Lehmann, J. (2006). Modelling ontology evaluation and validation. In Sure, Y. and Domingue, J., editors, The Semantic Web: Research and Applications, volume 4011 of Lecture Notes in Computer Science, pages 140- 154. Springer Berlin Heidelberg.
  12. Granitzer, M., Scharl, A., Weichselbraun, A., Neidhart, T., Juffinger, A., and Wohlgenannt, G. (2007). Automated ontology learning and validation using hypothesis testing. In Wegrzyn-Wolska, K. M. and Szczepaniak, P. S., editors, Advances in Intelligent Web Mastering, volume 43 of Advances in Soft Computing, pages 130-135. Springer Berlin Heidelberg.
  13. Hamlet, R. G. (1977). Testing programs with the aid of a compiler. IEEE Transactions on Software Engineering, SE-3(4):279-290.
  14. Horridge, M., Drummond, N., Goodwin, J., Rector, A., Stevens, R., and Wang, H. H. (2006). The Manchester OWL syntax. In OWL: Experiences and Directions Workshop (OWLED).
  15. Horrocks, I. (2002). DAML+OIL: a description logic for the semantic web. Bulletin of the Technical Committee on Data Engineering, 25(1):4-9.
  16. Horrocks, I. (2013). What are ontologies good for? In Küppers, B.-O., Hahn, U., and Artmann, S., editors, Evolution of Semantic Systems, pages 175-188. Springer Berlin Heidelberg.
  17. Howden, W. E. (1982). Weak mutation testing and completeness of test sets. IEEE Transactions on Software Engineering, SE-8(4):371-379.
  18. Jia, Y. and Harman, M. (2011). An analysis and survey of the development of mutation testing. IEEE Transactions on Software Engineering, 37(5):649-678.
  19. Kershenbaum, A., Fokoue, A., Patel, C., Welty, C., Schonberg, E., Cimino, J., Ma, L., Srinivas, K., Schloss, R., and Murdock, J. W. (2006). A view of OWL from the field: Use cases and experiences. In Cuenca Grau, B., Hitzler, P., Shankey, C., and Wallace, E., editors, Proceedings of the Second Workshop on OWL: Experiences and Directions (OWLED), volume 216 of CEUR Workshop Proceedings.
  20. Lee, S., Bai, X., and Chen, Y. (2008). Automatic mutation testing and simulation on OWL-S specified web services. In Proceedings of the 41st Annual Simulation Symposium (ANSS), pages 149-156. IEEE.
  21. Lipton, R. (1971). Fault diagnosis of computer programs. Technical report, Carnegie Mellon University.
  22. Ma, L., Yang, Y., Qiu, Z., Xie, G., Pan, Y., and Liu, S. (2006). Towards a complete OWL ontology benchmark. In Sure, Y. and Domingue, J., editors, The Semantic Web: Research and Applications, volume 4011 of Lecture Notes in Computer Science, pages 125- 139. Springer Berlin Heidelberg.
  23. Ma, Y.-S., Offutt, A. J., and Kwong, Y. R. (2005). Mujava: An automated class mutation system. Software Testing, Verification and Reliability, 15(2):97-133.
  24. McGuinness, D. L., Fikes, R., Rice, J., and Wilder, S. (2000). An environment for merging and testing large ontologies. In Proceedings of the Seventh International Conference on Principles of Knowledge Representation and Reasoning (KR2000), pages 483-493.
  25. Mottu, J.-M., Baudry, B., and Le Traon, Y. (2006). Mutation analysis testing for model transformations. In Rensink, A. and Warmer, J., editors, Model Driven Architecture - Foundations and Applications, volume 4066 of Lecture Notes in Computer Science, pages 376-390. Springer Berlin Heidelberg.
  26. Offutt, A. J. (1994). A practical system for mutation testing: help for the common programmer. In Proceedings of the International Test Conference (ITC), pages 824- 830. IEEE Computer Society.
  27. Offutt, A. J. and Hayes, J. H. (1996). A semantic model of program faults. SIGSOFT Software Engineering Notes, 21(3):195-200.
  28. Offutt, A. J., Lee, A., Rothermel, G., Untch, R. H., and Zapf, C. (1996). An experimental determination of sufficient mutant operators. ACM Transactions on Software Engineering and Methodology (TOSEM), 5(2):99-118.
  29. Offutt, A. J. and Untch, R. H. (2001). Mutation 2000: Uniting the orthogonal. In Wong, W. E., editor, Mutation Testing for the New Century, volume 24 of The Springer International Series on Advances in Database Systems, pages 34-44. Springer US.
  30. Poveda-Villalón, M., Suárez-Figueroa, M. C., and G ómezPérez, A. (2010). Common pitfalls in ontology development. In Meseguer, P., Mandow, L., and Gasca, R. M., editors, Current Topics in Artificial Intelligence, volume 5988 of Lecture Notes in Computer Science, pages 91-100. Springer Berlin Heidelberg.
  31. Poveda-Villalón, M., Suárez-Figueroa, M. C., and G ómezPérez, A. (2012). Validating ontologies with OOPS! In ten Teije, A., V ölker, J., Handschuh, S., Stuckenschmidt, H., d'Acquin, M., Nikolov, A., AussenacGilles, N., and Hernandez, N., editors, Knowledge Engineering and Knowledge Management, volume 7603 of Lecture Notes in Computer Science, pages 267- 281. Springer Berlin Heidelberg.
  32. Quillian, M. R. (1967). Word concepts: A theory and simulation of some basic semantic capabilities. Behavioral Science, 12(5):410-430.
  33. Reding, V. (2010). The upcoming data protection reform for the European Union. International Data Privacy Law.
  34. Rodríguez-Doncel, V., Santos, C., and Casanovas, P. (2014a). A model of air transport passenger incidents and rights. In Proceedings of the 27th International Conference on Legal Knowledge and Information Systems (JURIX), pages 55-60. IOS Press.
  35. Rodríguez-Doncel, V., Santos, C., and Casanovas, P. (2014b). Ontology-driven legal support-system in the air transport passenger domain. In Proceedings of the International Workshop on Semantic Web for the Law (SW4Law).
  36. Rospocher, M. and Serafini, L. (2013). An ontological framework for decision support. In Takeda, H., Qu, Y., Mizoguchi, R., and Kitamura, Y., editors, Semantic Technology, volume 7774 of Lecture Notes in Computer Science, pages 239-254. Springer Berlin Heidelberg.
  37. Wang, H., Horridge, M., Rector, A., Drummond, N., and Seidenberg, J. (2005). Debugging OWL-DL ontologies: A heuristic approach. In Gil, Y., Motta, E., Benjamins, V. R., and Musen, M. A., editors, The Semantic Web - ISWC 2005, volume 3729 of Lecture Notes in Computer Science, pages 745-757. Springer Berlin Heidelberg.
  38. World Wide Web Consortium (W3C) (2004a). OWL-S: Semantic markup for web services.
  39. World Wide Web Consortium (W3C) (2004b). OWL Web Ontology Language test cases.
  40. World Wide Web Consortium (W3C) (2008). Sparql query language for rdf.
  41. World Wide Web Consortium (W3C) (2012). OWL 2 Web Ontology Language document overview (second edition).
  42. World Wide Web Consortium (W3C) (2014a). RDF 1.1 concepts and abstract syntax.
  43. World Wide Web Consortium (W3C) (2014b). RDF 1.1 Turtle.
Download


Paper Citation


in Harvard Style

Bartolini C. and Bartolini C. (2016). Mutating OWLs: Semantic Mutation Testing for Ontologies . In Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016) ISBN 978-989-758-166-3, pages 43-53. DOI: 10.5220/0005844600430053


in Bibtex Style

@conference{amaretto16,
author={Cesare Bartolini and Cesare Bartolini},
title={Mutating OWLs: Semantic Mutation Testing for Ontologies},
booktitle={Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)},
year={2016},
pages={43-53},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005844600430053},
isbn={978-989-758-166-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Workshop on domAin specific Model-based AppRoaches to vErificaTion and validaTiOn - Volume 1: AMARETTO, (MODELSWARD 2016)
TI - Mutating OWLs: Semantic Mutation Testing for Ontologies
SN - 978-989-758-166-3
AU - Bartolini C.
AU - Bartolini C.
PY - 2016
SP - 43
EP - 53
DO - 10.5220/0005844600430053