Ontology Quality Problems - An Experience with Automatically Generated Ontologies

Mounira Harzallah, Giuseppe Berio, Toader Gherasim, Pascale Kuntz

2014

Abstract

Ontologies play a major role in the development of personalized and interoperable applications. However, validation of ontologies remains a critical open issue. Validation is fundamentally driven by an “ontology evaluation”, often referred to as “quality evaluation”, as better explained in the Introduction. This paper reports an experience designed on our previous work on quality evaluation and using ontologies automatically generated from some textual resources. In the previous work, we have proposed a standard typology of problems impacting (negatively) on the quality of one ontology (named quality problems). The experience shows how our previous work can be practically deployed. One a posteriori analysis of experience results and lessons learnt presented in the paper make explicit and concrete key contributions to validation. Finally, conclusions highlight both limitations of the experience and research perspectives.

References

  1. Baumeister, J., Seipel, D., 2005. Smelly owls-design anomalies in ontologies. Pages 215-220 of: Proc. of the 18th int. florida artificial intelligence research society conf.
  2. Baumeister, J., Seipel, D., 2010. Anomalies in ontologies with rules. Web semantics: Science, services and agents on the world wide web, 8(1), 55-68.
  3. Buhmann, L., Danielczyk, S., Lehmann, J., 2011. D3.4.1 report on relevant automatically detectable modelling errors and problems. Tech. rept. LOD2 - Creating Knowledge out of Interlinked Data.
  4. Burton-Jones, A., Storey, V., Sugumaran, V., 2005. A semiotic metrics suite for assessing the quality of ontologies. Data and knowledge engineering, 55(1),84-102.
  5. Cimiano, P., Volker, J., 2005. Text2onto - a framework for ontology learning and data-driven change discovery. Pages 227-238 of: Montoyo, A., Munoz, R., & Metais, E. (eds), Proc. of the 2nd eur. semantic web conf., vol. 3513.
  6. Cimiano, P., Maedche, A., Staab, S., Volker, J., 2009. Ontology learning. Pages 245-267 of: Studer, R., & Staab, S. (eds), Handbook on ontologies,. International Handbooks on Information Systems. Springer.
  7. Corcho, O., Roussey, C., Blazquez, L.M. Vilches., 2009. Catalogue of anti-patterns for formal ontology debugging. Pages 2-12 of: Atelier construction d'ontologies: vers un guide des bonnes pratiques, afia.
  8. Duque-Ramos, A., Fernandez-Breis, J.T., AussenacGilles, N., Stevens, R., 2011. Oquare: Asquare based approach for evaluating the quality of ontologies. Journal of research and practice in information technology, 43, 159-173.
  9. Fahad, M., Qadir, M.A., 2008. A framework for ontology evaluation. Pages 149-158 of: Proc. Of the 16th int. conf. on conceptual structures (iccs'2008), vol. 354.
  10. Gangemi, A., Catenacci, C., Ciaramita, M., Lehmann, J., 2006. Modelling ontology evaluation and validation. Pages 140-154 of: Proc. of the 3rd. semantic web conf. (eswc2006). LNCS, no. 4011.
  11. Gherasim,T., Harzallah, M., Berio, G. Kuntz, P., 2013. Methods and tools for automatic construction of ontologies from textual resources: A framework for comparison and its application. Pages 177-201 of: Advances in knowledge discovery and management, vol. 471. Springer.
  12. Gherasim,T., Harzallah, M., Berio, G. Kuntz, P., 2012. Problems impacting the quality of automatically built ontologies. In Proceedings of the 8th Workshop on Knowledge Engineering and Software Engineering (KESE-2012), held in conjunction with ECAI 2012, p. 25-32, 2012.
  13. Gomez-Perez, A., 1995. Some ideas and examples to evaluate ontologies. Pages 299-305 of: Proc. of the 11th conf. on artificial intelligence for applications.
  14. Gomez-Perez, A., 2004. Ontology evaluation. Pages 251- 274 of: Staab, S., & Studer, R. (eds), Handbook on ontologies, 1 edn. Int. Handbooks on Inf. Syst. Springer.
  15. Gomez-Perez, A., Fernandez-Lopez, M., Corcho, O., 2001. Ontological engineering: With examples from the areas of knowledge management, e-commerce and the semantic web. Adv. Inf. And Know. Processing. Springer.
  16. Gruber, T.R., 1993. Atranslation approach to portable ontology specifications. Knowledge acquisition, 5(2), 199-220.
  17. Guarino, N., Oberle, D., & Staab, S., 2009. What is an ontology? Pages 1-17 of: Studer, R., & Staab, S. (eds), Handbook on ontologies, 2 edn. International Handbooks on Information Systems. Springer.
  18. Hartmann, J., Spyns, P., Giboin, A., Maynard, D., Cuel, R., Suarez-Figueroa, M. C., Sure, Y., 2004. Methods for ontology evaluation. Tech. rept. Knowledge Web Deliverable D1.2.3.
  19. Harzallah, M., 2012. Développement des ontologies pour l'interopérabilité des systèmes hétérogènes, applications aux cas industriels du projet ISTA3. Livrable final de la tâche 2.4 du projet ISTA3. http://interop-vlab.eu/workspaces/ISTA 3/.
  20. Hirst, G., 2009. Ontology and the lexicon. Pages 269-292 of: Studer, R., & Staab, S. (eds), Handbook on ontologies, 2 edn. International Handbooks on Information Systems. Springer.
  21. Kalfoglou, Y., 2010. Cases on semantic interoperability for information systems integration: Practices and applications. IGI Global.
  22. Lundqvist, K. O., Baker, K., Williams, S., 2011. Ontology supported competency system. Int. j. of knowledge and learning, vol.7, no.3/4, 197 - 219.. Pages 217-231 of: Proc. of 2nd int. conf. on web and information technologies (icwit2009).
  23. Pammer, V. 2010. Automatic support for ontology evaluation - review of entailed statements and assertional effects for owl ontologies. Ph.D. thesis, Graz University of Technology.
  24. Poveda, M., Suarez-Figueroa, M.C., Gomez-Perez, A., 2009. Common pitfalls in ontologydevelopment. Pages 91-100 of: Proc. of the current topics in artificial intelligence (caepia'09), and 13th conf. on spanish association for artificial intelligence.
  25. Poveda, M., Suarez-Figueroa, M.C., Gomez-Perez, A., 2010. A double classification of commonpitfalls in ontologies. Pages 1-12 of: Proc. of the workshop on ontology quality at ekaw 2010.
  26. Poveda, M., Suarez-Figueroa, M.C., Gomez-Perez, A., 2012. Validating ontologies with oops! Pages 267-281 of: Knowledge engineering and knowledge management. LNCS. Springer.
  27. Roussey, C., Corcho, O., Blazquez, L.M. Vilches., 2009. A catalogue of owl ontology antipatterns. Pages 205- 206 of: Proc. of the 5th int. conf. on knowledge capture (k-cap 2009).
  28. Roussey, C., Scharffe, F., Corcho, O., Zamazal, O., 2010. Une méthode de débogage d'ontologiesowl basées sur la détection d'anti-patrons. Pages 43-54 of: Actes de la 21e conférence en ingénierie des connaissances (IC2010).
  29. Simperl, E., & Tempich, C., 2009. Exploring the economical aspects of ontology engineering. Pages 445-462 of: Studer, R., & Staab, S. (eds), Handbook on ontologies, 2 edn. International Handbooks on Information Systems. Springer.
  30. Tartir, S., Arpinar, I.B., Sheth, A.P., 2010. Ontological evaluation and validation. Pages 115-130 of: Poli, R., Healy, M., & Kameas, A. (eds), Theory and applications of ontology: Computer applications. Springer.
  31. Volker, J., Sure, Y., 2006. Data-driven change discoveryevaluation. Tech. rept. Deliverable D3.3.2for SEKT Project, Institute AIFB, University of Karlsruhe.
  32. Vrandecic, D., 2009. Ontology evaluation. Pages 293-314 of: Studer, R., Staab, S. (eds), Handbook on ontologies, 2 edn. Int. Handbooks on Inf. Syst. Springer.
Download


Paper Citation


in Harvard Style

Harzallah M., Berio G., Gherasim T. and Kuntz P. (2014). Ontology Quality Problems - An Experience with Automatically Generated Ontologies . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2014) ISBN 978-989-758-049-9, pages 120-129. DOI: 10.5220/0005141301200129


in Bibtex Style

@conference{keod14,
author={Mounira Harzallah and Giuseppe Berio and Toader Gherasim and Pascale Kuntz},
title={Ontology Quality Problems - An Experience with Automatically Generated Ontologies},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2014)},
year={2014},
pages={120-129},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005141301200129},
isbn={978-989-758-049-9},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2014)
TI - Ontology Quality Problems - An Experience with Automatically Generated Ontologies
SN - 978-989-758-049-9
AU - Harzallah M.
AU - Berio G.
AU - Gherasim T.
AU - Kuntz P.
PY - 2014
SP - 120
EP - 129
DO - 10.5220/0005141301200129