OntoMetrics: Putting Metrics into Use for Ontology Evaluation

Birger Lantow

2016

Abstract

Automatically calculated metrics are needed in order to evaluate ontology quality. Otherwise, major resources are required in order to manually assess certain Quality Criteria of an ontology. While there is rule based support for the detection modelling errors and the violation of ontology modelling guidelines, there is a lack of support for calculating ontology metrics. However, metrics can serve as indicators for possible quality problems that are not covered rule based ontology evaluation. Many metrics have been proposed that correlate for example with ontology characteristics like Readability, Adaptability, and Reusability. However, there is a lack of tool support. OntoMetrics provides free access to metric definition and calculation. Furthermore it fosters the development of knowledge regarding the application of Ontology Metrics. This paper provides theoretical background and usage scenarios for the OntoMetrics on-line platform.

References

  1. Alani, H., Brewster, C., and Shadbolt, N. (2006). Ranking ontologies with AKTiveRank. In International Semantic Web Conference, pages 1-15.
  2. Brewster, C., Alani, H., Dasmahapatra, S., and Wilks, Y. (2004). Data driven ontology evaluation.
  3. Burton-Jones, A., Storey, V. C., Sugumaran, V., and Ahluwalia, P. (2005). A semiotic metrics suite for assessing the quality of ontologies. Data & Knowledge Engineering, 55(1):84-102.
  4. Ding, L., Finin, T., Joshi, A., Pan, R., Cost, R. S., Peng, Y., Reddivari, P., Doshi, V. C., and Sachs, J. (2004). Swoogle: A semantic web search and metadata engine. In Proc. 13th ACM Conf. on Information and Knowledge Management, volume 304.
  5. Fernández, M., Overbeeke, C., Sabou, M., and Motta, E. (2009). What makes a good ontology? A case-study in fine-grained knowledge reuse. In Asian Semantic Web Conference, pages 61-75.
  6. Fernández-López, M., Gómez-Pérez, A., and Juristo, N. (1997). Methontology: from ontological art towards ontological engineering.
  7. Gangemi, A., Catenacci, C., Ciaramita, M., and Lehmann, J. (2005). A theoretical framework for ontology evaluation and validation. In SWAP, volume 166.
  8. Gavrilova, T., Gorovoy, V., and Bolotnikova, E. (2012). New Ergonomic Metrics for Educational Ontology Design and Evaluation. In SoMeT, pages 361-378.
  9. Guarino, N. and Welty, C. A. (2009). An overview of OntoClean. In Handbook on ontologies, pages 201-220. Springer.
  10. Hlomani, H. and Stacey, D. (2014). Approaches, methods, metrics, measures, and subjectivity in ontology evaluation: A survey. Semantic Web Journal, pages 1-5.
  11. Lantow, B. and Sandkuhl, K. (2015). An Analysis of Applicability using Quality Metrics for Ontologies on Ontology Design Patterns. Intelligent Systems in Accounting, Finance and Management, 22(1):81-99.
  12. Lozano-Tello, A. and G ómez-Pérez, A. (2004). Ontometric: A method to choose the appropriate ontology. Journal of database management, 2(15):1-18.
  13. Noy, N. F., McGuinness, D. L., et al. (2001). Ontology development 101: A guide to creating your first ontology.
  14. Pak, J. and Zhou, L. (2011). A Framework for Ontology Evaluation. In Sharman, R., Rao, H., and Raghu, T., editors, Exploring the Grand Challenges for Next Generation E-Business, volume 52 of Lecture Notes in Business Information Processing, pages 10-18. Springer Berlin Heidelberg.
  15. Porzel, R. and Malaka, R. (2004). A task-based approach for ontology evaluation. In ECAI Workshop on Ontology Learning and Population, Valencia, Spain.
  16. Poveda-Villalón, M., Suárez-Figueroa, M. C., and GómezPérez, A. (2012). Validating ontologies with oops! In International Conference on Knowledge Engineering and Knowledge Management, pages 267-281.
  17. Tartir, S., Arpinar, I. B., Moore, M., Sheth, A. P., and Aleman-Meza, B. (2005). OntoQA: Metricbased ontology quality analysis. In IEEE Workshop on Knowledge Acquisition from Distributed, Autonomous, Semantically Heterogeneous Data and Knowledge Sources, volume 9.
  18. Yao, H., Orme, A. M., and Etzkorn, L. (2005). Cohesion metrics for ontology design and application. Journal of Computer science, 1(1):107.
Download


Paper Citation


in Harvard Style

Lantow B. (2016). OntoMetrics: Putting Metrics into Use for Ontology Evaluation . In Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 2: KEOD, (IC3K 2016) ISBN 978-989-758-203-5, pages 186-191. DOI: 10.5220/0006084601860191


in Bibtex Style

@conference{keod16,
author={Birger Lantow},
title={OntoMetrics: Putting Metrics into Use for Ontology Evaluation},
booktitle={Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 2: KEOD, (IC3K 2016)},
year={2016},
pages={186-191},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006084601860191},
isbn={978-989-758-203-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 2: KEOD, (IC3K 2016)
TI - OntoMetrics: Putting Metrics into Use for Ontology Evaluation
SN - 978-989-758-203-5
AU - Lantow B.
PY - 2016
SP - 186
EP - 191
DO - 10.5220/0006084601860191