EVALUATION OF ONTOLOGY BUILDING METHODOLOGIES - A Method based on Balanced Scorecards

Michela Chimienti, Michele Dassisti, Antonio De Nicola, Michele Missikoff

2009

Abstract

Ontology building methodologies concern techniques and methods related to ontology creation that starts from capturing ontology users’ requirements and concludes by releasing the final ontology. Despite the several ontology building methodologies (OBMs) developed, endowed with different characteristics, there is not yet a method to evaluate them. This paper describes an evaluation method of OBMs based on Balanced Scorecards (BSCs), a novel approach for strategic management of enterprises that we apply to the assessment of OBMs. Then, as a case study, the proposed evaluation method is applied to the UPON OBM. Finally, we show the major strengths of the BSCs’ multi-disciplinary approach.

References

  1. Boehm, B.M., Abts, C., Chulani, S. (2000). Software development cost estimation approaches-A survey. In Annals of Software Engineering, 10, 177-205.
  2. Buglione, L., Abran, A., Meli, R. (2001). How functional size measurement supports the balanced scorecard framework for ICT. In Proceedings of European Conference on Software Measurement and ICT Control, 259-272.
  3. Burton-Jones, A., Storey, V.C., Sugumaran, V., Ahluwalia, P. (2005). A semiotic metrics suite for assessing the quality of ontologies. In Data & Knowledge Engineering, 55(1), 84-102.
  4. Chimienti, M., Dassisti, M., De Nicola, A., Missikoff, M. (2006) Benchmarking Criteria to Evaluate Ontology Building Methodologies. In Proceedings of the EMOIINTEROP'06 Luxembourg.
  5. Corcho, O., Fernández-López, M., Gomez-Perez, A. (2003). Methodologies, tools and languages for building ontologies. Where is the meeting point? In Data & Knowledge Engineering, 46(1), 41-64.
  6. Dam, K.H., Winikoff, M. (2004). Comparing AgentOriented Methodologies. In Agent-Oriented Information Systems (AOIS 2003), Springer LNAI 3030, 78-93.
  7. De Nicola, A., Navigli, R., Missikoff, M. (2009). A software engineering approach to ontology building. In Information Systems, 34 (2), 258-275.
  8. Fernández-López, M. (1999). Overview of Methodologies for Building Ontologies. In Proceedings of the IJCAI99 Stockholm, Sweden.
  9. Geerts, G.L., McCarthy, W.E. (2000). The Ontological Foundations of REA Enterprise. Information Systems. Annual Meeting of the American Accounting Association, Philadelphia, PA, USA.
  10. Gruber, T.R. (1993). A translation approach to portable ontology specifications. In Knowledge Acquisition, 5(2), 199-220.
  11. Grüninger, M., Fox, M.S. (1995). Methodology for the design and evaluation of ontologies. In Proceedings of the Workshop on Basic Ontological Issues in Knowledge Sharing.
  12. Guarino, N., Welty, C. (2002). Evaluating ontological decisions with Ontoclean. In Communications of the ACM, 45 (2), 61-65.
  13. Haarslev, V., Möller R. (2001). Description of the RACER system and its applications. In Proceedings of the International Workshop on Description Logics.
  14. Hakkarainen, S., Strasunskas, D., Hella, L., Tuxen, S. (2005). Choosing Appropriate Method Guidelines for Web-Ontology Building. In ER 2005. Lecture Notes in Computer Science, 3716, 270-287.
  15. Holsapple, C.W., Joshi, K.D. (2002). A collaborative approach to ontology design. In Communications of the ACM, 45(2), 42-47.
  16. Ibáñez, M. (1998). Balanced IT Scorecard Generic Model Version 1.0. In Technical Report of European Software Institute, ESI-1998-TR-009.
  17. Ide, N., Véronis, J. (1993). Extracting knowledge bases from machine-readable dictionaries: have we wasted our time? In Proceedings of KB&KS workshop, Tokyo, 257-266.
  18. IEEE (1996). IEEE Std. 1074-1995 Standard for Developing Software Life Cycle Processes. Standards Coordinating Committee of the IEEE Computer Society, April 26, 1996, New York, USA.
  19. Kaplan, R., Norton, D. (1996). The balanced scorecard: translating strategy into action. Harvard Business School Press, Boston Massachusettes.
  20. Likert, R. (1932). A technique for the measurement of attitudes. In Archives of Psychology, 140, 1-55.
  21. Noy, N.F., McGuinness, D.L. (2001). Ontology Development 101: a guide to creating your first ontology, Knowledge Systems Laboratory, Stanford.
  22. Paslaru Bontas Simperl, E., Tempich, C., Sure Y. (2006). ONTOCOM: a cost estimation model for ontology engineering. In Proceedings of ISWC.
  23. Sure, Y., Studer, R. (2002). On-To-Knowledge Methodology. On-To-Knowledge deliverable D-17, Institute AIFB, University of Karlsruhe.
  24. Swartout, B., Ramesh, P., Knight, K., Russ, T. (1997). Toward Distributed Use of Large-Scale Ontologies. In Proceedings of the Symposium on Ontological Engineering of AAAI, Stanford, California, 138-148.
  25. Tempich, C., Pinto, H.S., Staab, S. (2006). Ontology engineering revisited: an iterative case study. In Proceedings of the European Semantic Web Conference ESWC, Springer LNCS 4011, 110-124.
Download


Paper Citation


in Harvard Style

Chimienti M., Dassisti M., De Nicola A. and Missikoff M. (2009). EVALUATION OF ONTOLOGY BUILDING METHODOLOGIES - A Method based on Balanced Scorecards . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009) ISBN 978-989-674-012-2, pages 141-146. DOI: 10.5220/0002287001410146


in Bibtex Style

@conference{keod09,
author={Michela Chimienti and Michele Dassisti and Antonio De Nicola and Michele Missikoff},
title={EVALUATION OF ONTOLOGY BUILDING METHODOLOGIES - A Method based on Balanced Scorecards},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009)},
year={2009},
pages={141-146},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002287001410146},
isbn={978-989-674-012-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2009)
TI - EVALUATION OF ONTOLOGY BUILDING METHODOLOGIES - A Method based on Balanced Scorecards
SN - 978-989-674-012-2
AU - Chimienti M.
AU - Dassisti M.
AU - De Nicola A.
AU - Missikoff M.
PY - 2009
SP - 141
EP - 146
DO - 10.5220/0002287001410146