EVALUATING SEMANTIC CLASSES USED FOR ONTOLOGY BUILDING AND LEARNING FROM TEXTS

Sarra Ben Abbès, Haïfa Zargayouna, Adeline Nazarenko

Abstract

A large effort has been devoted to the development of ontology building tools but it is still difficult to assess their strengths and limitations. Proposed evaluations are hardly reproducible and there is a lack of well accepted protocols and data. In this paper, we propose to decompose the evaluation of ontology acquisition process into independent functionalities. We focus on the evaluation of semantic class acquisition considered as a main step in the ontology acquisition process. We propose an approach to automatically evaluate semantic classes of ontologies that offer lexical entries for concepts. It is based on the comparative paradigm (to a gold standard). Its main focus is to compare how similar the generated semantic classes are to the gold standard concerning the disposition of concepts frontiers. This comparison relies on the lexical level and on the hierarchical structure of the ”gold” concepts. The propositions are implemented, two experiments are settled on different domains and prove that the measures give a more accurate information on quality of systems’ performances.

References

  1. Brank, J., Madenic, D., and Groblenik, M. (2006). Gold standard based ontology evaluation using instance assignment. In Proc. of the 4th Workshop on Evaluating Ontologies for the Web (EON2006), Scotland.
  2. Maedche, A. and Staab, S. (2002). Measuring Similarity between Ontologies. In Proc. Of the European Conference on Knowledge Acquisition and Management - EKAW-2002. Spain.
  3. Szulman, S., Aussenac-Gilles, N., and Despres, S. (2008). The terminae method and platform for ontology engineering from texts. In Bridging the Gap between Text and Knowledge - Selected Contributions to Ontology Learning and Population from Text. IOS press.
  4. Wu, Z. and Palmer, M. (1994). Verb semantics and lexical selection. In 32nd. Annual Meeting of the Association for Computational Linguistics, pages 133 -138, New Mexico.
  5. Zargayouna, H. and Nazarenko, A. (2010). Evaluation of textual knowledge acquisition tools: a challenging task. In LREC 2010, Malta.
  6. Zavitsanos, E., Paliouras, G., and Vouros, G. (2008). A distributional approach to evaluating ontology learning methods using a gold standard. In Ontology Learning and Population Workshop (OLP 2008), European Conference on Artificial Intelligence (ECAI 2008).
Download


Paper Citation


in Harvard Style

Ben Abbès S., Zargayouna H. and Nazarenko A. (2011). EVALUATING SEMANTIC CLASSES USED FOR ONTOLOGY BUILDING AND LEARNING FROM TEXTS . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2011) ISBN 978-989-8425-80-5, pages 445-448. DOI: 10.5220/0003661804450448


in Bibtex Style

@conference{keod11,
author={Sarra Ben Abbès and Haïfa Zargayouna and Adeline Nazarenko},
title={EVALUATING SEMANTIC CLASSES USED FOR ONTOLOGY BUILDING AND LEARNING FROM TEXTS},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2011)},
year={2011},
pages={445-448},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003661804450448},
isbn={978-989-8425-80-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2011)
TI - EVALUATING SEMANTIC CLASSES USED FOR ONTOLOGY BUILDING AND LEARNING FROM TEXTS
SN - 978-989-8425-80-5
AU - Ben Abbès S.
AU - Zargayouna H.
AU - Nazarenko A.
PY - 2011
SP - 445
EP - 448
DO - 10.5220/0003661804450448