Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle

Perrine Pittet, Jérôme Barthélémy

Abstract

This paper presents the basis of our approach for evaluation of application ontologies. Adapting an existing task-based evaluation, this approach explains how crowdsourcing, involving application users, can efficiently help in the improvement of an application ontology all along the ontology lifecycle. A real case experiment on an application ontology designed for the semantic annotation of geobusiness user data illustrates the proposal.

References

  1. Ali, R., Solis, C., Omoronyia, I., Salehie, M., & Nuseibeh, B. (2012). Social adaptation: when software gives users a voice.
  2. Brank, J., Grobelnik, M., & Mladenic, D. (2005, October). A survey of ontology evaluation techniques. In Proceedings of the conference on data mining and data warehouses (SiKDD 2005) (pp. 166-170).
  3. Brewster, C., Alani, H., Dasmahapatra, S., & Wilks, Y. (2004). Data driven ontology evaluation.
  4. Gómez-Pérez, A. (1995, February). Some ideas and examples to evaluate ontologies. In Artificial Intelligence for Applications, 1995. Proceedings, 11th Conference on (pp. 299-305). IEEE.
  5. Gómez Pérez, A. (2001). Evaluation of ontologies. International Journal of intelligent systems, 16(3), 391-409.
  6. Guarino, N. (1998). Formal ontology in information systems: Proceedings of the first international conference (FOIS'98), June 6-8, Trento, Italy (Vol. 46). IOS press.
  7. Guarino, N., & Welty, C. (2002). Evaluating ontological decisions with OntoClean. Communications of the ACM, 45(2), 61-65.
  8. Hosseini, M., Phalp, K., Taylor, J., & Ali, R. (2014, May). The four pillars of crowdsourcing: A reference model. In Research Challenges in Information Science (RCIS), 2014 IEEE Eighth International Conference on (pp. 1-12). IEEE.
  9. Klein, M. C. A. (2004). Change management for distributed ontologies.
  10. Lozano-Tello, A., & Gómez-Pérez, A. (2004). Ontometric: A method to choose the appropriate ontology. Journal of Database Management, 2(15), 1-18.
  11. Maedche, A., & Staab, S. (2002). Measuring similarity between ontologies. In Knowledge engineering and knowledge management: Ontologies and the semantic web (pp. 251-263). Springer Berlin Heidelberg.
  12. Malone, J., & Parkinson, H. (2010) Reference and Application Ontologies. Ontogenesis. http:// ontogenesis.knowledgeblog.org/295.
  13. Neuhaus, F., Vizedom, A., Baclawski, K., Bennett, M., Dean, M., Denny, M., & Yim, P. (2013). Towards ontology evaluation across the life cycle. Applied Ontology, 8(3), 179-194.
  14. Noy, N. F., & McGuinness, D. L. (2001). Ontology development 101: A guide to creating your first ontology.
  15. Pagano, D., & Brügge, B. (2013, May). User involvement in software evolution practice: a case study. In Proceedings of the 2013 international conference on Software engineering (pp. 953-962). IEEE Press.
  16. Porzel, R., & Malaka, R. (2004, August). A task-based approach for ontology evaluation. In ECAI Workshop on Ontology Learning and Population, Valencia, Spain.
  17. Santos, L. E., Girardi, R., & Novais, P. (2013, April). A Case Study on the Construction of Application Ontologies. In Information Technology: New Generations (ITNG), 2013 Tenth International Conference on (pp. 619-624). IEEE.
  18. Shaw, M., Detwiler, L. T., Brinkley, J. F., & Suciu, D. (2008). Generating application ontologies from reference ontologies. In AMIA Annual Symposium Proceedings (Vol. 2008, p. 672). American Medical Informatics Association.
  19. Staab, S., & Studer, R. (Eds.). (2013). Handbook on ontologies. Springer Science & Business Media.
  20. Suarez-Figueroa, M. C., Gomez-Perez, A., & FernandezLopez, M. (2012). The NeOn methodology for ontology engineering. In Ontology engineering in a networked world (pp. 9-34). Springer Berlin Heidelberg.
  21. Sure, Y., Erdmann, M., Angele, J., Staab, S., Studer, R., & Wenke, D. (2002). OntoEdit: Collaborative ontology development for the semantic web (pp. 221-235). Springer Berlin Heidelberg.
  22. Sure, Y., Staab, S., & Studer, R. (2009). Ontology engineering methodology. In Handbook on ontologies (pp. 135-152). Springer Berlin Heidelberg.
  23. Vrandecic, D. (2009). Ontology evaluation (pp. 293-313). Springer Berlin Heidelberg.
Download


Paper Citation


in Bibtex Style

@conference{keod15,
author={Perrine Pittet and Jérôme Barthélémy},
title={Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle},
booktitle={Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015)},
year={2015},
pages={263-268},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005608202630268},
isbn={978-989-758-158-8},
}


in Harvard Style

Pittet P. and Barthélémy J. (2015). Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle . In Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015) ISBN 978-989-758-158-8, pages 263-268. DOI: 10.5220/0005608202630268


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015)
TI - Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle
SN - 978-989-758-158-8
AU - Pittet P.
AU - Barthélémy J.
PY - 2015
SP - 263
EP - 268
DO - 10.5220/0005608202630268