Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle

Perrine Pittet, Jérôme Barthélémy

2015

Abstract

This paper presents the basis of our approach for evaluation of application ontologies. Adapting an existing task-based evaluation, this approach explains how crowdsourcing, involving application users, can efficiently help in the improvement of an application ontology all along the ontology lifecycle. A real case experiment on an application ontology designed for the semantic annotation of geobusiness user data illustrates the proposal.

References

  1. Ali, R., Solis, C., Omoronyia, I., Salehie, M., & Nuseibeh, B. (2012). Social adaptation: when software gives users a voice.
  2. Brank, J., Grobelnik, M., & Mladenic, D. (2005, October). A survey of ontology evaluation techniques. In Proceedings of the conference on data mining and data warehouses (SiKDD 2005) (pp. 166-170).
  3. Brewster, C., Alani, H., Dasmahapatra, S., & Wilks, Y. (2004). Data driven ontology evaluation.
  4. Gómez-Pérez, A. (1995, February). Some ideas and examples to evaluate ontologies. In Artificial Intelligence for Applications, 1995. Proceedings, 11th Conference on (pp. 299-305). IEEE.
  5. Gómez Pérez, A. (2001). Evaluation of ontologies. International Journal of intelligent systems, 16(3), 391-409.
  6. Guarino, N. (1998). Formal ontology in information systems: Proceedings of the first international conference (FOIS'98), June 6-8, Trento, Italy (Vol. 46). IOS press.
  7. Guarino, N., & Welty, C. (2002). Evaluating ontological decisions with OntoClean. Communications of the ACM, 45(2), 61-65.
  8. Hosseini, M., Phalp, K., Taylor, J., & Ali, R. (2014, May). The four pillars of crowdsourcing: A reference model. In Research Challenges in Information Science (RCIS), 2014 IEEE Eighth International Conference on (pp. 1-12). IEEE.
  9. Klein, M. C. A. (2004). Change management for distributed ontologies.
  10. Lozano-Tello, A., & Gómez-Pérez, A. (2004). Ontometric: A method to choose the appropriate ontology. Journal of Database Management, 2(15), 1-18.
  11. Maedche, A., & Staab, S. (2002). Measuring similarity between ontologies. In Knowledge engineering and knowledge management: Ontologies and the semantic web (pp. 251-263). Springer Berlin Heidelberg.
  12. Malone, J., & Parkinson, H. (2010) Reference and Application Ontologies. Ontogenesis. http:// ontogenesis.knowledgeblog.org/295.
  13. Neuhaus, F., Vizedom, A., Baclawski, K., Bennett, M., Dean, M., Denny, M., & Yim, P. (2013). Towards ontology evaluation across the life cycle. Applied Ontology, 8(3), 179-194.
  14. Noy, N. F., & McGuinness, D. L. (2001). Ontology development 101: A guide to creating your first ontology.
  15. Pagano, D., & Brügge, B. (2013, May). User involvement in software evolution practice: a case study. In Proceedings of the 2013 international conference on Software engineering (pp. 953-962). IEEE Press.
  16. Porzel, R., & Malaka, R. (2004, August). A task-based approach for ontology evaluation. In ECAI Workshop on Ontology Learning and Population, Valencia, Spain.
  17. Santos, L. E., Girardi, R., & Novais, P. (2013, April). A Case Study on the Construction of Application Ontologies. In Information Technology: New Generations (ITNG), 2013 Tenth International Conference on (pp. 619-624). IEEE.
  18. Shaw, M., Detwiler, L. T., Brinkley, J. F., & Suciu, D. (2008). Generating application ontologies from reference ontologies. In AMIA Annual Symposium Proceedings (Vol. 2008, p. 672). American Medical Informatics Association.
  19. Staab, S., & Studer, R. (Eds.). (2013). Handbook on ontologies. Springer Science & Business Media.
  20. Suarez-Figueroa, M. C., Gomez-Perez, A., & FernandezLopez, M. (2012). The NeOn methodology for ontology engineering. In Ontology engineering in a networked world (pp. 9-34). Springer Berlin Heidelberg.
  21. Sure, Y., Erdmann, M., Angele, J., Staab, S., Studer, R., & Wenke, D. (2002). OntoEdit: Collaborative ontology development for the semantic web (pp. 221-235). Springer Berlin Heidelberg.
  22. Sure, Y., Staab, S., & Studer, R. (2009). Ontology engineering methodology. In Handbook on ontologies (pp. 135-152). Springer Berlin Heidelberg.
  23. Vrandecic, D. (2009). Ontology evaluation (pp. 293-313). Springer Berlin Heidelberg.
Download


Paper Citation


in Harvard Style

Pittet P. and Barthélémy J. (2015). Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle . In Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015) ISBN 978-989-758-158-8, pages 263-268. DOI: 10.5220/0005608202630268


in Bibtex Style

@conference{keod15,
author={Perrine Pittet and Jérôme Barthélémy},
title={Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle},
booktitle={Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015)},
year={2015},
pages={263-268},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005608202630268},
isbn={978-989-758-158-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Joint Conference on Knowledge Discovery, Knowledge Engineering and Knowledge Management - Volume 1: KEOD, (IC3K 2015)
TI - Exploiting Users’ Feedbacks - Towards a Task-based Evaluation of Application Ontologies Throughout Their Lifecycle
SN - 978-989-758-158-8
AU - Pittet P.
AU - Barthélémy J.
PY - 2015
SP - 263
EP - 268
DO - 10.5220/0005608202630268