Semantic Gastroenterological Images Annotation and Retrieval - Reasoning with a Polyp Ontology

Yahia Chabane, Christophe Rey


In gastroenterology, monitoring polyps is fundamental in order to detect a cancer. It may be difficult for surgeons to decide whether he should remove a polyp or not. A wrong decision may generate unjustified costs or be dangerous for the patient health. To help their diagnosis, physicians may need images of previously treated cases. For this purpose, we present in this paper a semantic image retrieval approach focused on endoscopic gastroenterological images. This approach is based on a slight extension of classical description logic reasonings, associated with a polyp ontology and a suited image annotation mechanism.


  1. AIM (2010). Annotation and image markup (aim) project.
  2. Aslani, M. and Haarslev, V. (2012). Concurrent classification of owl ontologies - an empirical evaluation. In Description Logics.
  3. Baader, F., Calvanese, D., McGuinness, D. L., Nardi, D., and Patel-Schneider, P. F., editors (2007). The Description Logic Handbook: Theory, Implementation, and Applications (2nd Edition). Cambridge University Press.
  4. Bimbo, A. D. (1999). Visual information retrieval. Morgan Kaufmann.
  5. BioPortal (2013). Bioportal. http://bioportal.
  6. Calì, A., Gottlob, G., and Lukasiewicz, T. (2009). A general datalog-based framework for tractable query answering over ontologies. In PODS, pages 77-86.
  7. Colucci, S., Noia, T. D., Sciascio, E. D., Donini, F. M., and Mongiello., M. (2011). Description Logic-Based Resource Retrieval., pages 185-197. Encyclopedia of Knowledge Management.
  8. Datta, R., Joshi, D., Li, J., and Wang, J. Z. (2008). Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys, 40(2).
  9. Di Noia, T., Di Sciascio, E., Donini, F. M., di Cugno, F., and Tinelli, E. (2005). Non-standard inferences for knowledge-based image retrieval. In EWIMT 2005 2nd European Workshop on the Integration of Knowledge, Semantic and Digital Media Techniques, IEE press, pages 191-197. IEE.
  10. DICOM (1993). Digital imaging and communications in medicine.
  11. FaCT++ (2013). The fact++ owl-dl and (partial) owl2-dl reasoner.
  12. FMA (2013). Foundational model anatomy. http://sig.
  13. Galen (2013). Galen and the galen-core high-level ontology for medicine.
  14. Gruber, T. (2009). Encyclopedia of Database Systems, chapter Ontology. Springer-Verlag.
  15. Heer, J., Card, S. K., and Landay, J. A. (2005). prefuse: a toolkit for interactive information visualization. In CHI, pages 421-430.
  16. HermiT (2013). The hermit owl2 reasoner. http://
  17. Horridge, M., Parsia, B., and Sattler, U. (2011). The state of bio-medical ontologies. Bio-Ontologies. http://
  18. Hu, B., Dasmahapatra, S., Lewis, P. H., and Shadbolt, N. (2003). Ontology-based medical image annotation with description logics. In ICTAI, pages 77-.
  19. Kudo, S., Hirota, S., Nakajima, T., Hosobe, S., Kusaka, H., Kobayashi, T., Himori, M., and Yagyuu, A. (1994). Colorectal tumours and pit pattern. J Clin Pathol, 47.
  20. Lenzerini, M. (2011). Ontology-based data management. In Proceedings of the 20th ACM international conference on Information and knowledge management, CIKM 7811.
  21. Meghini, C., Sebastiani, F., and Straccia, U. (2001). A model of multimedia information retrieval. J. ACM, 48(5):909-970.
  22. Motik, B., Shearer, R., and Horrocks, I. (2009). Hypertableau reasoning for description logics. J. Artif. Intell. Res. (JAIR), 36:165-228.
  23. MST (2009). Mst - minimal standard terminology for gastrointestinal endoscopy. mst.html.
  24. Mutharaju, R., Maier, F., and Hitzler, P. (2010). A mapreduce algorithm for el+. In Description Logics.
  25. OpenClinical (2013). Openclinical: knowledge management for medical care. ontologies.html.
  26. Opitz, J., Parsia, B., and Sattler, U. (2009). Using ontologies for medical image retrieval - an experiment. In OWLED.
  27. OWL (2007). Owl, the web ontology language.
  28. Paris (2003). The paris endoscopic classification of superficial neoplastic lesions: esophagus, stomach, and colon: November 30 to december 1, 2002. Gastrointestinal Endoscopy, 58(6 Suppl):3-43.
  29. Pellet (2013). The pellet owl2 reasoner. http://
  30. Protégé (2013). The proégé open source ontology editor and knowledge-base framework. http://protege.
  31. RacerPro (2013). The racerpro owl/rdf reasoner. http://
  32. RJ, S., RH, R., Y, K., F, B., and al (2000). The vienna classification of gastrointestinal epithelial neoplasia. Gut., 47:251-255.
  33. Rubin, D. L., Mongkolwat, P., Kleper, V., Supekar, K., and Channin, D. S. (2008). Medical imaging on the semantic web: Annotation and image markup. In AAAI Spring Symposium: Semantic Scientific Knowledge Integration, pages 93-98. AAAI.
  34. Rui, Y., Huang, T. S., and Chang, S.-F. (1999). Image retrieval: current techniques, promising directions and open issues. Journal of Visual Communication and Image Representation, 10:39-62.
  35. S. Dasmahapatra, D. Dupplaw, B. H. P. L. and Shadbolt, N. (2005). Ontology-mediated distributed decision support for breast cancer. In AIME 2005, LNAI 3581, page 221?225. Springer-Verlag Berlin Heidelberg.
  36. Sciascio, E. D., Donini, F. M., and Mongiello, M. (2000). Semantic indexing in image retrieval using description logic. In Proceedings of the 22nd International Conference on Information Technology Interfaces.
  37. SnomedCT (2007). Systematized nomenclature of medicine - clinical terms. research/umls/Snomed/snomed main.html.
  38. Staab, S. and Studer, R., editors (2009). Handbook on Ontologies, volume XIX of International Handbooks on Information Systems. 2nd ed. edition.
  39. Theseus (2009). Theseus project, medico scenario. http://
  40. University, S. (2002). The institute for formal ontology and medical information science.
  41. Wennerberg, P., Schulz, K., and Buitelaar, P. (2011). Ontology modularization to improve semantic medical image annotation. Journal of Biomedical Informatics, 44(1):155-162.

Paper Citation

in Harvard Style

Chabane Y. and Rey C. (2013). Semantic Gastroenterological Images Annotation and Retrieval - Reasoning with a Polyp Ontology . In Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013) ISBN 978-989-8565-81-5, pages 293-300. DOI: 10.5220/0004549202930300

in Bibtex Style

author={Yahia Chabane and Christophe Rey},
title={Semantic Gastroenterological Images Annotation and Retrieval - Reasoning with a Polyp Ontology},
booktitle={Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013)},

in EndNote Style

JO - Proceedings of the International Conference on Knowledge Engineering and Ontology Development - Volume 1: KEOD, (IC3K 2013)
TI - Semantic Gastroenterological Images Annotation and Retrieval - Reasoning with a Polyp Ontology
SN - 978-989-8565-81-5
AU - Chabane Y.
AU - Rey C.
PY - 2013
SP - 293
EP - 300
DO - 10.5220/0004549202930300