Semantic Annotation of Images Extracted from the Web using RDF Patterns and a Domain Ontology

Rim Teyeb Jaouachi, Mouna Torjmen Khemakhem, Nathalie Hernandez, Ollivier Haemmerle, Maher Ben Jemaa

2015

Abstract

Semantic annotation of web resources presents a point of interest for several research communities. The use of this technique improves the retrieval process because it allows one to pass from the traditional web to the semantic web. In this paper, we propose a new method for semantically annotating web images. The main originality of our approach lies in the use of RDF (Resource Description Framework) patterns in order to guide the annotation process with contextual factors of web images. Each pattern presents a group of information to instantiate from contextual factors related to the image to annotate. We compared the generated annotations with annotations made manually. The results we obtain are encouraging.

References

  1. Arndt, R., Troncy, R., Staab, S., Hardman, L., and Vacura, M. (2007). Comm: Designing a well-founded multimedia ontology for the web. In Proceedings of the 6th International Semantic Web Conference (ISWC2007), pages 11-15.
  2. Bechhofer, S. and Goble, C. (2001). Towards annotation using daml+oil. In Workshop Knowledge Markup & Semantic Annotation, Victoria B.C., Canada.
  3. Bellini, P., Bruno, I., and Nesi, P. (2011). Exploiting intelligent content via axmedis/mpeg-21 for modelling and distributing news. International Journal of Software Engineering and Knowledge Engineering, 21(1):3- 32.
  4. Cunningham, H., Maynard, D., Bontcheva, K., and Tablan, V. (2002). GATE: A Framework and Graphical Development Environment for Robust NLP Tools and Applications. In ACL'02,the 40th Anniversary Meeting of the Association for Computational Linguistics.
  5. Cusano, C., Ciocca, G., and Schettini, R. (2004). Image annotation using SVM. Proceedings of SPIE, 5304:330- 338.
  6. Declerck, T., Crispi, C., Contreras, J., and ?scar Corcho (2004). Text-based semantic annotation service for multimedia content in the esperonto project. In Knowledge-Based Media Analysis for Self-Adaptive and Agile Multi-Media, Proceedings of the European Workshop for the Integration of Knwoledge, Semantics and Digital Media Technology, EWIMT 2004, November 25-26, 2004, London, UK.
  7. Gillet, P. (2013). Gnration de patrons de requtes partir dalignements dontologies: Application un systme dinterrogation du web smantique fond sur les patrons.
  8. Halaschek-wiener, C., Golbeck, J., Schain, A., Parsia, B., and Hendler, J. (2006). Annotation and provenance tracking in semantic web photo libraries. In In International provenance and annotation workshop. Chicago, pages 82-89.
  9. Handschuh, S., Staab, S., and Maedche, A. (2001). Cream: creating relational metadata with a component-based, ontology-driven annotation framework. In K-CAP, pages 76-83.
  10. Jaouachi, R. T., Khemakhem, M. T., Jemaa, M. B., Hernandez, N., and Haemmerle, O. (2013). Multi-factor rdf graph based image annotation -application in cinema domain-. In ICWIT'13, Fifth International Conference on Web and Information Technologies.
  11. Kahan, J. and Koivunen, M.-R. (2001). Annotea: An open rdf infrastructure for shared web annotations. In Proceedings of the 10th International Conference on World Wide Web, pages 623-632, New York, NY, USA. ACM.
  12. Kogut, P. and Holmes, W. (2001). Aerodaml: Applying information extraction to generate daml annotations from web pages. In First International Conference on Knowledge Capture (K-CAP 2001). Workshop on Knowledge Markup and Semantic Annotation.
  13. Krestel, R., Witte, R., and Bergler, S. (2010). PredicateArgument EXtractor (PAX). In New Challenges for NLP Frameworks.
  14. Laclavik, M., Hluch?, L., Seleng, M., and Ciglan, M. (2009). Ontea: Platform for pattern based automated semantic annotation. Computing and Informatics, pages 555-579.
  15. Li, J. and Wang, J. Z. (2003). Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans. Pattern Anal. Mach. Intell., 25(9):1075-1088.
  16. McDowell, L., Etzioni, O., Gribble, S. D., Halevy, A. Y., Levy, H. M., Pentney, W., Verma, D., and Vlasseva, S. (2003). Mangrove: Enticing ordinary people onto the semantic web via instant gratification. In The Semantic Web - ISWC 2003, Second International Semantic Web Conference, Sanibel Island, FL, USA, October 20-23, 2003, Proceedings, pages 754-770.
  17. Nguyen, M.-T. (2007). Vers une plate-forme d'annotations smantiques automatiques partir de documents multimdias.
  18. Popov, B., Kiryakov, A., Kirilov, A., Manov, D., Ognyanoff, D., and Goranov, M. (2004). Kim semantic annotation platform. Journal of Natural Language Engineering, pages 375-392.
  19. Porter, M. F. (1997). Readings in information retrieval. chapter An algorithm for suffix stripping. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
  20. Pradel, C., Haemmerlé, O., and Hernandez, N. (2012). Des patrons modulaires de requtes sparql dans le systme swip. In 23eme Journes Francophones dIngnierie des Connaissances.
  21. Pradel, C., Haemmerlé, O., and Hernandez, N. (2013). Natural language query translation into sparql using patterns. In COLD.
  22. Smeulders, A. W. M., Worring, M., Santini, S., Gupta, A., and Jain, R. (2000). Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell., 22(12):1349-1380.
  23. Vargas-Vera, M., Motta, E., Domingue, J., Lanzoni, M., Stutt, A., and Ciravegna, F. (2002). Mnm: Ontology driven semi-automatic and automatic support for semantic markup. pages 379-391.
  24. Wang, C., Jing, F., Zhang, L., and Zhang, H.-J. (2007). Content-Based Image Annotation Refinement. Computer Vision and Pattern Recognition, 2007. CVPR 7807. IEEE Conference on, pages 1-8.
Download


Paper Citation


in Harvard Style

Teyeb Jaouachi R., Torjmen Khemakhem M., Hernandez N., Haemmerle O. and Ben Jemaa M. (2015). Semantic Annotation of Images Extracted from the Web using RDF Patterns and a Domain Ontology . In Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-097-0, pages 137-144. DOI: 10.5220/0005374301370144


in Bibtex Style

@conference{iceis15,
author={Rim Teyeb Jaouachi and Mouna Torjmen Khemakhem and Nathalie Hernandez and Ollivier Haemmerle and Maher Ben Jemaa},
title={Semantic Annotation of Images Extracted from the Web using RDF Patterns and a Domain Ontology},
booktitle={Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2015},
pages={137-144},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005374301370144},
isbn={978-989-758-097-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 17th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Semantic Annotation of Images Extracted from the Web using RDF Patterns and a Domain Ontology
SN - 978-989-758-097-0
AU - Teyeb Jaouachi R.
AU - Torjmen Khemakhem M.
AU - Hernandez N.
AU - Haemmerle O.
AU - Ben Jemaa M.
PY - 2015
SP - 137
EP - 144
DO - 10.5220/0005374301370144