Extracting Semantic Meaning from Photographic Annotations using a Hybrid Approach

Rodrigo Carvalho, Sam Chapman, Fabio Ciravegna

Abstract

This paper evaluates singular then hybrid methodologies for extracting semantics relevant to users in cataloguing and searching of personal photographs. It concentrates upon extraction of meaningful concepts within textual annotations focusing around geographical identification, together with references to people and objects concerning each image. A number of approaches are considered; machine learning, rule based and a novel hybrid approach encompassing previous techniques. This evaluation identifies the strengths of the singular approaches and defines rules best suited to differing extractions providing a higher performing hybrid method.

References

  1. L. Ahn and L. Dabbish. Labeling images with a computer game. In CHI 7804, pages 319-326, New York, NY, USA, 2004. ACM Press.
  2. A. Barla, F. Odone, and A. Verri. Old fashioned state-of-the-art image classification. In Proc. of ICIAP 2003, pages 566-571, Sept 2003.
  3. M. Hearst. Automatic acquisition of hyponyms from large text corpora. In Proc. of COLING 1992, pages 539-545, 1992.
  4. J. Iria and F. Ciravegna. A Methodology and Tool for Representing Language Resources for Information Extraction. In Proc. of LREC 2006, Genoa, Italy, May 2006.
  5. J. Iria, N. Ireson, and F. Ciravegna. An experimental study on boundary classification algorithms for information extraction using svm. In Proc. of EACL 2006, April 2006.
  6. M. Naaman, S. Harada, Q. Wang, H. Garcia-Molina, and A. Paepcke. Context data in georeferenced digital photo collections. In Proc. of ACM MM, Oct 2004.
  7. K. Pastra, H. Saggion H, and Y. Wilks. Extracting relational facts for indexing and retrieval of crime-scene photographs, 2002.
  8. R. Srihari. Automatic indexing and content-based retrieval of captioned images. Computer, 28(9):49-56, 1995.
  9. R. Veltkamp and M. Tanase. Content-based image retrieval systems: A survey. Technical Report UU-CS-2000-34, Dept. of Computing Science, Utrecht University, 2000.
Download


Paper Citation


in Harvard Style

Carvalho R., Chapman S. and Ciravegna F. (2008). Extracting Semantic Meaning from Photographic Annotations using a Hybrid Approach . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 48-57. DOI: 10.5220/0002339700480057


in Bibtex Style

@conference{mmiu08,
author={Rodrigo Carvalho and Sam Chapman and Fabio Ciravegna},
title={Extracting Semantic Meaning from Photographic Annotations using a Hybrid Approach},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},
year={2008},
pages={48-57},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002339700480057},
isbn={978-989-8111-24-1},
}


in EndNote Style

TY - CONF
JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Extracting Semantic Meaning from Photographic Annotations using a Hybrid Approach
SN - 978-989-8111-24-1
AU - Carvalho R.
AU - Chapman S.
AU - Ciravegna F.
PY - 2008
SP - 48
EP - 57
DO - 10.5220/0002339700480057