Improved Image Retrieval using Visual Sorting and Semi-Automatic Semantic Categorization of Images

Kai Uwe Barthel, Sebastian Richter, Anuj Goyal

2008

Abstract

The increasing use of digital images has led to the growing problem of how to organize these images efficiently for search and retrieval. Interpretation of what we see in images is hard to characterize, and even more so to teacha machine such that any automated organization can be possible. Due to this, both keyword-based Internet image search systems and content-based image retrieval systems are not capable of searching images according to the human high-level semantics of images. In this paper we propose a new image search system using keyword annotations, low-level visual metadata and semantic inter-image relationships. The semantic relationships are earned exclusively from the human users’ interaction with the image search system. Our system can be used to search huge (web-based) image sets more efficiently. However, the most important advantage of the new system is that it can be used to generate semi-automatically semantic relationships between the images.

References

  1. M. Bober: MPEG-7 visual shape descriptors. Special issue on MPEG-7, IEEE Transactions on Circuits and Systems for Video Technology 11/6, 716-719 (2001)
  2. Ritendra Datta, Jia Li, James Ze Wang: Content-based image retrieval: approaches and trends of the new age. Multimedia Information Retrieval 2005: 253-262
  3. D. Deng, J. Zhang and M. Purvis: Visualisation and comparison of image collections based on self-organised maps, ACSW Frontiers 7804: Workshop on Australasian information security, Data Mining and Web Intelligence, and Software Internationalisation (2004)
  4. J. Laaksonen, M. Koskela, and E. Oja, PicSOM - Self-Organizing Image Retrieval With MPEG-7 Content Descriptors, IEEE Trans. on Neural Networks, Vol. 13, No. 4, (2002)
  5. Kohonen, T., Self-Organizating Maps, New York: Springer (1997)
  6. Y. L. Lu, C. Hu, X. Zhu, H. J. Zhang, and Q. Yang, “A unified framework for semantics and feature based relevance feedback in image retrieval systems,” in Proceedings of 8th ACM International Conference on Multimedia (MM 7800), pp. 31-37
  7. David G. Lowe, "Distinctive image features from scale-invariant keypoints," International Journal of Computer Vision, 60, 2 (2004), pp. 91-110.
  8. Manjunath B. S. , Ohm J. R. , Vasudevan V. V., Yamada A. “Color and texture descriptors. Special issue on MPEG-7”, IEEE Transactions on Circuits and Systems for Video Technology, 11/6, 703-715 (2001)
  9. G. Matas, D. Koubaroulis and J. Kittler, Colour Image Retrieval and Object Recognition Using the Multimodal Neighbourhood Signature, 6th European Conference on Computer Vision, Dublin, Ireland, June 2000
  10. Jia-Yu Pan, Hyung-Jeong Yang, Christos Faloutsos, Pinar Duygulu: GCap: Graph-based Automatic Image Captioning (2004)
  11. Rubner, Y., Tomasi, C., and Guibas, L. J. 1998 The Earth Mover's Distance as a Metric for Image Retrieval. Technical Report. UMI Order Number: CS-TN-98-86, Stanford Univ.
  12. Liu Wenyin, Susan Dumais, Yanfeng Sun, HongJiang Zhang, Mary Czerwinski, Brent Field: Semi-Automatic Image Annotation (2001)
  13. Wei Wang, Yimin Wu, Aidong Zhang: SemView: A Semantic-sensitive Distributed Image Retrieval System, National Conference on Digital Government Research (2003)
  14. X. S. Zhou, T. S. Huang, “Unifying Keywords and Visual Contents in Image Retrieval”, IEEE Multimedia, April-June Issue, 2002.
Download


Paper Citation


in Harvard Style

Barthel K., Richter S. and Goyal A. (2008). Improved Image Retrieval using Visual Sorting and Semi-Automatic Semantic Categorization of Images . In Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008) ISBN 978-989-8111-24-1, pages 67-77. DOI: 10.5220/0002339400670077


in Bibtex Style

@conference{mmiu08,
author={Kai Uwe Barthel and Sebastian Richter and Anuj Goyal},
title={Improved Image Retrieval using Visual Sorting and Semi-Automatic Semantic Categorization of Images},
booktitle={Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)},
year={2008},
pages={67-77},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002339400670077},
isbn={978-989-8111-24-1},
}


in EndNote Style

TY - CONF
JO - Metadata Mining for Image Understanding - Volume 1: MMIU, (VISIGRAPP 2008)
TI - Improved Image Retrieval using Visual Sorting and Semi-Automatic Semantic Categorization of Images
SN - 978-989-8111-24-1
AU - Barthel K.
AU - Richter S.
AU - Goyal A.
PY - 2008
SP - 67
EP - 77
DO - 10.5220/0002339400670077