IMAGE ANNOTATION WITH RELEVANCE FEEDBACK USING A SEMI-SUPERVISED AND HIERARCHICAL APPROACH

Cheng-Chieh Chiang, Ming-Wei Hung, Yi-Ping Hung, Wee Kheng Leow

Abstract

This paper presents an approach for image annotation with relevance feedback that interactively employs a semi-supervised learning to build hierarchical classifiers associated with annotation labels. We construct individual hierarchical classifiers each corresponding to one semantic label that is used for describing the semantic contents of the images. We adopt hierarchical approach for classifiers to divide the whole semantic concept associated with a label into several parts such that the complex contents in images can be simplified. We also design a semi-supervised approach for learning classifiers reduces the need of training images by use of both labeled and unlabeled images. This proposed semi-supervised and hierarchical approach is involved in an interactive scheme of relevance feedbacks to assist the user in annotating images. Finally, we describe some experiments to show the performance of the proposed approach.

References

  1. Bilenko, M., Basu , S., and Mooney, R. J. (2004). Integrating Constraints and Metric Learning in SemiSupervised Clustering. Proceedings of ICM.
  2. Fei-Fei, L. and Perona, P. (2005). A Bayesian Hierarchical Model for Learning Natural Scene Categories. Proceedings of CVPR, pp. 524-531.
  3. Carneiro, G. and Vasconcelos, N. (2005). Formulating Semantic Image Annotation as a Supervised Learning Problem. Proceedings of CVPR.
  4. Chang, E. Y., Goh, K., Sychay, G., and Wu, G. (2003). CBSA: Content-based Soft Annotation for Multimodal Image Retrieval Using Bayes Point Machines. IEEE Transaction on Circuits and Systems for Video
  5. Technology, 13(1):26- 38.
  6. Datta, R., Li, J., and Wang, J. Z. (2005). Content-Based Image Retrieval - Approaches and Trends of the New Age. Proceedings of the ACM SIGMM international workshop on MIR.
  7. Duygulu, P., Barnard, K., de Freitas, J. F. G., and Forsyth, D. A. (2002). Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary. Proceedings of ECCV, pp. 97-112.
  8. Feng, S. L., Manmatha, R., and Lavrenko, V. (2004). Multiple Bernoulli Relevance Models for Image and Video Annotation. Proceedings of CVPR.
  9. Jeon, J., Lavrenko, V., and Manmatha, R. (2003). Automatic Image Annotation and Retrieval using Cross-Media Relevance Models. Proceedings of ACM SIGIR.
  10. Jin, W., Shi, R., and Chua, T. -S. (2004). A Semi-Naïve Bayesian Method Incorporating Clustering with PairWise Constraints for Auto Image Annotation. Proceedings of ACMMM.
  11. Lavrenko, V. and Croft, W. (2001). Relevance-Based Language Models. Proceedings of ACM SIGIR.
  12. Mori, Y., Takahashi, H., and Oka R., (1999). Image-toword transformation based on dividing and vector quantizing images with words. Proceedings of First International Workshop on Multimedia Intelligent Storage and Retrieval Management.
  13. Rui, Y., Huang, T. S., Ortega, M., and Mehrotra, S. (1998). Relevance Feedback: A Power Tool for Interactive Content-Based Image Retrieval. IEEE Transactions on Circuits and Systems for Video Technology, vol. 8(5): 644-655.
  14. Srikanth, M., Varner, J., Bowden, M., and Moldovan, D. (2005). Exploiting Ontologies for Automatic Image Annotation. Proceedings of ACM SIGIR.
  15. Zhu, X. (2005). Semi-Supervised Learning with Graphs. Ph.D. Thesis, CMU.
Download


Paper Citation


in Harvard Style

Chiang C., Hung M., Hung Y. and Kheng Leow W. (2008). IMAGE ANNOTATION WITH RELEVANCE FEEDBACK USING A SEMI-SUPERVISED AND HIERARCHICAL APPROACH . In Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008) ISBN 978-989-8111-21-0, pages 173-178. DOI: 10.5220/0001082001730178


in Bibtex Style

@conference{visapp08,
author={Cheng-Chieh Chiang and Ming-Wei Hung and Yi-Ping Hung and Wee Kheng Leow},
title={IMAGE ANNOTATION WITH RELEVANCE FEEDBACK USING A SEMI-SUPERVISED AND HIERARCHICAL APPROACH},
booktitle={Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)},
year={2008},
pages={173-178},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001082001730178},
isbn={978-989-8111-21-0},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Third International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2008)
TI - IMAGE ANNOTATION WITH RELEVANCE FEEDBACK USING A SEMI-SUPERVISED AND HIERARCHICAL APPROACH
SN - 978-989-8111-21-0
AU - Chiang C.
AU - Hung M.
AU - Hung Y.
AU - Kheng Leow W.
PY - 2008
SP - 173
EP - 178
DO - 10.5220/0001082001730178