Fully Automatic Saliency-based Subjects Extraction in Digital Images

Luca Greco, Marco La Cascia, Francesco Lo Cascio

Abstract

In this paper we present a novel saliency-based technique for the automatic extraction of relevant subjects in digital images. We use enhanced saliency maps to determine the most relevant parts of the images and an image cropping technique on the map itself to extract one or more relevant subjects. The contribution of the paper is two-fold as we propose a technique to enhance the standard GBVS saliency map and a technique to extract the most salient parts of the image. The GBVS saliency map is enhanced by applying three filters particularly designed to optimize the performance for the task of relevant subjects extraction. The extraction of relevant subjects is demonstrated on a manually annotated dataset and results are encouraging. A variation of the same technique has also been used to extract the most significant region of an image. This region can then be used to obtain a thumbnail keeping most of the relevant information of the original image and discarding nonsignificant background. Experimental results are reported also in this case.

References

  1. Harel, J., Koch, C. and Perona, P., 2006. Graph-Based Visual Saliency. Proceedings of Neural Information Processing Systems (NIPS).
  2. Marchesotti, L., Cifarelli, C. and Csurka, G., 2009. A framework for visual saliency detection with applications to image thumbnailing. Xerox Research Centre Europe (XRCE), France
  3. Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W., 2003. Automatic Thumbnail Cropping and its Effectiveness. Proceedings of the 16th annual ACM symposium on User interface software and technology
  4. Liu, L., Chen, R., Wolf, L., Cohen-Or, D., 2010. Optimizing Photo Composition. Computer Graphics Forum, vol. 29, n. 2 pp. 469-478, Wiley Online Library
  5. Zhang, M., Zhang, L., Sun, Y., Feng, L., Ma, W., 2005. Auto Cropping for Digital Photographs., IEEE International Conference on Multimedia and Expo, (ICME).
  6. Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X. and Shum, H.-Y., 2007. Learning to detect a salient object. IEEE Trans. Pattern Anal. Mach.
  7. Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X. and Hu, S.-M., 2011. Global contrast based salient region detection. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  8. Wang, L., Xue, J., Zheng, N. and Hua, G., 2011. Automatic salient object extraction with contextual cue. IEEE Conference on Computer Vision (ICCV).
  9. Alexe, B., Deselaers, T. and Ferrari, V., 2010. What is an object? IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  10. Feng, J.,Wei, Y., Tao, L., Zhang, C. and Sun, J., 2011. Salient object detection by composition. IEEE Conference on Computer Vision (ICCV).
  11. Huang, J., Yang, X., Zhang, R. and Fang, X., 2010. ReRanking Image Search Results by Multiscale Visual Saliency Model. IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB) .
  12. Itti, L., Koch, C. and Niebur, E., 1998, A model of saliency-based visual attention for rapid scene analysis. IEEE Transaction on Pattern Analysis and Machine Intelligence, vol. 20 n. 11 pp. 1254-1259.
  13. Samadani, R., Lim, S. H. and Tretter, D., 2007. Representative image thumbnails for good browsing. IEEE International Conference on Image Processing (ICIP).
  14. Avidan, S. and Shamir, A., 2007. Seam carving for content-aware image resizing. ACM Transaction on Graphics.
  15. Simakov, D., Caspi, Y., Shechtman, E. and Irani, M., 2008. Summarizing visual data using bidirectional similarity. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  16. Liu, F. and Gleicher, M., 2005. Automatic image retargeting with fisheye-view warping. ACM symposium on User interface software and technology (UIST).
  17. Rother, C., Kumar, S., Kolmogorov, V. and Blake, A., 2005. Digital tapestry. IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
  18. Wang, P., Wang, J., Zeng, G., Feng, J., Zha, H. and Li, S., 2012. Salient Object Detection for Searched Web Images via Global Saliency IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
Download


Paper Citation


in Harvard Style

Greco L., La Cascia M. and Lo Cascio F. (2013). Fully Automatic Saliency-based Subjects Extraction in Digital Images . In Proceedings of the 10th International Conference on Signal Processing and Multimedia Applications and 10th International Conference on Wireless Information Networks and Systems - Volume 1: SIGMAP, (ICETE 2013) ISBN 978-989-8565-74-7, pages 129-136. DOI: 10.5220/0004530401290136


in Bibtex Style

@conference{sigmap13,
author={Luca Greco and Marco La Cascia and Francesco Lo Cascio},
title={Fully Automatic Saliency-based Subjects Extraction in Digital Images},
booktitle={Proceedings of the 10th International Conference on Signal Processing and Multimedia Applications and 10th International Conference on Wireless Information Networks and Systems - Volume 1: SIGMAP, (ICETE 2013)},
year={2013},
pages={129-136},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004530401290136},
isbn={978-989-8565-74-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Signal Processing and Multimedia Applications and 10th International Conference on Wireless Information Networks and Systems - Volume 1: SIGMAP, (ICETE 2013)
TI - Fully Automatic Saliency-based Subjects Extraction in Digital Images
SN - 978-989-8565-74-7
AU - Greco L.
AU - La Cascia M.
AU - Lo Cascio F.
PY - 2013
SP - 129
EP - 136
DO - 10.5220/0004530401290136