Saliency Detection in Images using Graph-based Rarity, Spatial Compactness and Background Prior

Sudeshna Roy, Sukhendu Das

2014

Abstract

Bottom-up saliency detection techniques extract salient regions in an image while free-viewing the image. We have approached the problem with three different low-level cues– graph based rarity, spatial compactness and background prior. First, the image is broken into similar colored patches, called superpixels. To measure rarity we represent the image as a graph with superpixels as node and exponential color difference as the edge weights between the nodes. Eigenvectors of the Laplacian of the graph are then used, similar to spectral clustering (Ng et al., 2001). Each superpixel is associated with a descriptor formed from these eigenvectors and rarity or uniqueness of the superpixels are found using these descriptors. Spatial compactness is computed by combining disparity in color and spatial distance between superpixels. Concept of background prior is implemented by finding the weighted Mahalanobis distance of the superpixels from the statistically modeled mean background color. These cues in combination gives the proposed saliency map. Experimental results demonstrate that our method outperforms many of the recent state-of-the-art methods both in terms of accuracy and speed.

References

  1. A feature-integration theory of attention. Cognitive Psychology, 12(1).
  2. Achanta, R., Hemami, S., Estrada, F., and Susstrunk, S. (2009). Frequency-tuned salient region detection. In CVPR.
  3. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., and Susstrunk, S. (2010). SLIC Superpixels. Technical report, EPFL.
  4. Arbelaez, P., Maire, M., Fowlkes, C., and Malik, J. (2011). Contour detection and hierarchical image segmentation. TPAMI, 33(5):898-916.
  5. Cheng, M.-M., Zhang, G.-X., Mitra, N. J., Huang, X., and Hu, S.-M. (2011). Global contrast based salient region detection. In CVPR.
  6. Dolson, J., Jongmin, B., Plagemann, C., and Thrun, S. (2010). Upsampling range data in dynamic environments. In CVPR.
  7. Goferman, S., Zelnik-manor, L., and A.Tal (2010). Contextaware saliency detection. In CVPR.
  8. Harel, J., Koch, C., and Perona, P. (2006). Graph-based visual saliency. In NIPS, pages 545-552.
  9. Hou, X., Harel, J., and Koch, C. (2012). Image signature: Highlighting sparse salient regions. TPAMI, 34(1).
  10. Hou, X. and Zhang, L. (2007). Saliency detection: A spectral residual approach. In CVPR, pages 1-8.
  11. Itti, L., Koch, C., and Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. TPAMI, 20(11).
  12. Jiang, H., Wang, J., Yuan, Z., Wu, Y., Zheng, N., and Li, S. (2013). Salient object detection: A discriminative regional feature integration approach. In CVPR.
  13. Koch, C. and Ullman, S. (1987). Shifts in selective visual attention: Towards the underlying neural circuitry. In Matters of Intelligence, volume 188. Springer Netherlands.
  14. Li, J., Levine, M. D., An, X., Xu, X., and He, H. (2013). Visual saliency based on scale-space analysis in the frequency domain. TPAMI, 35(4).
  15. Ng, A. Y., Jordan, M. I., and Weiss, Y. (2001). On spectral clustering: Analysis and an algorithm. In NIPS, pages 849-856.
  16. Perazzi, F., Krahenbuhl, P., Pritch, Y., and Hornung, A. (2012). Saliency filters: Contrast based filtering for salient region detection. In CVPR.
  17. Schauerte, B. and Rainer, S. (2012). Quaternion-based spectral saliency detection for eye fixation prediction. In ECCV, pages 116-129.
  18. Shi, J. and Malik, J. (2000). Normalized cuts and image segmentation. TPAMI, 22(8):888-905.
  19. Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14).
  20. Wei, Y., Wen, F., Zhu, W., and Sun, J. (2012). Geodesic saliency using background priors. In ECCV.
  21. Yang, C., Zhang, L., Lu, H., Ruan, X., and Yang, M.-H. (2013). Saliency detection via graph-based manifold ranking. In CVPR.
  22. Zhou, D., Weston, J., Gretton, A., Bousquet, O., and Schlkopf, B. (2004). Ranking on data manifolds. In NIPS.
Download


Paper Citation


in Harvard Style

Roy S. and Das S. (2014). Saliency Detection in Images using Graph-based Rarity, Spatial Compactness and Background Prior . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 523-530. DOI: 10.5220/0004693605230530


in Bibtex Style

@conference{visapp14,
author={Sudeshna Roy and Sukhendu Das},
title={Saliency Detection in Images using Graph-based Rarity, Spatial Compactness and Background Prior},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={523-530},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004693605230530},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Saliency Detection in Images using Graph-based Rarity, Spatial Compactness and Background Prior
SN - 978-989-758-003-1
AU - Roy S.
AU - Das S.
PY - 2014
SP - 523
EP - 530
DO - 10.5220/0004693605230530