Monte-Carlo Image Retargeting

Roberto Gallea, Edoardo Ardizzone, Roberto Pirrone

2014

Abstract

In this paper an efficient method for image retargeting is proposed. It relies on a monte-carlo model that makes use of image saliency. Each random sample is extracted from deformation probability mass function defined properly, and shrinks or enlarges the image by a fixed size. The shape of the function, determining which regions of the image are affected by the deformations, depends on the image saliency. High informative regions are less likely to be chosen, while low saliency regions are more probable. Such a model does not require any optimization, since its solution is obtained by extracting repeatedly random samples, and allows real-time application even for large images. Computation time can be additionally improved using a parallel implementation. The approach is fully automatic, though it can be improved by providing interactively cues such as geometric constraints and/or automatic or manual labeling of relevant objects. The results prove that the presented method achieves results comparable or superior to reference methods, while improving efficiency.

References

  1. (2007). NVIDIA CUDA Compute Unified Device Architecture - Programming Guide.
  2. Avidan, S. and Shamir, A. (2007). Seam carving for content-aware image resizing. ACM Trans. Graph., 26(3):10.
  3. Dalal, N. and Triggs, B. (2005). Histograms of oriented gradients for human detection. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, volume 1, pages 886 - 893 vol. 1.
  4. Harris, C. and Stephens, M. (1988). A combined corner and edge detection. In Proceedings of The Fourth Alvey Vision Conference, pages 147-151.
  5. Hou, X., Harel, J., and Koch, C. (2012). Image signature: Highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell., 34(1):194-201.
  6. Itti, L., Koch, C., and Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20:1254-1259.
  7. Liu, C., Yuen, J., Torralba, A., Sivic, J., and Freeman, W. T. (2008). SIFT Flow: dense correspondence across different scenes. In ECCV.
  8. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. Int. J. Comput. Vision, 60(2):91- 110.
  9. Pele, O. and Werman, M. (2009). Fast and robust earth mover's distances. In ICCV.
  10. Rubinstein, M., Gutierrez, D., Sorkine, O., and Shamir, A. (2010). A comparative study of image retargeting. ACM Transactions on Graphics (Proc. SIGGRAPH Asia), 29(5).
  11. Rubinstein, M., Shamir, A., and Avidan, S. (2008). Improved seam carving for video retargeting. ACM Trans. Graph., 27(3):1-9.
  12. Rubinstein, M., Shamir, A., and Avidan, S. (2009). Multioperator media retargeting. ACM Transactions on Graphics (Proceedings SIGGRAPH 2009), 28(3):1- 11.
  13. Santella, A., Agrawala, M., Decarlo, D., Salesin, D., and Cohen, M. (2006). Gaze-based interaction for semiautomatic photo cropping. In In CHI 2006, pages 771-780.
  14. Suh, B., Ling, H., Bederson, B. B., and Jacobs, D. W. (2003). Automatic thumbnail cropping and its effectiveness. In UIST 7803: Proceedings of the 16th annual ACM symposium on User interface software and technology, pages 95-104, New York, NY, USA. ACM.
  15. Viola, P. and Jones, M. (2001). Robust real-time object detection. In International Journal of Computer Vision.
  16. Wang, Z., Bovik, A. C., Sheikh, H. R., Member, S., and Simoncelli, E. P. (2004). Image quality assessment: From error measurement to structural similarity. IEEE Trans. Image Processing, 13:600-612.
  17. Wolf, L., Guttmann, M., and Cohen-Or, D. (2007). Nonhomogeneous content-driven video-retargeting. In Proceedings of the Eleventh IEEE International Conference on Computer Vision (ICCV-07).
  18. Yu-Shuen Wang, Chiew-Lan Tai, O. S. and Lee, T.-Y. (2008). Optimized scale-and-stretch for image resizing. ACM Trans. Graph. (Proceedings of ACM SIGGRAPH ASIA, 27(5).
Download


Paper Citation


in Harvard Style

Gallea R., Ardizzone E. and Pirrone R. (2014). Monte-Carlo Image Retargeting . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-003-1, pages 402-408. DOI: 10.5220/0004744404020408


in Bibtex Style

@conference{visapp14,
author={Roberto Gallea and Edoardo Ardizzone and Roberto Pirrone},
title={Monte-Carlo Image Retargeting},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={402-408},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004744404020408},
isbn={978-989-758-003-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2014)
TI - Monte-Carlo Image Retargeting
SN - 978-989-758-003-1
AU - Gallea R.
AU - Ardizzone E.
AU - Pirrone R.
PY - 2014
SP - 402
EP - 408
DO - 10.5220/0004744404020408