Adapted SIFT Descriptor for Improved Near Duplicate Retrieval

Afra'a Ahmad Alyosef, Andreas Nürnberger

2016

Abstract

The scale invariant feature transformation algorithm (SIFT) has been designed to detect and characterize local features in images. It is widely used to find similar regions in affine transformed images, to recognize similar objects or to retrieve near-duplicates of images. Due to the computational complexity of SIFT based matching operations several approaches have been proposed to speed up this process. However, most approaches lack significant decrease of matching accuracy compared to the original descriptor. We propose an approach that is optimized for near-duplicate image retrieval tasks by a dimensionality reduction process that differs from other methods by preserving the information around the keypoints of any region patches of the original descriptor. The computation of the proposed Region Compressed (RC) SIFT−64D descriptors is therefore faster and requires less memory for indexing. Most important, the obtained features show at the same time a better retrieval performance and seem to be even more robust. In order to prove this, we provide results of a comparative performance analysis using the original SIFT−128D, reduced SIFT versions, SURF−64D and the proposed RC-SIFT−64D in image near-duplicate retrieval using large scale image benchmark databases.

References

  1. Auclair, A., Vincent, N., and Cohen, L. (2006). Hash functions for near duplicate image retrieval. In Applications of Computer Vision (WACV), pages 7-8.
  2. Beecks, C. and Seidl, T. (2009). Visual exploration of large multimedia databases. In Data Management and Visual Analytics Workshop.
  3. Chu, L., Jiang, S., Wang, S., Zhang, Y., and Huang, Q. (2013). Robust spatial consistency graph model for partial duplicate image retrieval. In Multimedia, IEEE Transactions on, pages 1982-1996.
  4. Chum, O., Philbin, J., Isard, M., and Zisserman, A. (2007). Scalable near identical image and shot detection. In Proc. CIVR.
  5. Chum, O., Philbin, J., and Zisserman, A. (2008). Near duplicate image detection: min-hash and tf-idf weighting. In British Machine Vision Conference.
  6. Grauman, K. and Darrell, T. (2005). Pyramid match kernels: Discriminative classification with sets of image features. In Proc. ICCV.
  7. Grauman, K. and Darrell, T. (2007). The pyramid match kernel: Efficient learning with sets of features. In The Journal of Machine Learning Research, pages 725- 760.
  8. Jègou, H., Douze, M., Schmid, C., and Pèrez, P. (2010). Aggregating local descriptors into a compact image representation. In Proc. IEEE Conf. Computer Vision and Pattern Recognition.
  9. Jiang, M., Zhang, S., Li, H., and Metaxas, D. N. (2015). Computer-aided diagnosis of mammographic masses using scalable image retrieval. In Biomedical Engineering, IEEE Transactions on, pages 783-792.
  10. Ke, Y. and Sukthankar, R. (2004). Pca-sift: A more distinctive representation for local image descriptors. In in: CVPR, issue 2, page 506513.
  11. Khan, N., McCane, B., and Wyvill, G. (2011). Sift and surf performance evaluation against various image deformations on benchmark dataset. In Digital Image Computing Techniques and Applications (DICTA).
  12. Li, J., Qian, X., Li, Q., Zhao, Y., Wang, L., and Tang, Y. Y. (2014). Mining near duplicate image groups. In Springer Science and Business Media New York.
  13. Low, T., Hentschel, C., Stober, S., Sack, H., and Nürnberger, A. (2014). Visual berrypicking in large image collections. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: fun, fast, foundational, pages 1043-1046. New York, NY : ACM.
  14. Lowe, D. (2004). Distinctive image features from scaleinvariant keypoints. In Journal of Computer Vision, pages 91-110.
  15. Nistèr, D. and Stewènius, H. (2006). Scalable recognition with a vocabulary tree. In CVPR, pages 2161-2168.
  16. Steffen, J., Christian, H., Alyosef, A. A., Tönnies, K., and Nürnberger, A. (2012). Rotational invariance at fixation points - experiments using human gaze data. In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods, pages 451-456.
  17. Steinbach, M., Ertoz, L., and Kumar (2003). The challenges of clustering high dimensional data. In Wille LT, editor. New Vistas in Statistical Physics-Applications in Econophysics, Bioinformatics, and Pattern Recognition. Springer-Verlag.
  18. Xu, D., Cham, T., Yan, S., Duan, L., and Chang, S. (2010). Near duplicate identification with spatially aligned pyramid matching. In IEEE Trans. Circuits and Systems for Video Technology, pages 1068-1079.
  19. Yang, Y. and Newsam, S. (2008). Comparing sift descriptors and gabor texture features for classification of remote sensed imagery. In Proceedings of the 15th IEEE on Image Processing, San Diego, pages 1852-1855. USA.
  20. Zhang, C., Wang, S., Huang, Q., Liu, J., Liang, C., and Tian, Q. (2013). Image classification using spatial pyramid robust sparse coding. In Pattern Recognition letters, pages 1046-1052.
  21. Zhang, D. Q. and et al. (2004). Detecting image near-duplicate by stochastic attribute relational graph matching with learning. In Proceedings of the 12th annual ACM international conference on Multimedia.
Download


Paper Citation


in Harvard Style

Alyosef A. and Nürnberger A. (2016). Adapted SIFT Descriptor for Improved Near Duplicate Retrieval . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 55-64. DOI: 10.5220/0005694800550064


in Bibtex Style

@conference{icpram16,
author={Afra'a Ahmad Alyosef and Andreas Nürnberger},
title={Adapted SIFT Descriptor for Improved Near Duplicate Retrieval},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={55-64},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005694800550064},
isbn={978-989-758-173-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Adapted SIFT Descriptor for Improved Near Duplicate Retrieval
SN - 978-989-758-173-1
AU - Alyosef A.
AU - Nürnberger A.
PY - 2016
SP - 55
EP - 64
DO - 10.5220/0005694800550064