Image Retrieval with Reciprocal and Shared Nearest Neighbors

Agni Delvinioti, Hervé Jégou, Laurent Amsaleg, Michael Houle

2014

Abstract

Content-based image retrieval systems typically rely on a similarity measure between image vector representations, such as in bag-of-words, to rank the database images in decreasing order of expected relevance to the query. However, the inherent asymmetry of k-nearest neighborhoods is not properly accounted for by traditional similarity measures, possibly leading to a loss of retrieval accuracy. This paper addresses this issue by proposing similarity measures that use neighborhood information to assess the relationship between images. First, we extend previous work on k-reciprocal nearest neighbors to produce new measures that improve over the original primary metric. Second, we propose measures defined on sets of shared nearest neighbors for reranking the shortlist. Both these methods are simple, yet they significantly improve the accuracy of image search engines on standard benchmark datasets.

References

  1. Fischler, M. A. and Bolles, R. C. (1981). Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM, 24(6).
  2. Hamzaoui, A., Letessier, P., Joly, A., Buisson, O., and Boujemaa, N. (2013). Object-based visual query suggestion. Multimedia Tools and Applications.
  3. Houle, M. E. (2008). The relevant-set correlation model for data clustering. Statistical Analysis and Data Mining, 1(3).
  4. Houle, M. E., Kriegel, H. P., Kröger, P., Schubert, E., and Zimek, A. (2010). Can shared-neighbor distances defeat the curse of dimensionality? In Scientific and Statistical Database Management.
  5. Jégou, H., Douze, M., and Schmid, C. (2008). Hamming embedding and weak geometric consistency for large scale image search. In ECCV.
  6. Jégou, H., Douze, M., Schmid, C., and Pérez, P. (2010). Aggregating local descriptors into a compact image representation. In CVPR.
  7. Jégou, H., Harzallah, H., and Schmid, C. (2007). A contextual dissimilarity measure for accurate and efficient image search. In CVPR.
  8. Lowe, D. G. (2004). Distinctive image features from scaleinvariant keypoints. International journal of computer vision, 60(2).
  9. Nister, D. and Stewenius, H. (2006). Scalable recognition with a vocabulary tree. In CVPR.
  10. Perronnin, F., Liu, Y., Sánchez, J., and Poirier, H. (2010). Large-scale image retrieval with compressed fisher vectors. In CVPR.
  11. Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2007). Object retrieval with large vocabularies and fast spatial matching. In CVPR.
  12. Philbin, J., Chum, O., Isard, M., Sivic, J., and Zisserman, A. (2008). Lost in quantization: Improving particular object retrieval in large scale image databases. In CVPR.
  13. Qin, D., Gammeter, S., Bossard, L., Quack, T., and Gool, L. V. (2011). Hello neighbor: accurate object retrieval with k-reciprocal nearest neighbors. In CVPR.
  14. Sivic, J. and Zisserman, A. (2003). Video Google: A text retrieval approach to object matching in videos. In ICCV.
Download


Paper Citation


in Harvard Style

Delvinioti A., Jégou H., Amsaleg L. and Houle M. (2014). Image Retrieval with Reciprocal and Shared Nearest Neighbors . In Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014) ISBN 978-989-758-004-8, pages 321-328. DOI: 10.5220/0004672303210328


in Bibtex Style

@conference{visapp14,
author={Agni Delvinioti and Hervé Jégou and Laurent Amsaleg and Michael Houle},
title={Image Retrieval with Reciprocal and Shared Nearest Neighbors},
booktitle={Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)},
year={2014},
pages={321-328},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004672303210328},
isbn={978-989-758-004-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 9th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2014)
TI - Image Retrieval with Reciprocal and Shared Nearest Neighbors
SN - 978-989-758-004-8
AU - Delvinioti A.
AU - Jégou H.
AU - Amsaleg L.
AU - Houle M.
PY - 2014
SP - 321
EP - 328
DO - 10.5220/0004672303210328