Enhancing Query Expansion for Tag-based Social Image Retrieval

Amel Ksibi, Anis Ben Ammar, Chokri Ben Amar


Recently, extensive research efforts have been dedicated to tag-based social image search which enables users to formulate their queries using tags. However, tag queries are often ambiguous and typically short yielding to retrieve irrelevant images in top ranked list. To overcome this problem, an effective strategy is to produce diverse images in top ranking list covering various aspects of the query. In this context, we propose a Multi-view Concept-based Query Expansion (MVCQE) process, using a predefined list of semantic concepts and following three main steps. First, we harvest social knowledge to capture different contexts related to the query. Second, we perform a Multi-view Concepts weighting by applying concept-based query expansion for the initial query and for each of its contexts. Third, we select the most representative concepts using an adaptive threshold with respect to the dispersion of concept weights. Experiments using ambiguous queries over the NUS-WIDE dataset confirm the effectiveness of our process to improve the diversification compared to well known query expansion approaches . . .


  1. Feki, G., Ksibi, A., Ammar, A. B., Amar, C. B.: Regimvid at imageclef2012: Improving diversity in personal photo ranking using fuzzy logic. In: ImageCLEF12 (2012)
  2. Hoque, E., Hoeber, O., Gong, M.: Balancing the trade-offs between diversity and precision for web image search using concept-based query expansion. Journal of Emerging Technologies in Web Intelligence 4(1) (2012)
  3. Jin, S., Lin, H., Su, S.: Query expansion based on folksonomy tag co-occurrence analysis. In: Granular Computing, 2009, GRC 7809. IEEE International Conference on, pp. 300-305 (2009). DOI 10.1109/GRC.2009.5255110
  4. Kato, M., Ohshima, H., Oyama, S., Tanaka, K.: Can social tagging improve web image search? In: Web Information Systems Engineering-WISE 2008, pp. 235-249. Springer (2008)
  5. Ksibi, A., Ammar, A. B., Amar, C. B.: Effective concept detection using second order cooccurence flickr context similarity measure socfcs. In: CBMI, pp. 1-6 (2012)
  6. Ksibi, A., Dammak, M., Ben Ammar, A., Mejdoub, M., Ben Amar, C.: Flickr-based semantic context to refine automatic photo annotation. In: Image Processing Theory, Tools and Applications (IPTA), 2012 3rd International Conference on, pp. 377-382. IEEE (2012)
  7. Ksibi, A., Elleuch, N., Ammar, A. B., Alimi, A. M.: Semi-automatic soft collaborative annotation for semantic video indexing. In: EUROCON, pp. 1-6. IEEE (2011)
  8. Myoupo, D., Popescu, A., Borgne, H., Mollic, P. A.: Multimodal Image Retrieval over a Large Database, Lecture Notes in Computer Science, vol. 6242. Springer Berlin Heidelberg (2010)
  9. Roohullah, Jaafar, J.: Exploiting the query expansion through knowledgebases for images. In: H. Zaman, P. Robinson, M. Petrou, P. Olivier, T. Shih, S. Velastin, I. Nystrm (eds.) Visual Informatics: Sustaining Research and Innovations, Lecture Notes in Computer Science, vol. 7067, pp. 93-103. Springer Berlin Heidelberg (2011)
  10. Santos, R. L., Macdonald, C., Ounis, I.: Exploiting query reformulations for web search result diversification. In: Proceedings of the 19th international conference on World wide web, WWW 7810, pp. 881-890. ACM, New York, NY, USA (2010)
  11. Sun, A., Bhowmick, S. S., Nguyen, K. T. N., Bai, G.: Tag-based social image retrieval: An empirical evaluation. JASIST 62(12), 2364-2381 (2011)
  12. Tang, X., Liu, K., Cui, J., Wen, F., Wang, X.: Intentsearch: Capturing user intention for oneclick internet image search. IEEE Trans. on Pattern Analysis and Machine Intelligence 34(7), 1342-1353 (2012)
  13. Wei, X. Y., Ngo, C. W., Jiang, Y. G.: Selection of concept detectors for video search by ontology-enriched semantic spaces. Multimedia, IEEE Transactions on 10(6), 1085-1096 (2008)
  14. Weinberger, K. Q., Slaney, M., Van Zwol, R.: Resolving tag ambiguity. In: Proceedings of the 16th ACM international conference on Multimedia, pp. 111-120. ACM (2008)

Paper Citation

in Harvard Style

Ksibi A., Ben Ammar A. and Ben Amar C. (2013). Enhancing Query Expansion for Tag-based Social Image Retrieval . In Proceedings of the 2nd International Workshop on Web Intelligence - Volume 1: WEBI, (ICEIS 2013) ISBN 978-989-8565-63-1, pages 42-51. DOI: 10.5220/0004603500420051

in Bibtex Style

author={Amel Ksibi and Anis Ben Ammar and Chokri Ben Amar},
title={Enhancing Query Expansion for Tag-based Social Image Retrieval},
booktitle={Proceedings of the 2nd International Workshop on Web Intelligence - Volume 1: WEBI, (ICEIS 2013)},

in EndNote Style

JO - Proceedings of the 2nd International Workshop on Web Intelligence - Volume 1: WEBI, (ICEIS 2013)
TI - Enhancing Query Expansion for Tag-based Social Image Retrieval
SN - 978-989-8565-63-1
AU - Ksibi A.
AU - Ben Ammar A.
AU - Ben Amar C.
PY - 2013
SP - 42
EP - 51
DO - 10.5220/0004603500420051