Using Neighborhood Pre-computation to Increase Recommendation Efficiency

Vreixo Formoso, Diego Fernández, Fidel Cacheda, Victor Carneiro

Abstract

Collaborative filtering is a very popular recommendation technique. Among the different approaches, the k- Nearest Neighbors algorithm stands out by its simplicity, and its good and explainable results. This algorithm bases its recommendations to a given user on the opinions of similar users. Thus, selecting those similar users is an important step in the recommendation, known as neighborhood selection. In real applications with millions of users and items, this step can be a serious performance bottleneck because of the huge number of operations needed. In this paper we study the possibility of pre-computing the neighbors in an offline step, in order to increase recommendation efficiency. We show how neighborhood pre-computation reduces the recommendation time by two orders of magnitude without a significant impact in recommendation precision.

References

  1. Badue, C. S., Baeza-Yates, R., Ribeiro-Neto, B., Ziviani, A., and Ziviani, N. (2007). Analyzing imbalance among homogeneous index servers in a web search system. Inf. Process. Manage., 43:592-608.
  2. Bennett, J. and Lanning, S. (2007). The netflix prize. In KDDCup 7807: Proceedings of KDD Cup and Workshop, page 4, San Jose, California, USA. ACM.
  3. Cacheda, F., Carneiro, V., Fernández, D., and Formoso, V. (2011). Comparison of collaborative filtering algorithms: Limitations of current techniques and proposals for scalable, high-performance recommender systems. ACM Trans. Web, 5:2:1-2:33.
  4. Cöster, R. and Svensson, M. (2002). Inverted file search algorithms for collaborative filtering. In SIGIR 7802: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pages 246-252, New York, NY, USA. ACM.
  5. Desrosiers, C. and Karypis, G. (2011). A comprehensive survey of neighborhood-based recommendation methods. In Ricci, F., Rokach, L., Shapira, B., and Kantor, P. B., editors, Recommender Systems Handbook, pages 107-144. Springer.
Download


Paper Citation


in Harvard Style

Formoso V., Fernández D., Cacheda F. and Carneiro V. (2012). Using Neighborhood Pre-computation to Increase Recommendation Efficiency . In Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012) ISBN 978-989-8565-29-7, pages 333-335. DOI: 10.5220/0004139703330335


in Bibtex Style

@conference{kdir12,
author={Vreixo Formoso and Diego Fernández and Fidel Cacheda and Victor Carneiro},
title={Using Neighborhood Pre-computation to Increase Recommendation Efficiency},
booktitle={Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)},
year={2012},
pages={333-335},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004139703330335},
isbn={978-989-8565-29-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Knowledge Discovery and Information Retrieval - Volume 1: KDIR, (IC3K 2012)
TI - Using Neighborhood Pre-computation to Increase Recommendation Efficiency
SN - 978-989-8565-29-7
AU - Formoso V.
AU - Fernández D.
AU - Cacheda F.
AU - Carneiro V.
PY - 2012
SP - 333
EP - 335
DO - 10.5220/0004139703330335