Is Products Recommendation Good? An Experiment on User Satisfaction

Jaime Wojciechowski, Rafael Romualdo Wandresen, Rafaela Mantovani Fontana, João Eugênio Marynowski, Alexander Robert Kutzke


Recommendation systems may use different algorithms to present relevant information to users. In e-commerce contexts, these systems are essential to provide users with a customized experience. Several studies have evaluated different recommendation algorithms against their accuracy, but only a few evaluate algorithms from the user satisfaction viewpoint. We here present a study that aims to identify how different recommendation algorithms trigger different perceptions of satisfaction on users. Our research approach was an experiment using products and sales data from a real small retailer. Users expressed their satisfaction perception for three different algorithms. The study results show that the algorithms proposed did not trigger different perceptions of satisfaction on users, giving clues of improvements to small retailers websites.


  1. Apache (2016). Apache Mahout: Scalable Machine Learning and Data Mining.
  2. Attridge-Stirling, J. (2001). Thematic networks: an analytic tool for qualitative research. Qualitative Research, 1(3):385-405.
  3. Bobadilla, J., Ortega, F., Hernando, A., and Gutiérrez, A. (2013). Recommender systems survey. KnowledgeBased Systems, 46:109-132.
  4. Dabholkar, P. A. and Sheng, X. (2012). Consumer participation in using online recommendation agents: effects on satisfaction, trust, and purchase intentions. Service Industries Journal, 32(9):1433-1449.
  5. Herlocker, J., Konstan, J. A., Terveen, L. G., and Riedl, J. T. (2004). Evaluating collorative filtering recommender systems. ACM Transactions on Information Systems, 22(1):5-53.
  6. Isinkaye, F. O., Folajimi, Y. O., and Ojokoh, B. A. (2015). Recommendation systems : Principles , methods and evaluation. Egyptian Informatics Journal, pages 261- 273.
  7. Jiang, Y., Shang, J., and Liu, Y. (2010). Maximizing customer satisfaction through an online recommendation system: A novel associative classification model. Decision Support Systems, 48(3):470-479.
  8. Kaminskas, M., Bridge, D., Foping, F., and Roche, D. (2015). Product recommendation for small-scale retailers. Lecture Notes in Business Information Processing, 239:17-29.
  9. Knijnenburg, B. P., Willemsen, M. C., Gantner, Z., Soncu, H., and Newell, C. (2012). Explaining the user experience of recommender systems. pages 441-504.
  10. Konstan, J. and Riedl, J. (2012). Recommender systems: From algorithms to user experience. User Modeling and User-Adapted Interaction, 22:101-123.
  11. Lemire, D. and Maclachlan, A. (2005). Slope One Predictors for Online Rating-Based Collaborative Filtering. Society for Industrial and Applied Mathematics, pages 471-475.
  12. Li, S. S. and Karahanna, E. (2015). On line Recommendation Systems in a B2C E-Commerce Context : A Review and Future Directions . Journal of the Association for Information Systems, 16(2):72-107.
  13. Liang, T.-P., Lai, H.-J., and Ku, Y.-C. (2006). Personalized Content Recommendation and User Satisfaction: Theoretical Synthesis and Empirical Findings. Journal of Management Information Systems, 23(3):45-70.
  14. Montgomery, D. C. (2009). Design and Analysis of Experiments. John Wiley and Sons Inc., New Jersey, 7th edition.
  15. Pazzani, M. J. and Billsus, D. (2007). Content-Based Recommendation Systems. The Adaptive Web, 4321:325- 341.
  16. Schafer, J., Frankowski, D., Herlocker, J., and Sen, S. (2007). Collaborative Filtering Recommender Systems. The Adaptive Web, pages 291-324.
  17. Srinivasan, S. S., Anderson, R., and Ponnavolu, K. (2002). Customer loyalty in e-commerce: An exploration of its antecedents and consequences. Journal of Retailing, 78(1):41-50.
  18. Thongpapanl, N. and Ashraf, A. R. (2011). Enhancing online performance through website content and personalization. Journal of Computer Information Systems, Fall 2011:3-13.
  19. Xiao, B. and Benbasat, I. (2007). E-Commerce Product Recommendation agents :Use, Characteristics, and Impact. MIS Quarterly, 31(1):137-209.

Paper Citation

in Harvard Style

Wojciechowski J., Wandresen R., Mantovani Fontana R., Marynowski J. and Robert Kutzke A. (2017). Is Products Recommendation Good? An Experiment on User Satisfaction . In Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-248-6, pages 713-720. DOI: 10.5220/0006316307130720

in Bibtex Style

author={Jaime Wojciechowski and Rafael Romualdo Wandresen and Rafaela Mantovani Fontana and João Eugênio Marynowski and Alexander Robert Kutzke},
title={Is Products Recommendation Good? An Experiment on User Satisfaction},
booktitle={Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,},

in EndNote Style

JO - Proceedings of the 19th International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - Is Products Recommendation Good? An Experiment on User Satisfaction
SN - 978-989-758-248-6
AU - Wojciechowski J.
AU - Wandresen R.
AU - Mantovani Fontana R.
AU - Marynowski J.
AU - Robert Kutzke A.
PY - 2017
SP - 713
EP - 720
DO - 10.5220/0006316307130720