A Local Differential Privacy based Hybrid Recommendation Model with BERT and Matrix Factorization

Jeyamohan Neera, Xiaomin Chen, Nauman Aslam, Biju Issac, Eve O’Brien

2022

Abstract

Many works have proposed integrating sentiment analysis with collaborative filtering algorithms to improve the accuracy of recommendation systems. As a result, service providers collect both reviews and ratings, which is increasingly causing privacy concerns among users. Several works have used the Local Differential Privacy (LDP) based input perturbation mechanism to address privacy concerns related to the aggregation of ratings. However, researchers have failed to address whether perturbing just ratings can protect the privacy of users when both reviews and ratings are collected. We answer this question in this paper by applying an LDP based perturbation mechanism in a recommendation system that integrates collaborative filtering with a sentiment analysis model. On the user-side, we use the Bounded Laplace mechanism (BLP) as the input rating perturbation method and Bidirectional Encoder Representations from Transformers (BERT) to tokenize the reviews. At the service provider’s side, we use Matrix Factorization (MF) with Mixture of Gaussian (MoG) as our collaborative filtering algorithm and Convolutional Neural Network (CNN) as the sentiment classification model. We demonstrate that our proposed recommendation system model produces adequate recommendation accuracy under strong privacy protection using Amazon’s review and rating datasets.

Paper Citation

in Harvard Style

Neera J., Chen X., Aslam N., Issac B. and O’Brien E. (2022). A Local Differential Privacy based Hybrid Recommendation Model with BERT and Matrix Factorization. In Proceedings of the 19th International Conference on Security and Cryptography - Volume 1: SECRYPT, ISBN 978-989-758-590-6, pages 325-332. DOI: 10.5220/0011266800003283

in Bibtex Style

@conference{secrypt22,
author={Jeyamohan Neera and Xiaomin Chen and Nauman Aslam and Biju Issac and Eve O’Brien},
title={A Local Differential Privacy based Hybrid Recommendation Model with BERT and Matrix Factorization},
booktitle={Proceedings of the 19th International Conference on Security and Cryptography - Volume 1: SECRYPT,},
year={2022},
pages={325-332},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011266800003283},
isbn={978-989-758-590-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 19th International Conference on Security and Cryptography - Volume 1: SECRYPT,
TI - A Local Differential Privacy based Hybrid Recommendation Model with BERT and Matrix Factorization
SN - 978-989-758-590-6
AU - Neera J.
AU - Chen X.
AU - Aslam N.
AU - Issac B.
AU - O’Brien E.
PY - 2022
SP - 325
EP - 332
DO - 10.5220/0011266800003283