Evaluating the Effect of Justification and Confidence Information on User Perception of a Privacy Policy Summarization Tool

Vanessa Bracamonte, Seira Hidano, Welderufael Tesfay, Shinsaku Kiyomoto

2020

Abstract

Privacy policies are long and cumbersome for users to read. To support understanding of the information contained in privacy policies, automated analysis of textual data can be used to obtain a summary of their content, which can then be presented in a shorter, more usable format. However, these tools are not perfect and users indicate concern about the trustworthiness of their results. Although some of these tools provide information about their performance, the effect if this information has not been investigated. In order to address this, we conducted an experimental study to evaluate whether providing explanatory information such as result confidence and justification influences users’s understanding of the privacy policy content and perception of the tool. The results suggest that presenting a justification of the results, in the form of a policy fragment, can increase intention to use the tool and improve perception of trustworthiness and usefulness. On the other hand, showing only a result confidence percentage did not improve perception of the tool, nor did it help to communicate the possibility of incorrect results. We discuss these results and their implications for the design of privacy policy summarization tools.

Paper Citation

in Harvard Style

Bracamonte V., Hidano S., Tesfay W. and Kiyomoto S. (2020). Evaluating the Effect of Justification and Confidence Information on User Perception of a Privacy Policy Summarization Tool. In Proceedings of the 6th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP, ISBN 978-989-758-399-5, pages 142-151. DOI: 10.5220/0008986101420151

in Bibtex Style

@conference{icissp20,
author={Vanessa Bracamonte and Seira Hidano and Welderufael Tesfay and Shinsaku Kiyomoto},
title={Evaluating the Effect of Justification and Confidence Information on User Perception of a Privacy Policy Summarization Tool},
booktitle={Proceedings of the 6th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP,},
year={2020},
pages={142-151},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0008986101420151},
isbn={978-989-758-399-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 6th International Conference on Information Systems Security and Privacy - Volume 1: ICISSP,
TI - Evaluating the Effect of Justification and Confidence Information on User Perception of a Privacy Policy Summarization Tool
SN - 978-989-758-399-5
AU - Bracamonte V.
AU - Hidano S.
AU - Tesfay W.
AU - Kiyomoto S.
PY - 2020
SP - 142
EP - 151
DO - 10.5220/0008986101420151