Authors:
Tim Polzehl
1
;
2
;
Yuexin Cao
2
;
Vicente Ivan Sanchez Carmona
3
;
Xiaoyi Liu
3
;
Changjian Hu
3
;
Neslihan Iskender
2
;
André Beyer
4
and
Sebastian Möller
1
;
2
Affiliations:
1
German Research Center for Artificial Intelligence, Berlin, Germany
;
2
Technische Universität Berlin, Berlin, Germany
;
3
Lenovo Research AI Lab, Beijing, China
;
4
Crowdee GmbH, Berlin, Germany
Keyword(s):
User Experience, Chatbot, Personalization, User Modeling, Information Savviness.
Abstract:
Information savviness describes the ability to find, evaluate and reflect information online. Customers with high information savviness are more likely to look up product information online, read customer reviews before making a purchase decision. By assessing Information Savviness from chatbot interactions in a technical customer service domain, we analyze its impact on user experience (UX), expectations and preferences of the users in order to determine assessable personalization targets that acts dedicatedly on UX. To find out which UX factors can be assessed reliably, we conduct an assessment study through a set of scenario-based tasks using a crowd-sourcing set-up and analyze UX factors. We reveal significant differences in users’ UX expectations with respect to a series of UX factors like acceptability, task efficiency, system error, ease of use, naturalness, personality and promoter score. Our results strongly suggest a potential application for essential personalization and u
ser adaptation strategies utilizing information savviness for the personalization of technical customer support chatbots.
(More)