Authors:
Walter T. Nakamura
1
;
Leonardo C. Marques
1
;
Bruna Ferreira
2
;
Simone D. J. Barbosa
2
and
Tayana Conte
1
Affiliations:
1
Institute of Computing (IComp), Federal University of Amazonas, UFAM, Manaus, Brazil
;
2
Informatics Department, Pontifical Catholic University of Rio de Janeiro, PUC-Rio, Rio de Janeiro, Brazil
Keyword(s):
Usability, User eXperience, Usability Inspection, Usability Test, Evaluation Methods.
Abstract:
Companies are constantly striving to improve their products for satisfying customers. Evaluating the quality of these products concerning usability and User eXperience (UX) has become essential for obtaining an advantage over competing products. However, several evaluation methods exist, making it difficult to decide which to choose. This paper presents a comparison between usability inspection and testing methods and a UX evaluation. We investigated the extent to which each method allows identifying usability problems with efficiency and effectiveness. We also investigated whether there is a difference in UX ratings between inspectors and users. To do so, we evaluated a Web platform designed for a government traffic department. Inspectors used TUXEL to evaluate the usability and UX of the platform, while usability testing moderators employed Concurrent Think-Aloud and User Experience Questionnaire with users. The inspection method outperformed usability testing regarding effectivene
ss and efficiency while addressing most major problems that occurred in usability testing, even when considering only the results from novice inspectors. Finally, the UX evaluation revealed contrasting results. While inspectors evaluated the platform as neutral, reflecting the problems they identified, users, by contrast, rated it very positively, in contradiction to the problems they had during the interaction.
(More)