To Inspect or to Test? What Approach Provides Better Results When It Comes to Usability and UX?

Walter Nakamura, Leonardo Marques, Bruna Ferreira, Simone Barbosa, Tayana Conte

2020

Abstract

Companies are constantly striving to improve their products for satisfying customers. Evaluating the quality of these products concerning usability and User eXperience (UX) has become essential for obtaining an advantage over competing products. However, several evaluation methods exist, making it difficult to decide which to choose. This paper presents a comparison between usability inspection and testing methods and a UX evaluation. We investigated the extent to which each method allows identifying usability problems with efficiency and effectiveness. We also investigated whether there is a difference in UX ratings between inspectors and users. To do so, we evaluated a Web platform designed for a government traffic department. Inspectors used TUXEL to evaluate the usability and UX of the platform, while usability testing moderators employed Concurrent Think-Aloud and User Experience Questionnaire with users. The inspection method outperformed usability testing regarding effectiveness and efficiency while addressing most major problems that occurred in usability testing, even when considering only the results from novice inspectors. Finally, the UX evaluation revealed contrasting results. While inspectors evaluated the platform as neutral, reflecting the problems they identified, users, by contrast, rated it very positively, in contradiction to the problems they had during the interaction.

Paper Citation

in Harvard Style

Nakamura W., Marques L., Ferreira B., Barbosa S. and Conte T. (2020). To Inspect or to Test? What Approach Provides Better Results When It Comes to Usability and UX?.In Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS, ISBN 978-989-758-423-7, pages 487-498. DOI: 10.5220/0009367904870498

in Bibtex Style

@conference{iceis20,
author={Walter Nakamura and Leonardo Marques and Bruna Ferreira and Simone Barbosa and Tayana Conte},
title={To Inspect or to Test? What Approach Provides Better Results When It Comes to Usability and UX?},
booktitle={Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS,},
year={2020},
pages={487-498},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0009367904870498},
isbn={978-989-758-423-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 22nd International Conference on Enterprise Information Systems - Volume 2: ICEIS,
TI - To Inspect or to Test? What Approach Provides Better Results When It Comes to Usability and UX?
SN - 978-989-758-423-7
AU - Nakamura W.
AU - Marques L.
AU - Ferreira B.
AU - Barbosa S.
AU - Conte T.
PY - 2020
SP - 487
EP - 498
DO - 10.5220/0009367904870498