Risk-based Comprehensive Usability Evaluation of Software as a Medical Device

Noemi Stuppia, Federico Sternini, Federico Sternini, Federica Miola, Giorgia Picci, Claudia Boarini, Federico Cabitza, Alice Ravizza

2022

Abstract

Introduction: Usability evaluation is a core aspect in risk assessment of medical devices, as it aims to ensure the device interface safety, avoiding that usability problems at interface level are not related to harm. Methods: Our research group applied our risk-based approach, international reference standards and guidelines to the usability evaluation of a large family of SaMD. The methodology used for the evaluation is an elaboration of regulatory prescriptions and is composed of a combination of quantitative and qualitative methods. In particular, the usability evaluation is structured in a two-stage evaluation composed by formative and summative evaluation. The formative stage is propaedeutic for the planning of the summative evaluation. The final assessment included the analysis of quantitative data collected through three questionnaires and a user test. Results and discussion: Risk-based task analysis led to the identification of the most common use error emerged during the user test performance. The three questionnaires led to different results: Heuristic analysis allowed the identification of violations to the heuristic principles as perceived by the users and their severity; SUS questionnaire provided an indicator of general device usability; the interview identified the usability problems of each device with respect to their functionalities. Conclusions: The study allowed the extensive assessment of the devices, the identification of usability issues, and the classification in terms of criticality of each issue. In conclusion the study led to different proposals to solve the issues and design changes.

Paper Citation

in Harvard Style

Stuppia N., Sternini F., Miola F., Picci G., Boarini C., Cabitza F. and Ravizza A. (2022). Risk-based Comprehensive Usability Evaluation of Software as a Medical Device. In Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2022) - Volume 5: HEALTHINF; ISBN 978-989-758-552-4, SciTePress, pages 454-462. DOI: 10.5220/0010825100003123

in Bibtex Style

@conference{healthinf22,
author={Noemi Stuppia and Federico Sternini and Federica Miola and Giorgia Picci and Claudia Boarini and Federico Cabitza and Alice Ravizza},
title={Risk-based Comprehensive Usability Evaluation of Software as a Medical Device},
booktitle={Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2022) - Volume 5: HEALTHINF},
year={2022},
pages={454-462},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010825100003123},
isbn={978-989-758-552-4},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 15th International Joint Conference on Biomedical Engineering Systems and Technologies (BIOSTEC 2022) - Volume 5: HEALTHINF
TI - Risk-based Comprehensive Usability Evaluation of Software as a Medical Device
SN - 978-989-758-552-4
AU - Stuppia N.
AU - Sternini F.
AU - Miola F.
AU - Picci G.
AU - Boarini C.
AU - Cabitza F.
AU - Ravizza A.
PY - 2022
SP - 454
EP - 462
DO - 10.5220/0010825100003123
PB - SciTePress