Integrating Rigorous Qualitative Methods into the Design and Evaluation of Safety-Critical Systems

Romane Dubus, Romane Dubus, Anke Brock, Wendy Mackay

2024

Abstract

Traditional aviation research includes quantitative or qualitative studies of pilots’ behavior and cognition, followed by quantitative evaluations of current and novel system designs. However, qualitative and quantitative methods are rarely combined, making it difficult to link pilot behavior to specific design implications. This paper discusses how aviation researchers can benefit from a mixed-method approach that explicitly includes rigorous qualitative methods into the process of designing and evaluating safety-critical systems. We describe our use of the comparative structured observation method, where pilots perform at least two directly comparable realistic tasks using selected design variants, and are then asked to reflect deeply on the advantages and disadvantages associated with each. The goal is to obtain a more nuanced understanding of specific design trade-offs from the pilot’s perspective.

Paper Citation

in Harvard Style

Dubus R., Brock A. and Mackay W. (2024). Integrating Rigorous Qualitative Methods into the Design and Evaluation of Safety-Critical Systems. In Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS; ISBN 978-989-758-724-5, SciTePress, pages 104-109. DOI: 10.5220/0013022000004562

in Bibtex Style

@conference{iccas24,
author={Romane Dubus and Anke Brock and Wendy Mackay},
title={Integrating Rigorous Qualitative Methods into the Design and Evaluation of Safety-Critical Systems},
booktitle={Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS},
year={2024},
pages={104-109},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013022000004562},
isbn={978-989-758-724-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 2nd International Conference on Cognitive Aircraft Systems - Volume 1: ICCAS
TI - Integrating Rigorous Qualitative Methods into the Design and Evaluation of Safety-Critical Systems
SN - 978-989-758-724-5
AU - Dubus R.
AU - Brock A.
AU - Mackay W.
PY - 2024
SP - 104
EP - 109
DO - 10.5220/0013022000004562
PB - SciTePress