A Framework for Disentangling Efficiency from Effectiveness in External HMI Evaluation Procedures for Automated Vehicles

Alexandros Rouchitsas

2025

Abstract

Automated vehicles (AVs) are rapidly transforming smart cities, offering potential benefits such as improved safety, performance, mobility, accessibility, and overall user experience in traffic. A key area of focus in this evolution is the development of external human-machine interfaces (eHMIs) which aim to equip AVs with communication capabilities. Said interfaces address critical challenges, including mitigating safety risks and enhancing traffic flow in scenarios where drivers are inattentive or altogether absent, and play an important role in allaying distrust of the general public in AVs. Considering the research field of eHMIs is relatively young, it is unsurprising that standardized eHMI evaluation procedures are yet to be established. As a result, the effectiveness and efficiency of eHMI concepts are often assessed either simultaneously within the same evaluation procedure or separately but in otherwise similar procedures. Unfortunately, these approaches overlook on the whole the fundamental differences between the two constructs, resulting in limitations relating to the validity, reliability, and comparability of the findings. Here, I present a definitive framework aimed at disentangling efficiency from effectiveness by guiding methodological choices regarding design rationale explanation, instructions emphasizing speed, trial-level time limit, and targeted performance measures, depending on the research questions of interest.

Paper Citation

in Harvard Style

Rouchitsas A. (2025). A Framework for Disentangling Efficiency from Effectiveness in External HMI Evaluation Procedures for Automated Vehicles. In Proceedings of the 11th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS; ISBN 978-989-758-745-0, SciTePress, pages 616-621. DOI: 10.5220/0013435900003941

in Bibtex Style

@conference{vehits25,
author={Alexandros Rouchitsas},
title={A Framework for Disentangling Efficiency from Effectiveness in External HMI Evaluation Procedures for Automated Vehicles},
booktitle={Proceedings of the 11th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS},
year={2025},
pages={616-621},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0013435900003941},
isbn={978-989-758-745-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Conference on Vehicle Technology and Intelligent Transport Systems - Volume 1: VEHITS
TI - A Framework for Disentangling Efficiency from Effectiveness in External HMI Evaluation Procedures for Automated Vehicles
SN - 978-989-758-745-0
AU - Rouchitsas A.
PY - 2025
SP - 616
EP - 621
DO - 10.5220/0013435900003941
PB - SciTePress