On the Importance of User Role-Tailored Explanations in Industry 5.0

Inti Mendoza, Vedran Sabol, Vedran Sabol, Johannes Hoffer

2023

Abstract

Advanced Machine Learning models now see usage in sensitive fields where incorrect predictions have serious consequences. Unfortunately, as models increase in accuracy and complexity, humans cannot verify or validate their predictions. This ineffability foments distrust and reduces model usage. eXplainable AI (XAI) provides insights into AI models’ predictions. Nevertheless, scholar opinion on XAI range from ”absolutely necessary” to ”useless, use white box models instead”. In modern Industry 5.0 environments, AI sees usage in production process engineering and optimisation. However, XAI currently targets the needs of AI experts, not the needs of domain experts or process operators. Our Position is: XAI tailored to user roles and following social science’s guidelines on explanations is crucial in AI-supported production scenarios and for employee acceptance and trust. Our industry partners allow us to analyse user requirements for three identified user archetypes - the Machine Operator, Field Expert, and AI Expert - and experiment with actual use cases. We designed an (X)AI-based visual UI through multiple review cycles with industry partners to test our Position. Looking ahead, we can test and evaluate the impact of personalised XAI in Industry 5.0 scenarios, quantify its benefits, and identify research opportunities.

Paper Citation

in Harvard Style

Mendoza I., Sabol V. and Hoffer J. (2023). On the Importance of User Role-Tailored Explanations in Industry 5.0. In Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP; ISBN 978-989-758-634-7, SciTePress, pages 243-250. DOI: 10.5220/0011748300003417

in Bibtex Style

@conference{hucapp23,
author={Inti Mendoza and Vedran Sabol and Johannes Hoffer},
title={On the Importance of User Role-Tailored Explanations in Industry 5.0},
booktitle={Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP},
year={2023},
pages={243-250},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0011748300003417},
isbn={978-989-758-634-7},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2023) - Volume 2: HUCAPP
TI - On the Importance of User Role-Tailored Explanations in Industry 5.0
SN - 978-989-758-634-7
AU - Mendoza I.
AU - Sabol V.
AU - Hoffer J.
PY - 2023
SP - 243
EP - 250
DO - 10.5220/0011748300003417
PB - SciTePress