Psychophysiological Modelling of Trust in Technology: Comparative Analysis of Psychophysiological Signals

Ighoyota Ben Ajenaghughrure, Sónia Cláudia Da Costa Sousa, David Lamas

2021

Abstract

Measuring users trust with psychophysiological signals during interaction (real-time) with autonomous systems that incorporates artificial intelligence has been widely researched with several psychophysiological signals. However, it is unclear what psychophysiological is most reliable for real-time trust assessment during user’s interaction with an autonomous system. This study investigates what psychophysiological signal is most suitable for assessing trust in real-time. A within-subject four condition experiment was implemented with a virtual reality autonomous vehicle driving game that involved 31 carefully selected participants, while electroencephalogram, electrodermal activity, eletrocardiogram, eye-tracking and facial electromyogram psychophysiological signals were acquired. We applied hybrid feature selection methods on the features extracted from the psychophysiological signals. Using training and testing datasets containing only the resulting features from the feature selection methods, for each individual and multi-modal (combined) psychophysiological signals, we trained and tested six stack ensemble trust classifier models. The results of the model’s performance indicate that the EEG is most reliable, while the multimodal psychophysiological signals remain promising.

Paper Citation

in Harvard Style

Ben Ajenaghughrure I., Sousa S. and Lamas D. (2021). Psychophysiological Modelling of Trust in Technology: Comparative Analysis of Psychophysiological Signals. In Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP; ISBN 978-989-758-488-6, SciTePress, pages 161-173. DOI: 10.5220/0010237701610173

in Bibtex Style

@conference{hucapp21,
author={Ighoyota Ben Ajenaghughrure and Sónia Cláudia Da Costa Sousa and David Lamas},
title={Psychophysiological Modelling of Trust in Technology: Comparative Analysis of Psychophysiological Signals},
booktitle={Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP},
year={2021},
pages={161-173},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010237701610173},
isbn={978-989-758-488-6},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2021) - Volume 2: HUCAPP
TI - Psychophysiological Modelling of Trust in Technology: Comparative Analysis of Psychophysiological Signals
SN - 978-989-758-488-6
AU - Ben Ajenaghughrure I.
AU - Sousa S.
AU - Lamas D.
PY - 2021
SP - 161
EP - 173
DO - 10.5220/0010237701610173
PB - SciTePress