Physiologically Attentive User Interface for Robot Teleoperation - Real Time Emotional State Estimation and Interface Modification using Physiology, Facial Expressions and Eye Movements

Gaganpreet Singh, Sergi Bermúdez i Badia, Rodrigo Ventura, José Luís Silva

2018

Abstract

We developed a framework for Physiologically Attentive User Interfaces, to reduce the interaction gap between humans and machines in life critical robot teleoperations. Our system utilizes emotional state awareness capabilities of psychophysiology and classifies three emotional states (Resting, Stress, and Workload) by analysing physiological data along with facial expression and eye movement analysis. This emotional state estimation is then used to create a dynamic interface that updates in real time with respect to user’s emotional state. The results of a preliminary evaluation of the developed emotional state classifier for robot teleoperation are presented, along with its future possibilities are discussed.

Paper Citation

in Harvard Style

Singh G., Badia S., Ventura R. and Silva J. (2018). Physiologically Attentive User Interface for Robot Teleoperation - Real Time Emotional State Estimation and Interface Modification using Physiology, Facial Expressions and Eye Movements.In Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 3: Real, ISBN 978-989-758-279-0, pages 294-302. DOI: 10.5220/0006733002940302

in Bibtex Style

@conference{real18,
author={Gaganpreet Singh and Sergi Bermúdez i Badia and Rodrigo Ventura and José Luís Silva},
title={Physiologically Attentive User Interface for Robot Teleoperation - Real Time Emotional State Estimation and Interface Modification using Physiology, Facial Expressions and Eye Movements},
booktitle={Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 3: Real,},
year={2018},
pages={294-302},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006733002940302},
isbn={978-989-758-279-0},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 11th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 3: Real,
TI - Physiologically Attentive User Interface for Robot Teleoperation - Real Time Emotional State Estimation and Interface Modification using Physiology, Facial Expressions and Eye Movements
SN - 978-989-758-279-0
AU - Singh G.
AU - Badia S.
AU - Ventura R.
AU - Silva J.
PY - 2018
SP - 294
EP - 302
DO - 10.5220/0006733002940302