Authors:
Gaganpreet Singh
1
;
Sergi Bermúdez i Badia
1
;
Rodrigo Ventura
2
and
José Luís Silva
3
Affiliations:
1
Universidade da Madeira, Portugal
;
2
Instituto Superior Técnico and Universidade de Lisboa, Portugal
;
3
ISTAR-IUL, Portugal
Keyword(s):
Psychophysiology, Biosignals, Bitalino, Robot Teleoperation, Facial Emotions, Electroencephalography, Electrocardiogram, Electrodermal Activity, Electromyography, Eye Tracking, Sikuli, Picture-driven Computing, Automation, ISI, Emotions.
Abstract:
We developed a framework for Physiologically Attentive User Interfaces, to reduce the interaction gap between humans and machines in life critical robot teleoperations. Our system utilizes emotional state awareness capabilities of psychophysiology and classifies three emotional states (Resting, Stress, and Workload) by analysing physiological data along with facial expression and eye movement analysis. This emotional state estimation is then used to create a dynamic interface that updates in real time with respect to user’s emotional state. The results of a preliminary evaluation of the developed emotional state classifier for robot teleoperation are presented, along with its future possibilities are discussed.