Evaluating EEG Measures as a Workload Assessment in an Operational Video Game Setup

Lucille Lecoutre, Sami Lini, Christophe Bey, Quentin Lebour, Pierre-Alexandre Favier

2015

Abstract

We tested the electroencephalography (EEG) B-Alert X10 system (Advance Brain Monitoring, Inc.) mental workload metrics. When we evaluate a human-systems interfaces (HSI), we need to assess the operator’s state during a task in order evaluate the systems efficiency at helping the operator. Physiological metrics are of good help when it comes to evaluate the operator’s mental workload, and EEG is a promising tool. The B-Alert system includes an internal signal processing algorithm computing a mental workload index. We set up a simple experiment on a video game in order to evaluate the reliability of this index. Participants were asked to play a video game with different levels of goal (easy vs hard) as we measured subjective, behavioral and physiological indices (B-Alert mental workload index, pupillometry) of mental workload. Our results indicate that, although most of the measure point toward the same direction, the B-Alert metrics fails to give a clear indication of the mental workload state of the participants. The use of the B-Alert workload index alone is not precise enough to assess an operator mental workload condition with certainty. Further evaluations of this measure need to be done.

References

  1. Antonenko, P. et al., 2010. Using electroencephalography to measure cognitive load. Educational Psychology Review, 22(4), pp.425-438.
  2. Backs, R.W., Lenneman, J.K. and Sicard, J.L., 1999. The Use of Autonomic Components to Improve Cardiovascular Assessment of Mental Workload in Flight.. The International Journal of Aviation Psychology, 9(1), pp.33-47.
  3. Beatty, J., 1982. Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological bulletin, 91(2), p.276.
  4. Beatty, J. and Lucero-Wagoner, B., 2000. The pupillary system. Handbook of psychophysiology, 2, pp.142- 162.
  5. Berka, C. et al., 2007. EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. Aviation, space, and environmental medicine, 78(Supplement 1), p.B231-B244.
  6. Berka, C. et al., 2005. Evaluation of an EEG workload model in an Aegis simulation environment. In Defense and Security. International Society for Optics and Photonics, pp. 90-99.
  7. Berka, C. et al., 2004. Real-time analysis of EEG indexes of alertness, cognition, and memory acquired with a wireless EEG headset. International Journal of Human-Computer Interaction, 17(2), pp.151-170.
  8. Borghini, G. et al., 2012. Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neuroscience and Biobehavioral Reviews.
  9. Cegarra, J. and Chevalier, A., 2008. The use of Tholos software for combining measures of mental workload: Toward theoretical and methodological improvements. Behavior Research Methods, 40(4), pp.988-1000.
  10. Cegarra, J. and Morgado, N., 2009. Étude des propriétés de la version francophone du NASATLX. In Communication présentée à la cinquième édition du colloque de psychologie ergonomique (Epique).
  11. Hart, S.G. and Staveland, L.E., 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, pp.139-183.
  12. Johnson, R.R. et al., 2011. Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model. Biological psychology, 87(2), pp.241-250.
  13. Kahneman, D. and Beatty, J., 1966. Pupil diameter and load on memory. Science, 154(3756), pp.1583-1585.
  14. Klingner, J.M., 2010. Measuring cognitive load during visual tasks by combining pupillometry and eye tracking.
  15. Lini, S. et al., 2013. Evaluating ASAP (Anticipation Support for Aeronauticial Planning): a user-centered case study. In Proceedings of the 17th International Symposium on Aviation Psychology.
  16. Palinko, O. et al., 2010. Estimating cognitive load using remote eye tracking in a driving simulator. In Proceedings of the 2010 Symposium on Eye-Tracking Research and Applications. ACM, pp. 141-144.
  17. Tsang, P.S. and Vidulich, M.A., 2006. Mental workload and situation awareness. Handbook of Human Factors and Ergonomics, Third Edition, pp.243-268.
  18. Wickens, C.D., 1992. Engineering psychology and human performance, HarperCollins Publishers.
  19. Wilson, G.F., 2002. An analysis of mental workload in pilots during flight using multiple psychophysiological measures. The International Journal of Aviation Psychology, 12(1), pp.3-18.
Download


Paper Citation


in Harvard Style

Lecoutre L., Lini S., Bey C., Lebour Q. and Favier P. (2015). Evaluating EEG Measures as a Workload Assessment in an Operational Video Game Setup . In Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-085-7, pages 112-117. DOI: 10.5220/0005318901120117


in Bibtex Style

@conference{phycs15,
author={Lucille Lecoutre and Sami Lini and Christophe Bey and Quentin Lebour and Pierre-Alexandre Favier},
title={Evaluating EEG Measures as a Workload Assessment in an Operational Video Game Setup},
booktitle={Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2015},
pages={112-117},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005318901120117},
isbn={978-989-758-085-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Evaluating EEG Measures as a Workload Assessment in an Operational Video Game Setup
SN - 978-989-758-085-7
AU - Lecoutre L.
AU - Lini S.
AU - Bey C.
AU - Lebour Q.
AU - Favier P.
PY - 2015
SP - 112
EP - 117
DO - 10.5220/0005318901120117