Effect of a Real-Time Psychophysiological Feedback, Its Display Format and Reliability on Cognitive Workload and Performance

Sami Lini, Lise Hannotte, Margot Beugniot

2016

Abstract

For a long time, literature has identified some psychophysiological metrics that proved reliable to assess cognitive states in controlled conditions. Smaller, more reliable and more affordable sensors made the industrial community plan to design systems that would adapt themselves to the ability of their users to operate them. Thus an important human factors question must be asked: what is the impact of such a feedback on users’ performance and cognitive workload? Does the display format of this feedback have an influence over subjects? What if the feedback provides erroneous data? We designed a protocol to compare the influence of providing a cognitive load assessment gauge versus raw data versus no feedback in a Multiple Objects Tracking task. Reliability of this feedback was also evaluated. Performance in a dual task paradigm, pupil dilation and questionnaire were used to assess cognitive load. Trials duration and learning effect were used as control results. Raw feedback showed a negative effect while low reliability showed inconsistent results.

References

  1. Afergan, D., Peck, E. M., Solovey, E. T., Jenkins, A., Hincks, S. W., Brown, E. T., … Jacob, R. J. K. (2014). Dynamic difficulty using brain metrics of workload. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 3797-3806). ACM.
  2. Allen, R., McGeorge, P., Pearson, D., and Milne, A. B. (2004). Attention and expertise in multiple target tracking. Applied Cognitive Psychology, 18(3), 337- 347. doi:10.1002/acp.975.
  3. Beatty, J. (1988). Pupillometric signs of selective attention in man. In E. Donchin, G. Galbraith, and M. L. Kietzman (Eds.), Neurophysiology and psychophysiology: Experimental and clinical applications (pp. 138-143).
  4. Beatty, J., and Lucero-Wagoner, B. (2000). The pupillary system. In Handbook of psychophysiology (2nd ed., pp. 142-162). New York, NY, US: Cambridge University Press.
  5. Drew, T., Horowitz, T. S., and Vogel, E. K. (2013). Swapping or dropping? Electrophysiological measures of difficulty during multiple object tracking. Cognition, 126(2), 213-223.
  6. Egelund, N. (1982). Spectral analysis of heart rate variability as an indicator of driver fatigue. Ergonomics, 25(7), 663-672. doi:10.1080/00140138208925026.
  7. Gawron, V. J. (2008). Human performance, workload, and situational awareness measures handbook. CRC Press.
  8. George, L., and Lécuyer, A. (2010). An overview of research on“ passive” brain-computer interfaces for implicit human-computer interaction. In International Conference on Applied Bionics and Biomechanics ICABB 2010-Workshop W1“ Brain-Computer Interfacing and Virtual Reality.”
  9. Hulleman, J. (2005). The mathematics of multiple object tracking: From proportions correct to number of objects tracked. Vision Research, 45(17), 2298-2309.
  10. Kahneman, D., and Beatty, J. (1966). Pupil diameter and load on memory. Science, 154(3756), 1583-1585.
  11. Kluger, A. N., and DeNisi, A. (1996). The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254.
  12. Kohlmorgen, J., Dornhege, G., Braun, M., Blankertz, B., Müller, K.-R., Curio, G., … Kincses, W. (2007). Improving human performance in a real operating environment through real-time mental workload detection. Toward Brain-Computer Interfacing, 409-422.
  13. Lopez, J. S. A., Hansen, J. P., Sztuk, S., and Tall, M. H. (2014, February). Systems and methods of eye tracking calibration. Google Patents.
  14. Makovski, T., Vázquez, G. A., and Jiang, Y. V. (2008). Visual learning in multiple-object tracking. PLoS One, 3(5), e2228.
  15. Oksama, L., and Hyönä, J. (2004). Is multiple object tracking carried out automatically by an early vision mechanism independent of higher order cognition? An individual difference approach. Visual Cognition, 11(5), 631-671.
  16. Pylyshyn, Z. (2004). Some puzzling findings in multiple object tracking: I. Tracking without keeping track of object identities. Visual Cognition, 11(7), 801-822.
  17. Pylyshyn, Z., and Storm, R. W. (1988). Tracking multiple independent targets: Evidence for a parallel tracking mechanism*. Spatial Vision, 3(3), 179-197.
  18. Story, T. J., and Craske, M. G. (2008). Responses to false physiological feedback in individuals with panic attacks and elevated anxiety sensitivity. Behaviour Research and Therapy, 46(9), 1001-1008.
  19. Valins, S., and Ray, A. A. (1967). Effects of cognitive desensitization on avoidance behavior. Journal of Personality and Social Psychology, 7(4p1), 345.
  20. Voßkühler, A. (2009). OGAMA description (for Version 2.5). Berlin, Germany: Freie Universität Berlin, Fachbereich Physik.
  21. Wickens, C. D., Gempler, K., and Morphew, M. E. (2000). Workload and Reliability of Predictor Displays in Aircraft Traffic Avoidance. Transportation Human Factors, 2(2), 99-126. doi:10.1207/STHF0202_01.
Download


Paper Citation


in Harvard Style

Lini S., Hannotte L. and Beugniot M. (2016). Effect of a Real-Time Psychophysiological Feedback, Its Display Format and Reliability on Cognitive Workload and Performance . In Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-197-7, pages 75-79. DOI: 10.5220/0005939500750079


in Bibtex Style

@conference{phycs16,
author={Sami Lini and Lise Hannotte and Margot Beugniot},
title={Effect of a Real-Time Psychophysiological Feedback, Its Display Format and Reliability on Cognitive Workload and Performance},
booktitle={Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2016},
pages={75-79},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005939500750079},
isbn={978-989-758-197-7},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Effect of a Real-Time Psychophysiological Feedback, Its Display Format and Reliability on Cognitive Workload and Performance
SN - 978-989-758-197-7
AU - Lini S.
AU - Hannotte L.
AU - Beugniot M.
PY - 2016
SP - 75
EP - 79
DO - 10.5220/0005939500750079