Online Detection of P300 related Target Recognition Processes During a Demanding Teleoperation Task - Classifier Transfer for the Detection of Missed Targets

Hendrik Woehrle, Elsa Andrea Kirchner

2014

Abstract

The detection of event related potentials and their usage for innovative tasks became a mature research topic in the last couple of years for brain computer interfaces. However, the typical experimental setups are usually highly controlled and designed to actively evoke specific brain activity like the P300 event related potential. In this paper, we show that the detection and passive usage of the P300 related brain activity is possible in highly uncontrolled and noisy application scenarios where the subjects are performing demanding senso-motor task, i.e., telemanipulation of a real robotic arm. In the application scenario, the subject wears an exoskeleton to control a robotic arm, which is presented to him in a virtual scenario. While performing the telemanipulation task he has to respond to important messages. By online analysis of the subject’s electroencephalogram we detect P300 related target recognition processes to infer on upcoming response behavior or missing of response behavior in case a target was not recognized. We show that a classifier that is trained to distinguish between brain activity evoked by recognized task relevant stimuli and ignored frequent task irrelevant stimuli can be applied to classify between brain activity evoked by recognized task relevant stimuli and brain activity that is evoked in case that task relevant stimuli are not recognized.

References

  1. Farwell, L. A. and Donchin, E. (1988). Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr. Clin. Neurophysiol., 70(6):510-23.
  2. Folgheraiter, M., Jordan, M., Straube, S., Seeland, A., Kim, S.-K., and Kirchner, E. A. (2012). Measuring the improvement of the interaction comfort of a wearable exoskeleton. International Journal of Social Robotics, 4(3):285-302.
  3. George, L. and Lécuyer, A. (2010). An overview of research on ”passive” brain-computer interfaces for implicit human-computer interaction. In International Conference on Applied Bionics and Biomechanics ICABB 2010 - Workshop W1 ”Brain-Computer Interfacing and Virtual Reality”, Venice, Italy.
  4. Guger, C., Harkam, W., Hertnaes, C., and Pfurtscheller, G. (1999). Prosthetic control by an EEG-based braincomputer interface (BCI). 5th European AAATE Conference.
  5. Haufe, S., Treder, M. S., Gugler, M. F., Sagebaum, M., Curio, G., and Blankertz, B. (2011). EEG potentials predict upcoming emergency brakings during simulated driving. Journal of Neural Engineering, 8(5):056001.
  6. Iturrate, I., Montesano, L., and Minguez, J. (2013). Taskdependent signal variations in EEG error-related potentials for brain-computer interfaces. Journal of Neural Engineering, 10:026024.
  7. Kim, S. K. and Kirchner, E. A. (2013). Classifier transferability in the detection of error related potentials from observation to interaction. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, SMC 2013, Manchester, UK, October 13- 16, 2013.
  8. Kirchner, E. A. and Drechsler, R. (2013). A Formal Model for Embedded Brain Reading. volume 40, pages 530- 540. Emerald Group Publishing Limited.
  9. Kirchner, E. A. and Kim, S. K. (2012). EEG in Dual-Task Human-Machine Interaction: Target Recognition and Prospective Memory. In Proceedings of the 18th Annual Meeting of the Organization for Human Brain Mapping.
  10. Kirchner, E. A., Kim, S. K., Straube, S., Seeland, A., Wöhrle, H., Krell, M. M., Tabie, M., and Fahle, M. (accepted 2013). On the applicability of brain reading for self-controlled, predictive human-machine interfaces in robotics. PLoS ONE.
  11. Kirchner, E. A., Metzen, J. H., Duchrow, T., Kim, S. K., and Kirchner, F. (2009). Assisting Telemanipulation Operators via Real-Time Brain Reading. In Lohweg, V. and Niggemann, O., editors, Proc. Mach. Learning in Real-time Applicat. Workshop 2009, Lemgoer Schriftenreihe zur industriellen Informationstechnik, Paderborn, Germany.
  12. Kirchner, E. A., Wöhrle, H., Bergatt, C., Kim, S.-K., Metzen, J. H., Feess, D., and Kirchner, F. (2010). Towards operator monitoring via brain reading - an EEG-based approach for space applications. In Proc. 10th Int. Symp. Artificial Intelligence, Robotics and Automation in Space, pages 448-455, Sapporo.
  13. Krell, M. M., Straube, S., Seeland, A., Wöhrle, H., Teiwes, J., Metzen, J. H., Kirchner, E. A., and Kirchner, F. (2013a). pySPACE. https://github.com/pyspace.
  14. Krell, M. M., Straube, S., Seeland, A., Wöhrle, H., Teiwes, J., Metzen, J. H., Kirchner, E. A., and Kirchner, F. (submitted 2013b). pySPACE a signal processing and classification environment in Python. Frontiers in Neuroinformatics.
  15. Kutas, M., McCarthy, G., and Donchin, E. (1977). Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. Science, 197(4305):792- 5.
  16. Nijholt, A., Tan, D., Allison, B. Z., Del R Milan, J., and Graimann, B. (2008). Brain-computer interfaces for HCI and games, pages 3925-3928. ACM.
  17. Pan, S. J. and Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10):1345-1359.
  18. Polich, J. (2007). Updating P300: an integrative theory of P3a and P3b. Clin Neurophysiol, 118(10):2128-48.
  19. Reuderink, B. (2008). Games and Brain-Computer Interfaces: The State of the Art. WP2 BrainGain Deliverable HMI University of Twente September 2008, pages 1-11.
  20. Rivet, B., Souloumiac, A., Attina, V., and Gibert, G. (2009). xDAWN algorithm to enhance evoked potentials: application to brain-computer interface. IEEE Transactions on Biomedical Engineering, 56(8):2035-2043.
  21. Salisbury, D., Rutherford, B., Shenton, M., and McCarley, R. (2001). Button-pressing Affects P300 Amplitude and Scalp Topography. Clin Neurophysiol, 112(9):1676-1684.
  22. Seeland, A., W öhrle, H., Straube, S., and Kirchner, E. A. (2013). Online movement prediction in a robotic application scenario. In Neural Engineering (NER), 2013 6th International IEEE/EMBS Conference on.
  23. Wolpaw, J. R., Birbaumer, N., McFarland, D. J., Pfurtscheller, G., and Vaughan, T. M. (2002). Braincomputer interfaces for communication and control. Clin. Neurophysiol., 113(6):767-91.
  24. Zander, T. O., Kothe, C., Jatzev, S., and Gaertner, M. (2010). Enhancing human-computer interaction with
Download


Paper Citation


in Harvard Style

Woehrle H. and Kirchner E. (2014). Online Detection of P300 related Target Recognition Processes During a Demanding Teleoperation Task - Classifier Transfer for the Detection of Missed Targets . In Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS, ISBN 978-989-758-006-2, pages 13-19. DOI: 10.5220/0004724600130019


in Bibtex Style

@conference{phycs14,
author={Hendrik Woehrle and Elsa Andrea Kirchner},
title={Online Detection of P300 related Target Recognition Processes During a Demanding Teleoperation Task - Classifier Transfer for the Detection of Missed Targets},
booktitle={Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,},
year={2014},
pages={13-19},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004724600130019},
isbn={978-989-758-006-2},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Physiological Computing Systems - Volume 1: PhyCS,
TI - Online Detection of P300 related Target Recognition Processes During a Demanding Teleoperation Task - Classifier Transfer for the Detection of Missed Targets
SN - 978-989-758-006-2
AU - Woehrle H.
AU - Kirchner E.
PY - 2014
SP - 13
EP - 19
DO - 10.5220/0004724600130019