Synchronization of Electroencephalography and Eye Tracking using Global Illumination Changes

Daniel Siboska, Henrik Karstoft, Henrik Pedersen

2014

Abstract

This paper describes a flexible method for synchronizing electroencephalography (EEG) and eye tracking (ET) recordings to the presentation of visual stimuli. The method consists of embedding a synchronization signal in the visual stimuli, and recording this signal with both the EEG and ET equipment. The signal is recorded by the EEG device as an additional data channel, and with the camera used in the ET equipment by modulating the global illumination of the scene in time with the synchronizing signal. The prototype system where this method was implemented resulted in a single sample of jitter in both the EEG and ET system, while the ET system achieved a spatial resolution of 1.26 degrees. The system will be used in future work with augmented memory applications.

References

  1. Agustin, J. S., 2009. Low-Cost Gaze Interaction?: Ready to Deliver the Promises. , pp.4453-4458.
  2. Bell, G. & Gemmell, J., 2007. A Digital Life. Scientific American, 296(3), pp.58-65.
  3. Courchesne, E., Hillyard, S.A. & Galambos, R., 1975. Stimulus novelty, task relevance and the visual evoked potential in man. Electroencephalography and Clinical Neurophysiology, 39(2), pp.131-143.
  4. Davies, S., 2011. Still building the memex. Communications of the ACM, 54(2), p.80.
  5. Fairchild, M., 1998. Color Appearance Models, Reading, Mass.: Addison, Wesley, & Longman.
  6. Fischler, M. A. & Bolles, R.C., 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Communications of the ACM, 24(6).
  7. Görgen, K. & Walter, S., 2010. Combining Eyetracking and EEG. Publications of the Institute of Cognitive Science, 15.
  8. Jäger, C., 2010. Eye Safety of IREDs used in Lamp Applications Application Note,
  9. Luck, S., 2005. An Introduction to the Event-Related Potential Technique (Cognitive Neuroscience) 1st ed., A Bradford Book.
  10. Plöchl, M., Ossandón, J. P. & König, P., 2012. Combining EEG and eye tracking: identification, characterization, and correction of eye movement artifacts in electroencephalographic data. Frontiers in human neuroscience, 6(October), p.278.
  11. Pohlmeyer, E. a et al., 2011. Closing the loop in corticallycoupled computer vision: a brain-computer interface for searching image databases. Journal of neural engineering, 8(3), p.036025.
  12. Sereno, S., 2003. Measuring word recognition in reading: eye movements and event-related potentials. Trends in Cognitive Sciences, 7(11), pp.489-493.
  13. Villanueva, A. et al., 2009. A geometric approach to remote eye tracking. Universal Access in the Information Society, 8(4), pp.241-257.
  14. Wang, J. et al., 2009. Brain state decoding for rapid image retrieval. Proceedings of the seventeen ACM international conference on Multimedia - MM 7809, p.945.
  15. Wang, Y. et al., 2008. Brain-computer interfaces based on visual evoked potentials. IEEE Eng Med Biol Mag, 27(5), pp.64-71.
  16. Winfield, D. & Parkhurst, D.J., 2005. Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches. In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. IEEE, pp. 79-79.
Download


Paper Citation


in Harvard Style

Siboska D., Karstoft H. and Pedersen H. (2014). Synchronization of Electroencephalography and Eye Tracking using Global Illumination Changes . In Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2014) ISBN 978-989-758-011-6, pages 55-60. DOI: 10.5220/0004800400550060


in Bibtex Style

@conference{biosignals14,
author={Daniel Siboska and Henrik Karstoft and Henrik Pedersen},
title={Synchronization of Electroencephalography and Eye Tracking using Global Illumination Changes},
booktitle={Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2014)},
year={2014},
pages={55-60},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004800400550060},
isbn={978-989-758-011-6},
}


in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Bio-inspired Systems and Signal Processing - Volume 1: BIOSIGNALS, (BIOSTEC 2014)
TI - Synchronization of Electroencephalography and Eye Tracking using Global Illumination Changes
SN - 978-989-758-011-6
AU - Siboska D.
AU - Karstoft H.
AU - Pedersen H.
PY - 2014
SP - 55
EP - 60
DO - 10.5220/0004800400550060