Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study

Pietro Cipresso, Paolo Meriggi, Laura Carelli, Federica Solca, Barbara Poletti, Dorothée Lulé, Albert C. Ludolph, Vincenzo Silani, Giuseppe Riva

2012

Abstract

In this study we explored the use of Brain Computer Interface (BCI) and Eye-Tracking (ET) technology both as augmentative and alternative communication (AAC) tool and to assess cognitive deficits. Specifically, we focused on the possible development of a neuropsychological battery for cognitive assessment based on the integration of BCI and ET tools. To preliminary test this approach we assessed eight healthy subjects with a widespread used cognitive task. AAC and usability of both instruments have also been evaluated with the aim to fine-tune the overall system architecture for clinical use.

References

  1. Bak T. H., Hodges J. R., (2001). Motor neurone disease, dementia and aphasia: coincidence, co-occurrence or continuum? J Neurol, 248(4):260-70.
  2. Bak T. H., Hodges J. R., (2001). Motor neurone disease, dementia and aphasia: coincidence, co-occurrence or continuum? J Neurol, 248(4):260-70.
  3. Strong M. J., Lomen-Hoerth C., Caselli R. J. et al., (2003). Cognitive impairment, frontotemporal dementia, and the motor neuron diseases. Ann Neurol, 54:S20-23.
  4. Strong M. J., Lomen-Hoerth C., Caselli R. J. et al., (2003). Cognitive impairment, frontotemporal dementia, and the motor neuron diseases. Ann Neurol, 54:S20-23.
  5. Strong M. J., Grace G. M., Freedman M., Lomen-Hoerth C., Woolley S., Goldstein L. H., Murphy J., Shoesmith C., Rosenfeld J., Leigh P. N., Bruijn L., Ince P., Figlewicz D., (2009). Consensus criteria for the diagnosis of frontotemporal cognitive and behavioural syndromes in amyotrophic lateral sclerosis. Amyotroph Lateral Scler, 10(3):131-46.
  6. Strong M. J., Grace G. M., Freedman M., Lomen-Hoerth C., Woolley S., Goldstein L. H., Murphy J., Shoesmith C., Rosenfeld J., Leigh P. N., Bruijn L., Ince P., Figlewicz D., (2009). Consensus criteria for the diagnosis of frontotemporal cognitive and behavioural syndromes in amyotrophic lateral sclerosis. Amyotroph Lateral Scler, 10(3):131-46.
  7. Zago S., Poletti B., Morelli C., Doretti A., Silani V., (2011). Amyotrophic lateral sclerosis and frontotemporal dementia (ALS-FTD). Archives Italiennes de Biologie, 149: 39-56.
  8. Zago S., Poletti B., Morelli C., Doretti A., Silani V., (2011). Amyotrophic lateral sclerosis and frontotemporal dementia (ALS-FTD). Archives Italiennes de Biologie, 149: 39-56.
  9. Phukan J., Pender N. P., Hardiman O., (2007). Cognitive impairment in amyotrophic lateral sclerosis. Lancet Neurol, 6(11):994-1003.
  10. Phukan J., Pender N. P., Hardiman O., (2007). Cognitive impairment in amyotrophic lateral sclerosis. Lancet Neurol, 6(11):994-1003.
  11. Abrahams S., Leigh P. N., Harvey A., Vythelingum G. N., Grisé D., Goldstein L. H., (2000). Verbal fluency and executive dysfunction in amyotrophic lateral sclerosis (ALS). Neuropsychologia, 38(6):734-47.
  12. Abrahams S., Leigh P. N., Harvey A., Vythelingum G. N., Grisé D., Goldstein L. H., (2000). Verbal fluency and executive dysfunction in amyotrophic lateral sclerosis (ALS). Neuropsychologia, 38(6):734-47.
  13. Kübler A., Birbaumer N., (2008). Brain-Computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clinical Neurophysiology, 119:2658-2666.
  14. Kübler A., Birbaumer N., (2008). Brain-Computer interfaces and communication in paralysis: extinction of goal directed thinking in completely paralysed patients? Clinical Neurophysiology, 119:2658-2666.
  15. Fabiani M., Gratton G., Karis D., Donchin E., (1987). Definition, identification and reliability of the P300 component of the event-related brain potential. Ackles, P.K., Jennings, J. R., Coles, M. G. H. (Eds.). Advances in psychophysiology, 2. New York, NY: JAI Press, 1-78.
  16. Fabiani M., Gratton G., Karis D., Donchin E., (1987). Definition, identification and reliability of the P300 component of the event-related brain potential. Ackles, P.K., Jennings, J. R., Coles, M. G. H. (Eds.). Advances in psychophysiology, 2. New York, NY: JAI Press, 1-78.
  17. Sellers E. W., Donchin E., (2006). A P300-based brain-computer interface: Initial tests by ALS patients. Clin Neurophysiol,117:538-548.
  18. Sellers E. W., Donchin E., (2006). A P300-based brain-computer interface: Initial tests by ALS patients. Clin Neurophysiol,117:538-548.
  19. Sellers E. W., Kübler A., Donchin E., (2006). Brain-computer interface research at the University of South Florida Cognitive Psychophysiology Laboratory: the P300. Speller. IEEE Trans Neural Syst Rehabil Eng, 14(2):221-4.
  20. Sellers E. W., Kübler A., Donchin E., (2006). Brain-computer interface research at the University of South Florida Cognitive Psychophysiology Laboratory: the P300. Speller. IEEE Trans Neural Syst Rehabil Eng, 14(2):221-4.
  21. Dickhaus T., Sannelli C., Muller K. R., Curio G., Blankertz B., (2009). Predicting BCI performance to study BCI illiteracy. BMC Neuroscience, 10.
  22. Dickhaus T., Sannelli C., Muller K. R., Curio G., Blankertz B., (2009). Predicting BCI performance to study BCI illiteracy. BMC Neuroscience, 10.
  23. Nijboer F., Sellers E. W., Mellinger J., Jordan M. A., Matuz T., Furdea A., Halder S., Mochty U., Krusienski D. J., Vaughan T. M., Wolpaw J. R., Birbaumer N., Kübler A., (2008). A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol, 119(8):1909-16.
  24. Nijboer F., Sellers E. W., Mellinger J., Jordan M. A., Matuz T., Furdea A., Halder S., Mochty U., Krusienski D. J., Vaughan T. M., Wolpaw J. R., Birbaumer N., Kübler A., (2008). A P300-based brain-computer interface for people with amyotrophic lateral sclerosis. Clin Neurophysiol, 119(8):1909-16.
  25. Paulus K. S., Magnano I., Piras M. R. et al., (2002). Visual and auditory event-related potentials in sporadic amyotrophic lateral sclerosis. Clin Neurophysiol, 113:853-61.
  26. Paulus K. S., Magnano I., Piras M. R. et al., (2002). Visual and auditory event-related potentials in sporadic amyotrophic lateral sclerosis. Clin Neurophysiol, 113:853-61.
  27. Hanagasi H. A., Gurvit I. H., Ermutlu N. et al., (2002). Cognitive impairment in amyotrophic lateral sclerosis: evidence from neuropsychological investigation and eventrelated potentials. Cognitive Brain Research, 14:234-244.
  28. Hanagasi H. A., Gurvit I. H., Ermutlu N. et al., (2002). Cognitive impairment in amyotrophic lateral sclerosis: evidence from neuropsychological investigation and eventrelated potentials. Cognitive Brain Research, 14:234-244.
  29. Gil R., Neau J. P., Dary-Auriol M. et al., (1995). Event-related auditory evoked potentials and amyotrophic lateral sclerosis. Arch Neurol, 52: 890-896.
  30. Gil R., Neau J. P., Dary-Auriol M. et al., (1995). Event-related auditory evoked potentials and amyotrophic lateral sclerosis. Arch Neurol, 52: 890-896.
  31. Ogawa T., Tanaka H., Hirata K., (2009). Cognitive deficits in amyotrophic lateral sclerosis evaluated by event-related potentials. Clinical Neurophysiology, 120:659-664.
  32. Ogawa T., Tanaka H., Hirata K., (2009). Cognitive deficits in amyotrophic lateral sclerosis evaluated by event-related potentials. Clinical Neurophysiology, 120:659-664.
  33. Schreiber H., Gaigalat T., Wiedemuth-Catrinescu U., Graf M., Uttner I., Muche R., Ludolph A. C., (2005). Cognitive function in bulbar- and spinal-onset amyotrophic lateral sclerosis. A longitudinal study in 52 patients. J Neurol, 252(7):772-81.
  34. Schreiber H., Gaigalat T., Wiedemuth-Catrinescu U., Graf M., Uttner I., Muche R., Ludolph A. C., (2005). Cognitive function in bulbar- and spinal-onset amyotrophic lateral sclerosis. A longitudinal study in 52 patients. J Neurol, 252(7):772-81.
  35. Kübler A., Kotchoubey B., Kaiser J. et al., (2001). Brain-Computer Communication: unlocking the locked in. Psychological Bullettin, 127(3): 358-375.
  36. Kübler A., Kotchoubey B., Kaiser J. et al., (2001). Brain-Computer Communication: unlocking the locked in. Psychological Bullettin, 127(3): 358-375.
  37. Cipresso P., Meriggi P., Carelli L., Solca F., Meazzi D., Poletti B., Lulé D., Ludolph A. C., Riva G., Silani V., (2011), The combined use of Brain Computer Interface and EyeTracking technology for cognitive assessment in Amyotrophic Lateral Sclerosis, 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (2011): p. 320-324.
  38. Cipresso P., Meriggi P., Carelli L., Solca F., Meazzi D., Poletti B., Lulé D., Ludolph A. C., Riva G., Silani V., (2011), The combined use of Brain Computer Interface and EyeTracking technology for cognitive assessment in Amyotrophic Lateral Sclerosis, 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (2011): p. 320-324.
  39. Wolpaw J. R., Schalk G., McFarland D. J., Hinterberger T., Perelmouter J., Godde B., Birbaumer N., Pfurtscheller G., BCI2000: a general purpose brain-computer interface system. Soc Neurosci Abstr 2000c;26:1229.
  40. Wolpaw J. R., Schalk G., McFarland D. J., Hinterberger T., Perelmouter J., Godde B., Birbaumer N., Pfurtscheller G., BCI2000: a general purpose brain-computer interface system. Soc Neurosci Abstr 2000c;26:1229.
  41. Schalk G., McFarland D. J., Hinterberger T., Birbaumer N., Wolpaw J. R., BCI2000: development of a general purpose brain-computer interface (BCI) system. Soc Neurosci Abstr 2001;27:168.
  42. Schalk G., McFarland D. J., Hinterberger T., Birbaumer N., Wolpaw J. R., BCI2000: development of a general purpose brain-computer interface (BCI) system. Soc Neurosci Abstr 2001;27:168.
  43. Spielberger C. D., Goursuch R. I. and Lushene R. E., (1970) Manual for state and trait anxiety inventory (self-evaluation questionnaire). Consulting Psychologist Press, Palo Alto, CA.
  44. Spielberger C. D., Goursuch R. I. and Lushene R. E., (1970) Manual for state and trait anxiety inventory (self-evaluation questionnaire). Consulting Psychologist Press, Palo Alto, CA.
  45. Lang, P. J., (1995). The emotion probe. Studies of motivation and attention. The American Psychologist, 50(5), 372-385.
  46. Lang, P. J., (1995). The emotion probe. Studies of motivation and attention. The American Psychologist, 50(5), 372-385.
  47. Lang P. J., Behavioral treatment and bio-behavioral assessment. In: Sidowski J. B., Johnson J. H., Williams T. A., editors. Technology in mental health care delivery systems, Norwood, NJ: Ablex, 1980, pp. 119-37.
  48. Lang P. J., Behavioral treatment and bio-behavioral assessment. In: Sidowski J. B., Johnson J. H., Williams T. A., editors. Technology in mental health care delivery systems, Norwood, NJ: Ablex, 1980, pp. 119-37.
  49. Bradley, M. M. and Lang, P. J., (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49-59.
  50. Bradley, M. M. and Lang, P. J., (1994). Measuring emotion: The self-assessment manikin and the semantic differential. Journal of Behavior Therapy and Experimental Psychiatry, 25, 49-59.
  51. Nielsen, J., (1992). The usability engineering life cycle. IEEE Computer 25,3 (March), 12- 22.
  52. Nielsen, J., (1992). The usability engineering life cycle. IEEE Computer 25,3 (March), 12- 22.
  53. Nielsen, J., (1993). Usability Engineering, Academic Press, Boston, MA.
  54. Nielsen, J., (1993). Usability Engineering, Academic Press, Boston, MA.
  55. Velichkovsky, B. and Hansen, J. P., (1996). New technological windows into mind: There is more in eyes and brains for human-computer interaction. In Proc. CHI 1996, 496-503.
  56. Velichkovsky, B. and Hansen, J. P., (1996). New technological windows into mind: There is more in eyes and brains for human-computer interaction. In Proc. CHI 1996, 496-503.
  57. Kitamura, Y., Yamaguchi, Y., Imamizu, H., Kishino, F. and Kawato, M., (2003). Things happening in the brain while humans learn to use new tools. In Proc. CHI 2003, 417-424.
  58. Kitamura, Y., Yamaguchi, Y., Imamizu, H., Kishino, F. and Kawato, M., (2003). Things happening in the brain while humans learn to use new tools. In Proc. CHI 2003, 417-424.
  59. Abe K., Fujimura H., Toyooka K., Sakoda S., Yorifugi S., Yanagihara T., Cognitive function in amyotrophic lateral sclerosis. Journal of Neurological Sciences 1997;148:95- 100.
  60. Abe K., Fujimura H., Toyooka K., Sakoda S., Yorifugi S., Yanagihara T., Cognitive function in amyotrophic lateral sclerosis. Journal of Neurological Sciences 1997;148:95- 100.
Download


Paper Citation


in Harvard Style

Cipresso P., Meriggi P., Carelli L., Solca F., Poletti B., Lulé D., C. Ludolph A., Silani V. and Riva G. (2012). Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study . In Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012) ISBN 978-989-8425-92-8, pages 79-88. DOI: 10.5220/0003893100790088


in Harvard Style

Cipresso P., Meriggi P., Carelli L., Solca F., Poletti B., Lulé D., C. Ludolph A., Silani V. and Riva G. (2012). Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study . In Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012) ISBN 978-989-8425-92-8, pages 79-88. DOI: 10.5220/0003893100790088


in Bibtex Style

@conference{mindcare12,
author={Pietro Cipresso and Paolo Meriggi and Laura Carelli and Federica Solca and Barbara Poletti and Dorothée Lulé and Albert C. Ludolph and Vincenzo Silani and Giuseppe Riva},
title={Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study},
booktitle={Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012)},
year={2012},
pages={79-88},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003893100790088},
isbn={978-989-8425-92-8},
}


in Bibtex Style

@conference{mindcare12,
author={Pietro Cipresso and Paolo Meriggi and Laura Carelli and Federica Solca and Barbara Poletti and Dorothée Lulé and Albert C. Ludolph and Vincenzo Silani and Giuseppe Riva},
title={Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study},
booktitle={Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012)},
year={2012},
pages={79-88},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003893100790088},
isbn={978-989-8425-92-8},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012)
TI - Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study
SN - 978-989-8425-92-8
AU - Cipresso P.
AU - Meriggi P.
AU - Carelli L.
AU - Solca F.
AU - Poletti B.
AU - Lulé D.
AU - C. Ludolph A.
AU - Silani V.
AU - Riva G.
PY - 2012
SP - 79
EP - 88
DO - 10.5220/0003893100790088


in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Workshop on Computing Paradigms for Mental Health - Volume 1: MindCare, (BIOSTEC 2012)
TI - Brain Computer Interface and Eye-tracking for Neuropsychological Assessment of Executive Functions: A Pilot Study
SN - 978-989-8425-92-8
AU - Cipresso P.
AU - Meriggi P.
AU - Carelli L.
AU - Solca F.
AU - Poletti B.
AU - Lulé D.
AU - C. Ludolph A.
AU - Silani V.
AU - Riva G.
PY - 2012
SP - 79
EP - 88
DO - 10.5220/0003893100790088