Cognitive Assessment through “Casual Video Games” and Machine Learning - Doctoral Consortium Contributions

Sonia M. Valladares Rodríguez, Roberto Pérez Rodríguez, Luis E. Anido Rifón, Manuel J. Fernández Iglesias

2015

Abstract

Cognitive evaluation aims to the examination of cognitive functions like memory, attention, orientation, language, or executive functions (e.g., activity planning and sequencing), in order to discard anomalies in cognitive capabilities. Cognitive impairments are typically associated to senior citizens, who they could be seriously compromised due to dementia and other related processes. Another population group where cognitive evaluations are typically performed are students, because they can suffer from dyslexia, attention deficit disorder or hyperactivity. Thus, to detect these problems, it is necessary to pass a cognitive assessment. Currently, they take place in a controlled & medical environment and they are mainly based on: neuro-psychological tests (e.g. MMSE, King’s figure, Trail Making Test, etc.). Nevertheless, these classic tools suffer several limitations, such as: they require personalized attention of health professionals; their application is usually performed retrospectively when cognitive problems are clearly; they are very dependent of confounding factors (e.g. age, gender, educational level, behavioural, etc.). Thus, there is a need to develop new cognitive evaluation tools, more natural, transparent, continuous and entertained. Among the new trends to overcome the limitations recently mentioned, some researchers have raised the possibility of using casual video games. Thus, we have proposed the following research challenge: to create a device to estimate the cognitive status of a person, from their interaction with casual games, using machine learning techniques. Then, we are going to try to offer an answer and to contribute new knowledge in this matter, especially in the machine learning field. To conclude, the expected outcome of this research will be relevant under a scientific, social and economic perspective.

References

  1. Aalbers, T. et al., 2013. Puzzling With Online Games (BAM-COG): Reliability, Validity, and Feasibility of an Online Self-Monitor for Cognitive Performance in Aging Adults. Journal of medical Internet research, 15(12). Available at: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC38689 77/.
  2. Allegri, R., Harris, P. & Drake, M., 2000. La evaluaci{ó}n neuropsicol{ó}gica en la enfermedad de Alzheimer. Rev Neurol Arg, 25(supl 1), pp.11-15.
  3. Ardila, A. et al., 2000. Age-related cognitive decline during normal aging: the complex effect of education. Archives of clinical neuropsychology, 15(6), pp.495- 513.
  4. Ardila, A. et al., 2007. The impact of culture on neuropsychological test performance. International handbook of cross-cultural neuropsychology, pp.23- 44.
  5. Ashford, J.W. et al., 2007. Should older adults be screened for dementia? It is important to screen for evidence of dementia! Alzheimer's & Dementia, 3(2), pp.75-80.
  6. Atkins, S.M. et al., 2014. Measuring working memory is all fun and games: A four-dimensional spatial game predicts cognitive task performance. Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie). Available at: http://psycontent.metapress.com/content/v8813723327 73455/?referencesMode=Show.
  7. Baniqued, P.L. et al., 2013. Selling points: What cognitive abilities are tapped by casual video games? Acta psychologica, 142(1), pp.74-86. Available at: http://www.pubmedcentral.nih.gov/articlerender.fcgi?a rtid=3679476&tool=pmcentrez&rendertype=abstract [Accessed September 1, 2014].
  8. Barnett, K. et al., 2012. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. The Lancet, 380(9836), pp.37-43.
  9. Brink, T.L. et al., 1982. The geriatric depression scale. Measuring health: A guide to rating scales and questionnaires, pp.259-263.
  10. Carvalho, A. et al., 2014. Physical activity and cognitive function in individuals over 60 years of age: a systematic review. Clinical interventions in aging, 9, p.661.
  11. Cawley, G.C. & Talbot, N.L.C., 2003. Efficient leave-oneout cross-validation of kernel Fisher discriminant classifiers. Pattern Recognition, 36(11), pp.2585-2592.
  12. Chaytor, N. & Schmitter-Edgecombe, M., 2003. The ecological validity of neuropsychological tests: A review of the literature on everyday cognitive skills. Neuropsychology review, 13(4), pp.181-197.
  13. Cockrell, J.R. & Folstein, M.F., 1987. Mini-Mental State Examination (MMSE). Psychopharmacology bulletin, 24(4), pp.689-692.
  14. Dehaene, S. & Changeux, J.-P., 1997. A hierarchical neuronal network for planning behavior. Proceedings of the National Academy of Sciences, 94(24), pp.13293-13298.
  15. F. Bermejo, Pareja J. Porta-Etessam, J. Díaz Guzmán, P.M.- M., 2008. Más de CIEN ESCALAS en NEUROLOGÍA, Gourovitch, M.L. et al., 2000. A comparison of rCBF patterns during letter and semantic fluency. Neuropsychology, 14(3), p.353.
  16. Groth-Marnat, G.E., 2000. Neuropsychological assessment in clinical practice: A guide to test interpretation and integration., John Wiley & Sons Inc.
  17. Hagler, S., Jimison, H.B. & Pavel, M., 2014. Assessing executive function using a computer game: Computational modeling of cognitive processes. IEEE Journal of Biomedical and Health Informatics, 18(4), pp.1442-1452. Available at: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnum ber=6732879.
  18. Hatcher, J., Snowling, M.J. & Griffiths, Y.M., 2002. Cognitive assessment of dyslexic students in higher education. British Journal of Educational Psychology, 72(1), pp.119-133.
  19. Herrmann, M.J. et al., 2005. Optical topography with nearinfrared spectroscopy during a verbal-fluency task. Journal of Psychophysiology, 19(2), pp.100-105.
  20. Hodges, J.R., 2007. Cognitive assessment for clinicians, Oxford University Press.
  21. Holtzman, D.M., Morris, J.C. & Goate, A.M., 2011. Alzheimer's disease: the challenge of the second century. Science translational medicine, 3(77), pp.77sr1-77sr1.
  22. Howieson, D.B. & Lezak, M.D., 2010. The neuropsychological evaluation. Essentials of Neuropsychiatry and Behavioral Neurosciences, pp.29-46.
  23. Jimison, H., Pavel, M. & Le, T., 2008. Home-based cognitive monitoring using embedded measures of verbal fluency in a computer word game. In Engineering in Medicine and Biology Society, 2008. EMBS 2008. 30th Annual International Conference of the IEEE. pp. 3312-3315. Available at: http://www.scopus.com/inward/record.url?eid=2-s2.0- 61849185753&partnerID=40&md5=d64b42435084eb 11eaa24a9a8be838cf.
  24. Jimison, H.B. et al., 2006. A framework for cognitive monitoring using computer game interactions. In Medinfo 2007: Proceedings of the 12th World Congress on Health (Medical) Informatics; Building Sustainable Health Systems. p. 1073.
  25. Kaye, J. et al., 2014. Unobtrusive measurement of daily computer use to detect mild cognitive impairment. Alzheimer's & dementia?: the journal of the Alzheimer's Association, 10(1), pp.10-7. Available at: http://www.ncbi.nlm.nih.gov/pubmed/23688576 [Accessed January 5, 2015].
  26. Kearns, M. & Ron, D., 1999. Algorithmic stability and sanity-check bounds for leave-one-out cross-validation. Neural Computation, 11(6), pp.1427-1453.
  27. Kelsey, J.L., 1996. Methods in observational epidemiology, Oxford University Press.
  28. Koenig, S. & Krch, D., 2012. User-centered development of a virtual reality cognitive assessment. In Proceedings of International Conference on Disability, Virtual Reality and Associated Technologies. pp. 10-12. Available at: http://www.icdvrat.reading.ac.uk/2012/papers/ICDVR AT2012_S08N2_Koenig_etal.pdf [Accessed November 22, 2014].
  29. Lamb, R.L. et al., 2014. Cognitive diagnostic like approaches using neural-network analysis of serious educational videogames. Computers & Education, 70, pp.92-104. Available at: http://linkinghub.elsevier.com/retrieve/pii/S03601315 13002303 [Accessed November 10, 2014].
  30. Letteri, C.A., 1980. Cognitive profile: Basic determinant of academic achievement. The Journal of Educational Research, 73(4), pp.195-199.
  31. Nolin, P. et al., 2013. Virtual Reality as a New Approach to Assess Cognitive Decline in the Elderly. Academic Journal of Interdisciplinary Studies, 2(8), p.612.
  32. of Neurology, A.A. & others, 1996. Assessment: Neuropsychological testing of adults. Considerations for neurologists. Neurology, 47(2), pp.592-599.
  33. Pazzi, S. et al., 2014. A Serious Games platform for early diagnosis of mild cognitive impairments. In Games for Health 2014. Springer, pp. 110-113.
  34. Pearl, J., 2014. Comment: Understanding Simpson's Paradox. The American Statistician, 68(1), pp.8-13.
  35. Reitan, R.M. & Wolfson, D., 2009. The Halstead--Reitan Neuropsychological Test Battery for AdultsTheoretical, Methodological, and Validational Bases. Neuropsychological assessment of neuropsychiatric and neuromedical disorders, 1.
  36. Rosenbaum, P.R., 2002. Observational studies, Springer.
  37. Rosselli, M. et al., 2009. Gender differences and cognitive correlates of mathematical skills in school-aged children. Child Neuropsychology, 15(3), pp.216-231.
  38. Scale-Third, W.D.W.M., 1997. Edition (WMS-III). San Antonio, TX: The Psychological Corporation.
  39. Spreen, O., 1998. A compendium of neuropsychological tests: Administration, norms, and commentary, Oxford University Press.
  40. Sternberg, D.A. et al., 2013. The largest human cognitive performance dataset reveals insights into the effects of lifestyle factors and aging. Frontiers in human neuroscience, 7.
  41. Strauss, E., Sherman, E.M.S. & Spreen, O., 2006. A compendium of neuropsychological tests: Administration, norms, and commentary, Oxford University Press.
  42. Stroop, J.R., 1935. Studies of interference in serial verbal reactions. Journal of experimental psychology, 18(6), p.643.
  43. Swihart, A.A. et al., 1989. The Token Test: Validity and diagnostic power in Alzheimer's disease. Developmental Neuropsychology, 5(1), pp.69-78.
  44. Tarnanas, I. et al., 2013. Ecological validity of virtual reality daily living activities screening for early dementia: longitudinal study. JMIR Serious Games, 1(1), p.e1.
  45. Teasdale, G. & Jennett, B., 1974. Assessment of coma and impaired consciousness: a practical scale. The Lancet, 304(7872), pp.81-84.
  46. Tenorio Delgado, M. et al., 2014. TENI: A comprehensive battery for cognitive assessment based on games and technology. Child Neuropsychology, (ahead-of-print), pp.1-16.
  47. Thompson, O. et al., 2012. Examining the neurocognitive validity of commercially available, smartphone-based puzzle games. Psychology, 3, p.525.
  48. Tombaugh, T.N., 2004. Trail Making Test A and B: normative data stratified by age and education. Archives of clinical neuropsychology, 19(2), pp.203- 214.
  49. Tong, T. & Chignell, M., 2014. Developing a serious game for cognitive assessment: choosing settings and measuring performance. In Proceedings of the Second International Symposium of Chinese CHI. pp. 70-79.
  50. Wallentin, M., 2009. Putative sex differences in verbal abilities and language cortex: A critical review. Brain and language, 108(3), pp.175-183.
  51. Watkins, M.W., 2000. Cognitive profile analysis: A shared professional myth.
  52. Wechsler, D., 1997. WAIS-III, Wechsler Adult Intelligence Scale: Administration and Scoring Manual, Psychological Corporation.
  53. Xu, G. et al., 2002. Screening for mild cognitive impairment (MCI) utilizing combined mini-mentalcognitive capacity examinations for identifying dementia prodromes. International journal of geriatric psychiatry, 17(11), pp.1027-1033.
  54. Zucchella, C. et al., 2014. Serious games for screening predementia conditions: From virtuality to reality? a pilot project. Functional Neurology, 29(3), pp.153-158. Available at: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC42647 81/.
  55. Zygouris, S. et al., 2014. Can a Virtual Reality Cognitive Training Application Fulfill a Dual Role? Using the Virtual Supermarket Cognitive Training Application as a Screening Tool for Mild Cognitive Impairment. Journal of Alzheimer's Disease.
Download


Paper Citation


in Harvard Style

M. Valladares Rodríguez S., Pérez Rodríguez R., E. Anido Rifón L. and J. Fernández Iglesias M. (2015). Cognitive Assessment through “Casual Video Games” and Machine Learning - Doctoral Consortium Contributions . In Doctoral Consortium - DCICT4AW, (ICT4AgeingWell 2015) ISBN , pages 3-11


in Bibtex Style

@conference{dcict4aw15,
author={Sonia M. Valladares Rodríguez and Roberto Pérez Rodríguez and Luis E. Anido Rifón and Manuel J. Fernández Iglesias},
title={Cognitive Assessment through “Casual Video Games” and Machine Learning - Doctoral Consortium Contributions},
booktitle={Doctoral Consortium - DCICT4AW, (ICT4AgeingWell 2015)},
year={2015},
pages={3-11},
publisher={SciTePress},
organization={INSTICC},
doi={},
isbn={},
}


in EndNote Style

TY - CONF
JO - Doctoral Consortium - DCICT4AW, (ICT4AgeingWell 2015)
TI - Cognitive Assessment through “Casual Video Games” and Machine Learning - Doctoral Consortium Contributions
SN -
AU - M. Valladares Rodríguez S.
AU - Pérez Rodríguez R.
AU - E. Anido Rifón L.
AU - J. Fernández Iglesias M.
PY - 2015
SP - 3
EP - 11
DO -