Use of Biological Motion based Cues and Ecological Sounds in the Neurorehabilitation of Apraxia

Marta Bieńkiewicz, Georg Goldenberg, José M. Cogollor, Manuel Ferre, Charmayne Hughes, Joachim Hermsdörfer


Technological progress in the area of informatics and human interface platforms create a window of opportunities for the neurorehablitation of patients with motor impairments. The CogWatch project ( aims to create an intelligent assistance system to improve motor planning and execution in patients with apraxia during their daily activities. Due to the brain damage caused by cardiovascular incident these patients suffer from impairments in the ability to use tools, and to sequence actions during daily tasks (such as making breakfast). Based on the common coding theory (Hommel et al., 2001) and mirror neuron primate research (Rizzolatti et al., 2001) we aim to explore use of cues, which incorporate aspects of biological motion from healthy adults performing everyday tasks requiring tool use and ecological sounds linked to the action goal. We hypothesize that patients with apraxia will benefit from supplementary sensory information relevant to the task, which will reinforce the selection of the appropriate motor plan. Findings from this study determine the type of sensory guidance in the CogWatch interface. Rationale for the experimental design is presented and the relevant literature is discussed.


  1. Amblard, B., Cremieux, J., Marchand, A. R., & Carblanc, A. (1985). Lateral orientation and stabilization of human stance: Static versus dynamic visual cues. Experimental Brain Research, 61(1), 21-37.
  2. Bickerton, W., Riddoch, J., Samson, D., Balani,A., Mistry, B., & Humphreys, G., (2012). Systematic assessment of apraxia and functional predictions from the Birmingham Cognitive Screen, Journal of neurology, neurosurgery & psychiatry with practical neurology, 83 (5), 513-52.
  3. Christensen, A., Ilg, W., & Giese, M. A. (2011). Spatiotemporal tuning of the facilitation of biological motion perception by concurrent motor execution. The Journal of Neuroscience, 31(9), 3493-3499.
  4. Cooper, R. P.; Schwartz, M.; Yule, P. & Shallice, T. (2005). The simulation of action disorganisation in complex activities of daily living. Cognitive Neuropsychology 22 (8) 959-1004.
  5. De Renzi, E., Faglioni, P., & Sorgato, P. (1982) Modality specific and supramodal mechanisms of apraxia. Brain, 105, 301-312.
  6. Fadiga, L., Fogassi, L., Pavesi, G., & Rizzolatti G. (1995) Motor facilitation during action observation: a magnetic stimulation study, Journal of Neurophysiology, 73, 2608-2611.
  7. Gallese,V., & Goldman, A., (1998). Mirror neurons and the simulation theory of mind-reading, Trends in Cognitive Sciences, 2(12), 493-501.
  8. Giachristis, C., & Randall, G. (submitted) CogWatch: Cognitive Rehabilitation for Apraxia and Action Disorganization Syndrome Patients. 6th International Conference of Health Informatics.
  9. Gibson, J. J. (1950). Perception of the visual world. Boston: Houghton Mifflin.
  10. Goldenberg, G., Hermsdörfer, J., Glindemann, R., Rorden, C., & Karnath, H. O. (2007). Pantomime of tool use depends on integrity of left inferior frontal cortex. Cerebral Cortex, 17, 2769-2776.
  11. Goldenberg, G., & Hagmann, S. (1998) Therapy of activities of daily living in patients with apraxia. Neuropsychological Rehabilitation, 8(2), 123-41.
  12. Goldenberg, G., Hermsdörfer, J., & Spatt, J. (1996). Ideomotor apraxia and cerebral dominance for motor control. Cognitive Brain Research, 3, 95-100.
  13. Goodale, M. A., & Keith Humphrey, G. (1998). The objects of action and perception. Cognition, 67(1-2), 181-207.
  14. Grassi, M. (2005). Do we hear size or sound? balls dropped on plates. Attention, Perception, & Psychophysics, 67(2), 274-284.
  15. Gross, R., & Grossman, M. (2008). Update on apraxia. Current neurology and neuroscience reports, 8 (6), 490-496.
  16. Hazell, A. (2012) CogWatch - Cognitive Rehabilitation of Apraxia and Action Disorganisation Syndrome: Assessing the requirements of Healthcare Professionals, Stroke Survivors and Carers. UK Stroke Forum Conference 2012 Proceedings.
  17. Hanna-Pladdy, B., Heilman, K.M., & Foundas, A.L. (2003) Ecological implications of ideomotor apraxia: evidence from physical activities of daily living. Neurology, 60, 487-490.
  18. Hermsdörfer, J., Hentze, S., & Goldenberg, G. (2006) Spatial and kinematic features of apraxic movement depend on the mode of execution. Neuropsychologia, 44, 1642-1652.
  19. Hommel, B., Müsseler, J., Aschersleben, G., & Prinz, W. (2001). The theory of event coding (TEC): A framework for perception and action planning. Behavioral and Brain Sciences, 24(05), 849.
  20. Horstink, M., De Swart, B., Wolters, E., & Berger, H. (1993). Paradoxical behavior in Parkinson's disease. In: E. C Wolters, & P. Scheltens (Eds). Mental dysfunction in Parkinson's disease; proceedings of the European congress on mental dysfunction in Parkinson's disease. Amsterdam: Vrije Universiteit, 1993. Proceedings of the European Congress on Mental Dysfunction in Parkinson's Disease.
  21. Houben, M., Kohlrausch, A., & Hermes, D. (2005). The contribution of spectral and temporal cues to the auditory perception of size and speed of rolling balls. Acta Acustica United with Acustica, 91(6), 1007.
  22. Jackson, P., Meltzoff, A., & Decety, J. (2006) Neural circuits involved in imitation and perspective-taking. Neuroimage, 15 (31), 429-439.
  23. Jason, G. W. (1983). Hemispheric asymmetries in motor function: Left hemisphere specialization for memory but not performance. Neuropsychologia, 21 (1), 35-45.
  24. Keysers, C., Kohler, E., Umiltà, M.A., Nanetti, L., Fogassi, L., & Gallese, V. (2003). Audiovisual mirror neurons and action recognition, Experimental Brain Research, 153 (4), 628-636.
  25. Kohler, E., Keysers, C., Umilta, M., Fogassi, L., Gallese, V., & Rizzolatti, G. (2002). Hearing sounds, understanding actions: action representation in mirror neurons. Science, 297, 846-848.
  26. Laimgruber, K., Goldenberg, G., & Hermsdörfer, J. (2005) Manual and hemispheric asymmetries in the execution of actual and pantomimed prehension, Neuropsychologia, 43(5), 682-692.
  27. Lakatos, S., McAdams, S., & Caussé, R. (1997). The representation of auditory source characteristics: Simple geometric form. Attention, Perception, & Psychophysics, 59(8), 1180-1190.
  28. Meltzoff, A. N., & Moore, K. (1977) Imitation of Facial and Manual Gestures by Human Neonates, Science 198 (4312), 75-78.
  29. Nieuwboer, A., Kwakkel, G., Rochester, L., Jones, D., van Wegen, E., Willems, A. M. et al. (2007). Cueing training in the home improves gait-related mobility in Parkinson's disease: The RESCUE trial. Journal of Neurology, Neurosurgery & Psychiatry, 78(2), 134- 140.
  30. Petreska, B., Adriani, M., Blanke, O. & Billard, A. (2007) Apraxia: a review. In C. von Hofsten (Ed.). From Action to Cognition. Progress in Brain Research. Elsevier. Amsterdam. Vol. 164, pp. 61-83
  31. Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9 (2), 129-154.
  32. Redgrave, P., Rodriguez, M., Smith, Y., Rodriguez-Oroz, M., Lehericy, S., Bergman, H., et al. (2010). Goaldirected and habitual control in the basal ganglia: Implications for Parkinson's disease. Nature Reviews. Neuroscience, 11(11), 760-772.
  33. Rizzolatti, G., Fogassi, L., & Gallese, V. (2001) Neurophysiological mechanisms underlying the understanding and imitation of action. Nature Reviews. Neuroscience, 2(9), 661-670.
  34. Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27(1), 169- 192.
  35. Schwartz, M. F., Montgomery, M. W., Fitzpatrickdesalme, E. J., Ochipa, C., Coslett, H. B., & Mayer, N. H. (1995). Analysis of a disorder of everyday action. Cognitive Neuropsychology, 12, 863-892.
  36. Seelye, A., Schmitter-Edgecombe, M., Das, B., & Cook, D. (2011). Application of Cognitive Rehabilitation Theory to the Development of Smart Prompting Technologies, Biomedical Engineering, IEEE Reviews, 99, pp.1, 0.
  37. Sveistrup, H. (2004). Motor rehabilitation using virtual reality. Journal of NeuroEngineering and Rehabilitation, 1(1), 10.
  38. Tanaka, S., & Inui, T. (2002) Cortical involvement for action imitation of hand/arm postures versus finger configuration : An fMRI study, NeuroReport 13, 1599-1602.
  39. Thaut, M. H., Kenyon, G. P., Hurt, C. P., McIntosh, G. C., & Hoemberg, V. (2002). Kinematic optimization of spatiotemporal patterns in paretic arm training with stroke patients. Neuropsychologia, 40(7), 1073-1081.
  40. Ticini, L.F., Schutz-Bosbach, S., Weiss, C., Casile, A., & Waszak, F. (2012). When sounds become actions: higher-order representation of newly learned action sounds in the human motor system. Journal of Cognitive Neuroscience, 24(2), 464-474.
  41. Young, W.R., Rodger, M.W.M., & Craig, C.M. (2012) Using ecological event-based acoustic guides to cue gait in Parkinson's disease patients [abstract]. Movement Disorders, 27 Suppl 1 :119.
  42. Zahariev, M., & MacKenzie, C. (2007). Grasping at 'thin air': Multimodal contact cues for reaching and grasping. Experimental Brain Research, 180(1), 69- 84.

Paper Citation

in Harvard Style

Bieńkiewicz M., Goldenberg G., M. Cogollor J., Ferre M., Hughes C. and Hermsdörfer J. (2013). Use of Biological Motion based Cues and Ecological Sounds in the Neurorehabilitation of Apraxia . In Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2013) ISBN 978-989-8565-37-2, pages 221-227. DOI: 10.5220/0004237902210227

in Bibtex Style

author={Marta Bieńkiewicz and Georg Goldenberg and José M. Cogollor and Manuel Ferre and Charmayne Hughes and Joachim Hermsdörfer},
title={Use of Biological Motion based Cues and Ecological Sounds in the Neurorehabilitation of Apraxia},
booktitle={Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2013)},

in EndNote Style

JO - Proceedings of the International Conference on Health Informatics - Volume 1: HEALTHINF, (BIOSTEC 2013)
TI - Use of Biological Motion based Cues and Ecological Sounds in the Neurorehabilitation of Apraxia
SN - 978-989-8565-37-2
AU - Bieńkiewicz M.
AU - Goldenberg G.
AU - M. Cogollor J.
AU - Ferre M.
AU - Hughes C.
AU - Hermsdörfer J.
PY - 2013
SP - 221
EP - 227
DO - 10.5220/0004237902210227