Robotics Enabled Augmented Health

Artur Arsenio


Nowadays it is increasingly important, for social and economic reasons, to provide augmented health assistance for people at home. This will mostly benefit some specific user groups, such as elderly, patients recovering from physical injury, or athletes. This chapter describes the application of robotics, under the scope of the Augmented Human Assistance (AHA) project, for assisting people health. Two complementary and interacting approaches are described. The first consists on a mobile robot nurse, that assists patients and elderly on their daily lives, such as for advising on medicine intake, or providing complementary biomedical sensing equipment for health monitoring. The other approach consists of multimodal feedback assistance through augmented reality, haptic sensing and audio, in order to guide and assist people on the execution of exercises at home.


  1. Arsenio, A., Andrade, J., Duarte, A.: Non-invasive Wireless Bio Sensing. Accepted for publication at Lecture Notes in Computer Science, series Communications in Computer and Information Science (CCIS), Springer-Verlag (2015)
  2. Sigrist, R., Rauter, G., Riener, R., Wolf, P.: Augmented Visual, Auditory, Haptic, and multimodal feedback in motor learning: A review. Psychonomic bulletin & review 20, 1 (Feb. 2013), 21-53
  3. Tang, R., Alizadeh, H., Tang, A., Bateman, S., Jorge, J. Physio@Home: design explorations to support movement guidance. CHI 7814 Extended Abstracts on Human Factors in Computing Systems (2014)
  4. World health statistics 2012. World Health Organization, 2012
  5. Bemelmans, R., Gelderblom, G., Jonker, P., de Witte, L.: Socially assistive robots in elderly care: A systematic review into effects and effectiveness. Journal of the American Medical Directors Association 13.2 (2012), 114-120
  6. Broekens, J., Heerink, M., Rosendal, H.: Assistive social robots in elderly care: a review. Gerontechnology 8.2 (2009), 94-103
  7. Mataric M., Eriksson J., Feil-Seifer D.: Socially assistive robotics for post-stroke rehabilitation. Journal of Neuro Engineering and Rehabilitation 4.5 (2007)
  8. Scassellati, B.: How social robots will help us to diagnose, treat, and understand autism. Robotics research. Springer Berlin Heidelberg, (2007), 552-563
  9. Cory, K., Breazeal. C.: Robots at home: Understanding long-term human-robot interaction. IEEE/RSJ IROS International Conference on Intelligent Robots and Systems, IEEE (2008)
  10. Pineau, J., Montemerlo, M., Pollack, M., Roy, N., Thrun, S.: Towards robotic assistants in nursing homes: Challenges and results. Special issue on Socially Interactive Robots, Robotics and Autonomous Systems 42.3 (2003), 271-281
  11. Rincon, F., Vibbert, M., Childs, V., Fry, R., Caliguri, D., Urtecho, J., Rosenwasser, R., Jallo, J.: Implementation of a model of robotic tele-presence (RTP) in the Neuro-ICU: effect on critical care nursing team satisfaction. Neurocritical care 17.1 (2012), 97-101
  12. Wada, K., Shibata, T.: Robot Therapy for Elders Affected by Dementia. Engineering in medicine and biology magazine, 27 (2008), 53-60
  13. Wong, B., Norman, D.: Evaluation of a Novel Medication Aid, the Calendar Blister-pak, and its effect on drug compliance in a geriatric outpatient clinic. Journal of the American Geriatrics Society (1987)
  14. Castellano, G., Paiva, A., Kappas, A., Aylett, R., Hastie, H., Barendregt, W., Nabais, F., Bull, S.: Towards Virtual and Robotic Empathic Tutors. 16th International Conference on Artificial Intelligence in Education (AIED'13), Memphis, USA. In H.C. Lane & K. Yacef (eds), Artificial Intelligence in Education Springer-Verlag, Berlin Heidelberg (July 2013)
  15. Gonçalves, D., Arsenio, A.: Human-driven multi-robot design process for social interactions with children on complex environments. 2015 6th International Conference on Automation, Robotics and Applications (Feb. 2015), 70-76
  16. Pinto, A., Almeida, J., Pinto, S., Pereira, J., Oliveira, A., de Carvalho, M.: Home telemonitoring of non-invasive ventilation decreases healthcare utilisation in a prospective controlled trial of patients with amyotrophic lateral sclerosis. Journal of Neurology, Neurosurgery & Psychiatry (2010)
  17. Lim, J., Zitnick, C., Dollár, P.: Sketch Tokens: A Learned Mid-level Representation for Contour and Object Detection. CVPR, Portland, Oregon (2013)
  18. Girshick, R., Felzenszwalb, P., Mcallester, D.: Object detection with grammar models." Advances in Neural Information Processing Systems (2011)
  19. Arsenio, A.: Cognitive-developmental learning for a humanoid robot: a caregiver's gift. MIT. PhD thesis (2004)
  20. Yang, Y., Ge, S., Lee, T., Wang, C.: Facial expression recognition and tracking for intelligent human-robot interaction. Intelligent Service Robotics 1.2 (2008), 143-157
  21. Saponaro, G., Salvi, G., Bernardino, A.: Robot Anticipation of Human Intentions through Continuous Gesture Recognition, CR-HRI (2013)
  22. Goffredo, M., Seely, R., Carter, J., Nixon, M.: Markerless view independent gait analysis with self-camera calibration, In Proceedings of International Conference on Automatic Face and Gesture Recognition (2008)
  23. Chang, C., Lange, B., Zhang, M.: Towards Pervasive Physical Rehabilitation using Microsoft Kinect. 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) (2012), 159-162
  24. Scano, A., Caimmi, M., Malosio, M., Tosatti, L.: Using Kinect for upper-limb functional evaluation in home rehabilitation: A comparison with a 3D stereoscopic passive marker system. 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics (Aug. 2014), 561-566
  25. Borghese, N., Mainetti, R., Pirovano, M., Lanzi, P.: An intelligent game engine for the athome rehabilitation of stroke patients. IEEE 2nd International Conference on Serious Games and Applications for Health (SeGAH) (May 2013), 1-8
  26. Kitsunezaki, N., Adachi, E., Masuda, T., Mizusawa, J.: KINECT applications for the physical rehabilitation. IEEE International Symposium on Medical Measurements and Applications (MeMeA) (May 2013), 294-299
  27. Gama, A., Chaves, T., Figueiredo, L., Teichrieb, V.: Guidance and Movement Correction Based on Therapeutics Movements for Motor Rehabilitation Support Systems. 14th Symposium on Virtual and Augmented Reality (May 2012), 191-200
  28. Burke, J., McNeill, M., Charles, D., Morrow, P., Crosbie, J., McDonough, S. Serious Games for Upper Limb Rehabilitation Following Stroke. Conference in Games and Virtual Worlds for Serious Applications (Mar. 2009), 103-110
  29. Sadihov, D., Migge, B., Gassert, R.: Prototype of a VR upper-limb re-habilitation system enhanced with motion-based tactile feedback. World Haptics Conference (WHC) (Apr. 2013), 449-454
  30. Schonauer, C., Pintaric, T.: Full Body Interaction for Serious Games in Motor Rehabilitation. Proceedings of the 2nd Augmented Human International Conference, ACM Press (2011), 1-8
  31. Rego, P., Moreira, P., Reis, L.: Serious games for rehabilitation: A survey and a classification towards a taxonomy. 5th Iberian Conference on Information Systems and Technologies (CISTI 2010).
  32. Adherence to long-term therapies: evidence for action. World Health Organization (2003)
  33. Huang, H., Ingalls, T., Olson, L., Ganley, K., Rikakis, T., He, J.: Interactive multimodal biofeedback for task-oriented neural rehabilitation. 27th Annual International Conference of the Engineering in Medicine and Biology Society, IEEE-EMBS (2005), 2547-2550
  34. Garn, A., Baker, B., Beasley, E., Solmon, M.: What are the benefits of a commercial exergaming platform for college students? Examining physical activity, enjoyment, and future intentions. Journal of physical activity & health 9.2 (2012), 311-8
  35. Staiano, A., Calvert, S.: Exergames for physical education courses: Physical, social, and cognitive benefits. Child Development Perspectives 5.2 (2011), 93- 98
  36. Singh, A., Klapper, A., Jia, J.: Motivating people with chronic pain to do physical activity: opportunities for technology design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2014), 2803-2812
  37. Lohse, K., Shirzad, N., Verster, A.: Video Games and Rehabilitation: Using Design Principles to Enhance Engagement in Physical Therapy. Journal of Neurologic Physical Therapy 37, 4 (Dec. 2013), 166-75
  38. Laver, K., George, S., Thomas, S., Deutsch, J., Crotty, M.: Cochrane review: virtual reality for stroke rehabilitation,” Eur J Phys Rehabil Med, 48.3 (Sep. 2012), 523-530
  39. Cameirão, M., Bermúdez, S., Verschure, P.: Virtual reality based upper extremity rehabilitation following stroke: A review. Journal of CyberTherapy & Rehabilitation, 1.1 (2008)
  40. Lucca, L.: Virtual reality and motor rehabilitation of the upper limb after stroke: a generation of progress?. Journal Rehabilitation Medicine, 41.12 (Nov. 2009), 1003-1100
  41. Raskara, R., Ziegler, R., Willwacher, T.: Cartoon dioramas in motion. Proceedings of the 2nd international symposium on non-photorealistic animation and rendering (2002), 7-13
  42. Bandyopadhyay, D., Raskar, R., Fuchs, H.: Dynamic Shader Lamps: Painting on Movable Objects. IEEE/ACM international symposium on mixed and augmented reality (2001)
  43. Raskar, R., van Baar, J., Beardsley, P., Willwacher, T., Rao, S., Forlines, C.: iLamps: Geometrically Aware and Self-Configuring Projectors. ACM Transactions on Graphics (TOG), ISSN: 0730-0301, 22.3 (July 2003), 809-818
  44. Wilson, A., Benko, H.: Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces. In Proceedings of ACM UIST 7810 (2010), 273-282
  45. Yang, R., Gotz, D., Hensley, J., Towles, H., Brown, M.: Pixelflex: A reconfigurable multiprojector display system. Proceedings of the conference on Visualization (2001), 167-174
  46. Azuma, K., Miyashita, S.: Anamorphosis Projection by Ubiquitous Display in Intelligent Space. Proc. int. conf. universal access in human-computer interaction (2009), 209-217
  47. Harris, C.: Tracking with rigid models. In Active vision, MIT Press Cambridge, MA, USA (1993), 59-73
  48. Schkolne, S., Pruett, M., Schröder, P.: Surface drawing: creating organic 3D shapes with the hand and tangible tools. Proceedings of SIGCHI Conference on Human Factors in Computing Systems (2001), 261-268
  49. Jung, H., Nam, T., Lee, H., Han, S.: Spray modeling: Augmented reality based 3D modeling interface for intuitive and evolutionary form development. Proceedings of the International Conference on Artificial Reality and Telexistence (2004)
  50. Sodhi, R., Benko, H., Wilson, A.: LightGuide: projected visualizations for hand movement guidance. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (2012)
  51. Costa, N., Arsenio A.: Augmented Reality behind the wheel - Human Interactive Assistance by Mobile Robots. 6th International Conference on Automation, Robotics and Applications (Feb. 2015), 63 - 69

Paper Citation

in Harvard Style

Arsenio A. (2015). Robotics Enabled Augmented Health . In European Project Space on Intelligent Systems, Pattern Recognition and Biomedical Systems - EPS Lisbon, ISBN 978-989-758-095-6, pages 33-52. DOI: 10.5220/0006162300330052

in Bibtex Style

@conference{eps lisbon15,
author={Artur Arsenio},
title={Robotics Enabled Augmented Health},
booktitle={European Project Space on Intelligent Systems, Pattern Recognition and Biomedical Systems - EPS Lisbon,},

in EndNote Style

JO - European Project Space on Intelligent Systems, Pattern Recognition and Biomedical Systems - EPS Lisbon,
TI - Robotics Enabled Augmented Health
SN - 978-989-758-095-6
AU - Arsenio A.
PY - 2015
SP - 33
EP - 52
DO - 10.5220/0006162300330052