PLATFORM TO DRIVE AN INTELLIGENT WHEELCHAIR USING FACIAL EXPRESSIONS

Pedro Miguel Faria, Rodrigo A. M. Braga, Eduardo Valgôde, Luís Paulo Reis

Abstract

Many of the physically injured use electric wheelchairs as an aid to locomotion. Usually, for commanding this type of wheelchair, it is required the use of one’s hands and this poses a problem to those who, besides being unable to use their legs, are also unable to properly use their hands. The aim of the work described here, is to create a prototype of a wheelchair command interface that do not require hand usage. Facial expressions were chosen instead, to provide the necessary visual information for the interface to recognize user commands. The facial expressions are captured by a digital camera and interpreted by an application running on a laptop computer on the wheelchair. The software includes digital image processing algorithms for feature detection, such as colour segmentation and edge detection, followed by the application of a neural network that uses these features to detect the desired facial expressions. A simple simulator, built on top of the known (Ciber-Mouse) was used to validate the approach by simulating the control of the intelligent wheelchair in a hospital environment. The results obtained from the platform provide strong evidence that it is possible to comfortably drive an intelligent wheelchair using facial expressions.

References

  1. Aas, Kjersti 1996. Audio-Visual Person Recognition: A Survey, Report no. 911, Norwegian Computing Center
  2. Alekic, Peter et al. 2006. Automatic Facial expression recognition using facial animation parameters and multi-stream HMMs. IEEE Signal Processing Society
  3. Bartlett, M. et al 2003. Real Time Face detection and facial expression recognition: Development and Applications to Human Computer Interaction. CVPR Workshop on Computer Vision and Pattern Recognition for Human-Computer Interaction
  4. Cohen, Ira et al 2003a. Facial expression recognition from video sequences. Computer Vision and Image Understanding, Volume 91, Issues 1-2, Pages 160- 187, Special Issue on Face Recognition
  5. Cohen, Ira et al. 2003b. Semi-Supervised Learning for Facial Expression Recognition, 5th ACM SIGMM International Workshop on Multimedia Information Retrieval
  6. Ekman & Friesen 1978. Facial action coding system: A technique for the measurement of facial movement. Consulting Psychologists Press
  7. Franco, Leonardo 2001. A Neural Network Face Expression Recognition System using Unsupervised Local Processing. Proceedings of the Second International Symposium on Image and Signal Processing and Analysis (ISPA 01), Croatia, pp. 628- 632, June 19-21
  8. Frank, Carmen & Nöth 2003, E., Automatic Pixel Selection for Optimizing Facial Expression Recognition using Eigenfaces, Pattern Recognition 25th DAGM Symposium
  9. Gonzalez, Rafael C. & Woods, Richard E. 2002. Digital Image Processing. Prentice-Hall
  10. Haykin, Simon 1999. Neural Networks - A Comprehensive Foundation. Prentice-Hall
  11. Matsumoto, Y. and Zelinsky, A., 1999. Real-time Face Tracking System for Human-Robot Interaction. Proceedings of the 1999 IEEE International Conference on Systems, Man and Cybernetics (SMC99), Vol. 2, pp. 830-835.
  12. Wei, Y., 2004. Vision-based Human-robot Interaction and Navigation of Intelligent Service Robots. PhD Dissertation, Institute of Automation, Chinese Academic of Sciences, Beijing, China.
Download


Paper Citation


in Harvard Style

Miguel Faria P., A. M. Braga R., Valgôde E. and Paulo Reis L. (2007). PLATFORM TO DRIVE AN INTELLIGENT WHEELCHAIR USING FACIAL EXPRESSIONS . In Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 5: ICEIS, ISBN 978-972-8865-92-4, pages 164-169. DOI: 10.5220/0002394101640169


in Bibtex Style

@conference{iceis07,
author={Pedro Miguel Faria and Rodrigo A. M. Braga and Eduardo Valgôde and Luís Paulo Reis},
title={PLATFORM TO DRIVE AN INTELLIGENT WHEELCHAIR USING FACIAL EXPRESSIONS},
booktitle={Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 5: ICEIS,},
year={2007},
pages={164-169},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002394101640169},
isbn={978-972-8865-92-4},
}


in EndNote Style

TY - CONF
JO - Proceedings of the Ninth International Conference on Enterprise Information Systems - Volume 5: ICEIS,
TI - PLATFORM TO DRIVE AN INTELLIGENT WHEELCHAIR USING FACIAL EXPRESSIONS
SN - 978-972-8865-92-4
AU - Miguel Faria P.
AU - A. M. Braga R.
AU - Valgôde E.
AU - Paulo Reis L.
PY - 2007
SP - 164
EP - 169
DO - 10.5220/0002394101640169