Improving Isometric Hand Gesture Identification for HCI based on Independent Component Analysis in Bio-signal Processing

Ganesh R. Naik, Dinesh K. Kumar, Hans Weghorn, Vijay P. Singh, Marimuthu Palaniswami

Abstract

Hand gesture identification has various human computer interaction (HCI) applications. There is an urgent need for establishing a simple yet robust system that can be used to identify subtle complex hand actions and gestures for control of prosthesis and other computer assisted devices. Here, an approach is explained to demonstrate how hand gestures can be identified from isometric muscular activity, where signal level is low and changes are very subtle. Obvious difficulties arise from a very poor signal to noise ratio in the recorded electromyograms (EMG). Independent component analysis (ICA) is applied to separate these low-level muscle activities. The order and magnitude ambiguity of ICA have been overcome by using a priori knowledge of the hand muscle anatomy and a fixed un-mixing matrix. The classification is achieved using a back-propagation neural network. Experimental results are shown, where the system was able to reliably recognize motionless gestures. The system was tested across users to investigate the impact of inter-subject variation. The experimental results demonstrate an overall accuracy of 96%, and the system was shown being insensitive against electrode positions, since these successful experiments were repeated on different days. The advantage of such a system is, that it is easy to train by a lay user, and that it can easily be implemented as real-time processing after an initial training. Hence, EMG-based input devices can provide an effective solution for designing mobile interfaces that are subtle and intimate, and there exist a range of applications for communication, emotive machines and human computer interface.

References

  1. Pavlovic, V. I., Sharma, R., Huang, T. S.: Visual interpretation of hand gestures for human computer interaction, Vol. 19. IEEE Transactions on Pattern Analysis and Machine Intelligence (1997) 677 - 695
  2. Rehg, J. M., Kanade, T.: Vision-based hand tracking for human-computer interaction, IEEE, Workshop on Motion of Non-Rigid and Articulated Objects (1994) 16 - 22
  3. Koike, Y., Kawato, M.: Human Interface Using Surface Electromyography Signals, Vol. 79. Electronics and Communications, Japan (1996) 15 - 22
  4. Luca, C. J. D.: Physiology and mathematics of myoelectric signals. Vol. 266. IEEE Transactions on Biomedical Engineering (1979)
  5. Oakley, I., Angesleva, J., Hughes, S., O'Modhrain, S.: Tilt and Feel: Scrolling with Vibrotactile Display, The EuroHaptics (2004)
  6. Rekimoto, J.: Gesture Wrist and Gesture Pad: Unobtrusive Wearable Interaction Devices, Fifth IEEE International Symposium on Wearable Computers (2001)
  7. Headon, R., Coulouris, G.: Supporting Gestural Input for Users on the Move, IEE Eurowearable (2003) 107-112
  8. Wheeler, K. R., Jorgensen, C. C.: Gestures as input: Neuroelectric joysticks and keyboards. Vol. 2. IEEE Pervasive Computing (2003) 56-61
  9. Trejo, L. J., Wheeler, K. R., Jorgensen, C. C., Rosipal, R., Clanton, T. S., Matthews, B., Hibbs, A. D., Matthews, R., Krupka, M.: Multimodal neuroelectric interface development, Vol. 11. IEEE Transactions on Neural Systems and Rehabilitation Eng. (2003) 199- 204
  10. Chan, A. D. C., Englehart, K. B.: Continuous myoelectric control for powered prostheses using hidden markov models, Vol. 52. IEEE Transactions on Biomedical Engineering (2005) 121-124
  11. Fistre, J., Tanaka, A.: Real time EMG gesture recognition for consumer electronics device control, Presented at Sony CSL Paris Open House, http://www.csl.sony.fr/ atau/gesture/ (2002)
  12. Hyvarinen, A., Karhunen, J., Oja, E.: Independent Component Analysis, John Wiley, New York (2001)
  13. Jung, T., Makeig, S., Lee, T., McKeon, M., Brown, G., Bell, A., Sejnowski, T. : Independent component analysis of biomedical signals, Second International Workshop on Independent Component Analysis and Blind Signal Separation (2001) 633-644
  14. Makeig, S., Jung, T., Bell, A., Sejnowski, T.: Independent component analysis of electroencephalographic data, Vol. 8. Advances in neural information processing systems (1996) 145-151
  15. Hyvarinen, A., Oja, E.: Fast fixedpoint algorithm for independent component analysis, The Fast ICA matlab software package, http://www.cis.hut.fi/projects/ica/fastica/index.shtml (1997)
Download


Paper Citation


in Harvard Style

R. Naik G., K. Kumar D., Weghorn H., P. Singh V. and Palaniswami M. (2007). Improving Isometric Hand Gesture Identification for HCI based on Independent Component Analysis in Bio-signal Processing . In Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007) ISBN 978-972-8865-93-1, pages 171-180. DOI: 10.5220/0002427301710180


in Bibtex Style

@conference{pris07,
author={Ganesh R. Naik and Dinesh K. Kumar and Hans Weghorn and Vijay P. Singh and Marimuthu Palaniswami},
title={Improving Isometric Hand Gesture Identification for HCI based on Independent Component Analysis in Bio-signal Processing},
booktitle={Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007)},
year={2007},
pages={171-180},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002427301710180},
isbn={978-972-8865-93-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Workshop on Pattern Recognition in Information Systems - Volume 1: PRIS, (ICEIS 2007)
TI - Improving Isometric Hand Gesture Identification for HCI based on Independent Component Analysis in Bio-signal Processing
SN - 978-972-8865-93-1
AU - R. Naik G.
AU - K. Kumar D.
AU - Weghorn H.
AU - P. Singh V.
AU - Palaniswami M.
PY - 2007
SP - 171
EP - 180
DO - 10.5220/0002427301710180