Development and Evaluation of Human-Computer Interface based on Facial Motor Unit Activity

Carlos M. M. Queiroz, Slawomir J. Nasuto, Adriano O. Andrade

2014

Abstract

Interfaces that enable human-computer interaction have progressed significantly. In the past decade a lot of effort has been directed to the development and improvement of perceptual interfaces, i.e., interfaces that promote interaction with the computer without the use of conventional keyboard or mouse. This type of interface combines the understanding of natural human capabilities (e.g., communication, motor, cognitive and perceptual skills) with the use of these for interaction with the computer, taking into account the ways in which people naturally interact with each other and with the world. The search for more natural forms of interaction has directed recent research for the study of biological signals that have the potential to encode control strategies adopted by the central nervous system (CNS). In this context, information obtained through the activity of motor units - such as firing rate, waveform of action potentials and recruitment strategy - can be used in the development of human-computer interfaces. Therefore, this research proposes in an unprecedented manner, the development and evaluation of a human-computer interface based on information extracted from motor units (MUs). The interface development will consist of two steps: i) preparation of a flexible sensor array capable of detecting activity of MUs of facial muscles; ii) implementation of tools for signal processing capable of extracting information from MUs and translation of this information into control signals. The evaluation of the interface will consider: i) the quantification of learning related to the use of the interface; ii) the analysis of the correlation between learning and the dynamics of neural oscillation obtained by means of electroencephalographic signals; iii) the comparison of the new proposed interface with the Muscle Academy (Andrade et al., 2012), which is a myoelectric interface recently developed by our research group

References

  1. Ahsan, M. R., Ibrahimy, M. I. & Khalifa, O. O. 2009. Emg Signal Classification For Human Computer Interaction: A Review. European Journal Of Scientific Research, 33, 480-501.
  2. Andrade, A. O., Bourhis, G., Losson, E., Naves, E. L. M., Pinheiro, C. G., Jr. & Pino, P. 2011. Alternative Communication Systems For People With Severe Motor Disabilities: A Survey. Biomedical Engineering Online, 10, 31.
  3. Andrade, A. O., Pereira, A. A. & Kyberd, P. J. 2012. Mouse Emulation Based On Facial Electromyogram. Biomedical Signal Processing And Control.
  4. Bourhis, G., Pino, P. & Leal-Olmedo, A. Communication Devices For Persons With Motor Disabilities: HumanMachine Interaction Modeling. Systems, Man And Cybernetics, 2002 Ieee International Conference On, 2002. Ieee, 6 Pp. Vol. 3.
  5. Chin, C. A., Barreto, A., Cremades, J. G. & Adjouadi, M. 2008. Integrated Electromyogram And Eye-Gaze Tracking Cursor Control System For Computer Users With Motor Disabilities. Journal Of Rehabilitation Research And Development, 45, 161.
  6. Englehart, K., Hudgin, B. & Parker, P. A. 2001. A Wavelet-Based Continuous Classification Scheme For Multifunction Myoelectric Control. Biomedical Engineering, Ieee Transactions On, 48, 302-311.
  7. Hargrove, L. J., Englehart, K. & Hudgins, B. 2007. A Comparison Of Surface And Intramuscular Myoelectric Signal Classification. Biomedical Engineering, Ieee Transactions On, 54, 847-853.
  8. Higginbotham, D. J., Shane, H., Russell, S. & Caves, K. 2007. Access To Aac: Present, Past, And Future. Augmentative And Alternative Communication, 23, 243-257.
  9. Huang, Y., Englehart, K. B., Hudgins, B. & Chan, A. D. 2005. A Gaussian Mixture Model Based Classification Scheme For Myoelectric Control Of Powered Upper Limb Prostheses. Biomedical Engineering, Ieee Transactions On, 52, 1801-1811.
  10. Javanovic, R. & Mackenzie, I. S. 2010. Markermouse: Mouse Cursor Control Using A Head-Mounted Marker. Computers Helping People With Special Needs. Springer.
  11. Jiang, N., Englehart, K. B. & Parker, P. A. 2009. Extracting Simultaneous And Proportional Neural Control Information For Multiple-Dof Prostheses From The Surface Electromyographic Signal. Biomedical Engineering, Ieee Transactions On, 56, 1070-1080.
  12. Júnior, C. G. P. 2013. Assistive Technology For The Severe Motor Impaired By Using Online Processing Of Motor Unit Action Potentials Of Facial Muscles. Phd Phd Thesis, Federal University Of Uberlândia.
  13. Krishnan, A., Williams, L. J., Mcintosh, A. R. & Abdi, H. 2011. Partial Least Squares (Pls) Methods For Neuroimaging: A Tutorial And Review. Neuroimage, 56, 455-475.
  14. Majewski, M. & Kacalak, W. 2006. Natural Language Human-Machine Interface Using Artificial Neural Networks. Advances In Neural Networks-Isnn 2006. Springer.
  15. Martínez-Montes, E., Valdés-Sosa, P. A., Miwakeichi, F., Goldman, R. I. & Cohen, M. S. 2004. Concurrent Eeg/Fmri Analysis By Multiway Partial Least Squares. Neuroimage, 22, 1023-1034.
  16. Oviatt, S. & Cohen, P. 2000. Perceptual User Interfaces: Multimodal Interfaces That Process What Comes Naturally. Commun. Acm, 43, 45-53.
  17. Tai, K., Blain, S. & Chau, T. 2008. A Review Of Emerging Access Technologies For Individuals With Severe Motor Impairments. Assistive Technology, 20, 204-221.
  18. Turk, M. & Robertson, G. 2000. Perceptual User Interfaces. Communications Of The Acm, 43.
Download


Paper Citation


in Harvard Style

M. Queiroz C., J. Nasuto S. and O. Andrade A. (2014). Development and Evaluation of Human-Computer Interface based on Facial Motor Unit Activity . In Doctoral Consortium - DCBIOSTEC, (BIOSTEC 2014) ISBN Not Available, pages 47-53


in Bibtex Style

@conference{dcbiostec14,
author={Carlos M. M. Queiroz and Slawomir J. Nasuto and Adriano O. Andrade},
title={Development and Evaluation of Human-Computer Interface based on Facial Motor Unit Activity},
booktitle={Doctoral Consortium - DCBIOSTEC, (BIOSTEC 2014)},
year={2014},
pages={47-53},
publisher={SciTePress},
organization={INSTICC},
doi={},
isbn={Not Available},
}


in EndNote Style

TY - CONF
JO - Doctoral Consortium - DCBIOSTEC, (BIOSTEC 2014)
TI - Development and Evaluation of Human-Computer Interface based on Facial Motor Unit Activity
SN - Not Available
AU - M. Queiroz C.
AU - J. Nasuto S.
AU - O. Andrade A.
PY - 2014
SP - 47
EP - 53
DO -