![](bg8.png)
system using only a webcam and delivering a per-
formance of 100 fps. Face detection has high per-
formance, from the implementation of auxiliary tech-
niques, such as skin color segmentation and detection
cut between frames. Face landmarks allowed to iden-
tify the face movement, this signal is converted by
a transfer function to a accurate and smooth mouse
cursor movement. The system also enables the face
movement to perform the typing simulation. The
opening and closing of eyes and mouths have been
translated for simulation of clicks and typing.
From the tests performed, it was demonstrated the
efficiency of the tool and the ease of users to learn
how to interact with the system and perform simple
computer tasks. People with disabilities of the up-
per limbs and spinal cord injury, as long as they have
the head movement, can use this tool and enjoy the
resources available in the computer and the internet.
The digital inclusion of these people can stimulate the
increase of their self-esteem and provide opportuni-
ties for academic and professional development.
As future works, the proposed system must un-
dergo more tests of comparison with other existing
similar tools. Tests should also be performed with
users with disabilities in order to confirm the usabil-
ity of the system. After these tests and possible ad-
justments in its functionalities, the tool must be made
available to the public.
Human-computer interfaces aimed to people with
disabilities should always be research and develop-
ment topic, as society must ensure that these users are
included in all activities. Future systems may deter-
mine more efficient techniques of using the opening
and closing of the eyes as an interface to the system,
considering a low-resolution and reduced-size input
image without performance decrease. These systems
should always provide the best performance possible,
as low performance makes the system unusable in real
situations or affect their usability.
REFERENCES
Betke, M., Gips, J., and Fleming, P. (2002). The camera
mouse: Visual tracking of body features to provide
computer access for people with severe disabilities.
IEEE Transactions on Neural Systems and Rehabili-
tation Engineering, 10(1):1–10.
Bian, Z.-P., Hou, J., Chau, L.-P., and Magnenat-Thalmann,
N. (2016). Facial position and expression-based hu-
man–computer interface for persons with tetraplegia.
IEEE Journal of Biomedical and Health Informatics,
20(3):915–924.
Dlib (2017). Home page. Available in: http://dlib.net/. Ac-
cess on May 31, 2017.
Fu, Y. and Huang, T. (2007). hMouse: Head tracking driven
virtual computer mouse. In 2007 IEEE Workshop on
Applications of Computer Vision. IEEE.
Gor, A. K. and Bhatt, M. S. (2015). Fast scale invari-
ant multi-view face detection from color images us-
ing skin color segmentation & trained cascaded face
detectors. In 2015 International Conference on Ad-
vances in Computer Engineering and Applications.
IEEE.
Ji, S., Lu, X., and Xu, Q. (2014). A fast face detection
method combining skin color feature and AdaBoost.
In 2014 International Conference on Multisensor Fu-
sion and Information Integration for Intelligent Sys-
tems (MFI). IEEE.
Kazemi, V. and Sullivan, J. (2014). One millisecond face
alignment with an ensemble of regression trees. In
Proceedings of the IEEE Conference on Computer Vi-
sion and Pattern Recognition, pages 1867–1874.
Kjeldsen, R. (2006). Improvements in vision-based pointer
control. In Proceedings of the 8th international ACM
SIGACCESS conference on Computers and accessi-
bility - Assets 06. ACM Press.
Kraichan, C. and Pumrin, S. (2014). Face and eye track-
ing for controlling computer functions. In 2014
11th International Conference on Electrical Engi-
neering/Electronics, Computer, Telecommunications
and Information Technology (ECTI-CON). IEEE.
OpenCV (2017). Home page. Available in:
http://opencv.org/. Access on May 31, 2017.
Pallej
`
a, T., Guillamet, A., Tresanchez, M., Teixid
´
o, M., del
Viso, A. F., Rebate, C., and Palac
´
ın, J. (2011). Im-
plementation of a robust absolute virtual head mouse
combining face detection, template matching and op-
tical flow algorithms. Telecommunication Systems,
52(3):1479–1489.
Sagonas, C., Tzimiropoulos, G., Zafeiriou, S., and Pantic,
M. (2013). 300 faces in-the-wild challenge: The first
facial landmark localization challenge. In 2013 IEEE
International Conference on Computer Vision Work-
shops. IEEE.
Soukoreff, R. W. and MacKenzie, I. S. (2004). Towards a
standard for pointing device evaluation, perspectives
on 27 years of fitts’ law research in hci. International
Journal of Human-Computer Studies, 61(6):751–789.
Tu, J., Huang, T., and Tao, H. (2005). Face as mouse
through visual face tracking. In The 2nd Canadian
Conference on Computer and Robot Vision (CRV 05).
IEEE.
Viola, P. and Jones, M. (2001). Rapid object detection us-
ing a boosted cascade of simple features. In Proceed-
ings of the 2001 IEEE Computer Society Conference
on Computer Vision and Pattern Recognition. CVPR
2001. IEEE Comput. Soc.
WHO (2011). World Report on Disability. World Health
Organization.
Xu, G., Wang, Y., and Feng, X. (2009). A robust low cost
virtual mouse based on face tracking. In 2009 Chinese
Conference on Pattern Recognition. IEEE.
Development of a Computer Interface for People with Disabilities based on Computer Vision
573