Facial Asymmetry Assessment from 3D Shape Sequences: The Clinical Case of Facial Paralysis

Paul Audain Desrosiers, Yasmine Bennis, Boulbaba Ben Amor, Mohamed Daoudi, Pierre Guerreschi

2016

Abstract

This paper addresses the problem of quantifying the facial asymmetry from dynamic 3D data. We investigate here the role of 4D (i.e. 3D+time) data to reveal the amount of both static and dynamic asymmetry, in a clinical use-case of facial paralysis. The final goal is to provide tools and solutions to clinicians for facial paralysis assessment and monitoring, which can provide qualitative and quantitative evaluations. To this end, the approach proposed here consider 3D facial sequences and adopt a recently-developed Riemannian approach for facial deformation analysis. After a preprocessing step, each frame of a given 3D sequence is approximated by an indexed collection of elastic radial curves. Riemannian shape analysis of obtained curves and their symmetrical counterparts, both elements of the same shape space, give rise to a feature vector, called Dense Scalar Fields (DSFs). The use of these DSFs reveals the amount of bilateral asymmetry of the face, when conveying expressions. That is, given a 3D frame, it is first reflected with respect to the YZ-plane, then compared to the obtained reflection using the DSFs. To exemplify the use of the proposed approach, a new dataset have been collected (of patients) before and after injecting Botulinum Toxin (BT) in related facial muscles. Experimental results obtained on this dataset show that the proposed approach allows clinicians to evaluate the facial asymmetry before and after the medical treatment.

References

  1. Al-Anezi, T., Khambay, B., Peng, M., O'Leary, E., Ju, X., and Ayoub, A. (2013). A new method for automatic tracking of facial landmarks in 3d motion captured images (4d). International Journal of Oral and Maxillofacial Surgery, 42(1):9 - 18.
  2. Ben Amor, B., Drira, H., Berretti, S., Daoudi, M., and Srivastava, A. (2014). 4-d facial expression recognition by learning geometric deformations. IEEE T. Cybernetics, 44(12):2443-2457.
  3. Cheng, S., Marras, I., Zafeiriou, S., and Pantic, M. (2015). Active nonrigid ICP algorithm. In 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition, FG 2015, Ljubljana, Slovenia, May 4-8, 2015, pages 1-8.
  4. Clark, R. and Berris, C. (1989). Botulinum toxin: a treatment for facial asymmetry caused by facial nerve paralysis. Plast Reconstr Surg, 84(2):353-5.
  5. Cosker, D., Krumhuber, E., and Hilton, A. (2011). A facs valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In Int. Conf. on Computer Vision (ICCV), pages 2296- 2303.
  6. Fang, T., Zhao, X., Ocegueda, O., Shah, S. K., and Kakadiaris, I. A. (2012). 3d/4d facial expression analysis: An advanced annotated face model approach. Image and Vision Computing, 30(10):738-749.
  7. Filipo, R., Spahiu, I., Covelli, E., Nicastri, M., and Bertoli, G. (2012). Botulinum toxin in the treatment of facial synkinesis and hyperkinesis. The Laryngoscope, 122(2):266-70.
  8. Joshi, S., Klassen, E., Srivastava, A., and Jermyn, I. (2007). A novel representation for Riemannian analysis of elastic curves in Rn. In Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pages 1063- 6919, Minneapolis, MN.
  9. Matuszewski, B., Quan, W., Shark, L.-k., McLoughlin, A., Lightbody, C., Emsley, H., and Watkins, C. (2012). Hi4d-adsip 3D dynamic facial articulation database. Image and Vision Computing, 30(10).
  10. Quan, W., Matuszewski, B. J., and Shark, L. (2012). Facial asymmetry analysis based on 3-d dynamic scans. In Proceedings of the IEEE International Conference on Systems, Man, and Cybernetics, SMC 2012, Seoul, Korea (South), October 14-17, 2012, pages 2676- 2681.
  11. Sandbach, G., Zafeiriou, S., Pantic, M., and Rueckert, D. (2012). Recognition of 3D facial expression dynamics. Image and Vision Computing, 30(10):762-773.
  12. Shujaat, S., Khambay, B., Ju, X., Devine, J., McMahon, J., Wales, C., and Ayoub, A. (2014). The clinical application of three-dimensional motion capture (4d): a novel approach to quantify the dynamics of facial animations. International Journal of Oral and Maxillofacial Surgery, 43(7):907 - 916.
  13. Srivastava, A., Klassen, E., Joshi, S. H., and Jermyn, I. H. (2011). Shape analysis of elastic curves in euclidean spaces. IEEE Trans. Pattern Anal. Mach. Intell., 33(7):1415-1428.
  14. Sun, Y., Chen, X., Rosato, M. J., and Yin, L. (2010). Tracking vertex flow and model adaptation for threedimensional spatiotemporal face analysis. IEEE Transactions on Systems, Man, and Cybernetics, Part A, 40(3):461-474.
  15. Sun, Y. and Yin, L. (2008). Facial expression recognition based on 3d dynamic range model sequences. In Proceedings of the 10th European Conference on Computer Vision: Part II, ECCV 7808, pages 58-71.
  16. Zhang, X., Yin, L., Cohn, J. F., Canavan, S., Reale, M., Horowitz, A., Liu, P., and Girard, J. M. (2014). Bp4dspontaneous: a high-resolution spontaneous 3D dynamic facial expression database. Image and Vision Computing, 32(10):692 - 706.
Download


Paper Citation


in Harvard Style

Desrosiers P., Bennis Y., Amor B., Daoudi M. and Guerreschi P. (2016). Facial Asymmetry Assessment from 3D Shape Sequences: The Clinical Case of Facial Paralysis . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 30-38. DOI: 10.5220/0005721200300038


in Bibtex Style

@conference{visapp16,
author={Paul Audain Desrosiers and Yasmine Bennis and Boulbaba Ben Amor and Mohamed Daoudi and Pierre Guerreschi},
title={Facial Asymmetry Assessment from 3D Shape Sequences: The Clinical Case of Facial Paralysis},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={30-38},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005721200300038},
isbn={978-989-758-175-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Facial Asymmetry Assessment from 3D Shape Sequences: The Clinical Case of Facial Paralysis
SN - 978-989-758-175-5
AU - Desrosiers P.
AU - Bennis Y.
AU - Amor B.
AU - Daoudi M.
AU - Guerreschi P.
PY - 2016
SP - 30
EP - 38
DO - 10.5220/0005721200300038