Automatic Generation and Detection of Visually Faultless Facial Morphs

Andrey Makrushin, Tom Neubert, Jana Dittmann

2017

Abstract

This paper introduces an approach to automatic generation of visually faultless facial morphs along with a proposal on how such morphs can be automatically detected. It is endeavored that the created morphs cannot be recognized as such with the naked eye and a reference automatic face recognition (AFR) system produces high similarity scores while matching a morph against faces of persons who participated in morphing. Automatic generation of morphs allows for creating abundant experimental data, which is essential (i) for evaluating the performance of AFR systems to reject morphs and (ii) for training forensic systems to detect morphs. Our first experiment shows that human performance to distinguish between morphed and genuine face images is close to random guessing. In our second experiment, the reference AFR system has verified 11.78% of morphs against any of genuine images at the decision threshold of 1% false acceptance rate. These results indicate that facial morphing is a serious threat to access control systems aided by AFR and establish the need for morph detection approaches. Our third experiment shows that the distribution of Benford features extracted from quantized DCT coefficients of JPEG-compressed morphs is substantially different from that of genuine images enabling the automatic detection of morphs.

References

  1. Arad, N., et al., 1994. Image Warping by Radial Basis Functions: Applications to Facial Expressions. In CVGIP:Graph Models Image Proc.56(2), pp. 161-172.
  2. Beier, T., Neely, S., 1992. Feature-based image metamorphosis. In Comp. Graphics. 26(2), pp. 35-42.
  3. Bianchi, T., Piva, A., 2012. Image Forgery Localization via Block-Grained Analysis of JPEG Artifacts. In IEEE Trans. on Information Forensics and Security 7(3), pp. 1003-1017.
  4. Bitouk, D., et al., 2008. Face Swapping: Automatically Replacing Faces in Photographs, In ACM Trans. on Graphics 27(3), 39.
  5. Blanz V., Vetter, T., 1999. A morphable model for the synthesis of 3D faces. In Proc. Conf. on Computer Graphics and Interactive Techniques, pp. 187-194.
  6. Celiktutan, O., et al., B., 2013. A comparative study of face landmarking techniques. In EURASIP Journal on Image and Video Processing 2013 (1), 1.
  7. Cootes, T.F., Taylor, C.J., 2000. Statistical Models of Appearance for Computer Vision. Technical Report, University of Manchester.
  8. Dirik, A.E., Memon, N., 2009. Image tamper detection based on demosaicing artifacts. In Proc. IEEE Int. Conf. on Image Processing, pp. 1497-1500.
  9. Farid, H., 2009. Image forgery detection. In IEEE Signal Processing Magazine 26(2), pp.16-25.
  10. Ferrara, M., Franco, A., Maltoni, D., 2014. The magic passport. In Proc. IEEE Int. Joint Conf. on Biometrics, Clearwater, Florida, pp. 1-7.
  11. Ferrara, M., Franco, A., Maltoni, D., 2016. On the Effects of Image Alterations on Face Recognition Accuracy. In Bourlai, T. (ed.) Face Recognition Across the Electromagnetic Spectrum, Springer, pp. 195-222.
  12. Ferrara, P., Bianchi, T., De Rosa, A., Piva, A., 2012. Image Forgery Localization via Fine-Grained Analysis of CFA Artifacts. In IEEE Trans. on Information Forensics and Security 7(5), pp. 1566-1577.
  13. Fridrich, J., 2009. Digital image forensic using sensor noise. In IEEE Sig. Proc. Magazine 26(2), pp.26-37.
  14. Fu, D., Shi, Y.Q., Su, W., 2007. A generalized Benford's law for JPEG coefficients and its applications in image forensics. In Proc. SPIE EI 6505, San Jose, CA.
  15. Ghatol, N., et al., 2013. Image Morphing Detection by Locating Tampered Pixels with Demosaicing Algorithms, In Int.J.of Computer App.66(8), pp.23-26.
  16. Hall, M., et al., 2009. The WEKA data mining software: An update. In SIGKDD Explorations 11(1), pp. 10-18.
  17. ISO, 2011. ISO/IEC 19794-5:2011, Information technology - Biometric data interchange formats, Part 5: Face image data.
  18. Lee, S., et al., 1996. Image Metamorphosis with Scattered Feature Constraints. In IEEE Trans. on Visualization and Computer Graphics 2(4), pp 337-354.
  19. Lee, S., Wolberg, G., Shin, S.Y., 1998. Polymorph: Morphing Among Multiple Images. In IEEE Computer Graphics and Applications 18(1), pp. 58-71.
  20. Liao, J., et al., 2014. Automating Image Morphing using Structural Similarity on a Halfway Domain. In ACM Transactions on Graphics 33(5), 168.
  21. Lukáš, J., Fridrich, J., 2003. Estimation of primary quantization matrix in double compressed JPEG images. In Proc. Digital Forensics Research Conference (DFRWS'03).
  22. Lyu, S., Pan, X., Zhang, X., 2014. Exposing Region Splicing Forgeries with Blind Local Noise Estimation. In Journal of Computer Vision 110(2), pp. 202-221.
  23. Mahdian, B., Saic, S., 2010. A bibliography on blind methods for identifying image forgery. In Signal Processing: Image Communication 25, pp. 389-399.
  24. Milani, S., et al, 2014. Discriminating multiple JPEG compressions using first digit features. In APSIPA Trans. on Signal and Inf. Processing 3(e19), pp. 1-10.
  25. Piva, A., 2013. An Overview on Image Forensics., In ISRN Signal Processing, Article ID 496701, 22 p.
  26. Ramachandra, R., Raja, K., Busch, C., 2016. Demystifying Magical Passport: A Robust Morphed Face Image Detection Scheme. In Proc. IEEE Int. Conf. on Biometrics: Theory, Appl., and Systems.
  27. Schetinger, V., Iuliani, M., Piva, A., Oliveira, M. M., 2016. Digital Image Forensics vs. Image Composition: An Indirect Arms Race. In CoRR abs/1601.03239.
  28. Vyas, J.P., Joshi, M.V., Raval., M.S., 2015. Automatic target image detection for morphing. In Journal of Visual Comm. and Image Represent. 27, pp. 28-43.
  29. Wang, J., et al., 2009. Understanding Benford's law and its vulnerability in image forensics. In Proc. IEEE Int. Conf. on Multimedia and Expo, pp. 1568-1571.
  30. Weng, Y., et al., 2013. Hair interpolation for portrait morphing, In Comp.Graph. Forum 32(7), pp. 79-84.
  31. Wolberg, G., 1998. Image morphing: a survey, In Visual Computer 14(8), pp. 360-372.
  32. Wolberg, G., 1990. Digital Image Warping, IEEE Computer Society Press, Los Alamitos CA.
  33. Wu, J., 2011. Face Recognition Jammer using Image Morphing. Tech.Rep. No. ECE-2011-03, Boston Uni.
  34. Zanella, V., Ramirez, G., Vargas, H., Rosas, L.V., 2009. Automatic Morphing of Face Images. Adaptive and Natural Computing Alg., LNCS 5495, pp 600-608.
Download


Paper Citation


in Harvard Style

Makrushin A., Neubert T. and Dittmann J. (2017). Automatic Generation and Detection of Visually Faultless Facial Morphs . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 39-50. DOI: 10.5220/0006131100390050


in Bibtex Style

@conference{visapp17,
author={Andrey Makrushin and Tom Neubert and Jana Dittmann},
title={Automatic Generation and Detection of Visually Faultless Facial Morphs},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={39-50},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006131100390050},
isbn={978-989-758-227-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Automatic Generation and Detection of Visually Faultless Facial Morphs
SN - 978-989-758-227-1
AU - Makrushin A.
AU - Neubert T.
AU - Dittmann J.
PY - 2017
SP - 39
EP - 50
DO - 10.5220/0006131100390050