DLDFD: Recurrence Free 2D Convolution Approach for Deep Fake Detection

Jag Mohan Singh, Raghavendra Ramachandra

2022

Abstract

Deep Fake images, which are digitally generated either through computer graphics or deep learning techniques, pose an increasing risk to existing face recognition systems. This paper presents a Deep-Learning-based Deep Fake Detection (DLDFD) architecture consisting of augmented convolutional layers followed by Resnet-50 architecture. We train DLDFD end-to-end with low-resolution images from the FaceForensics++ dataset. The number of images used during different phases includes approximately 1.68 million during training, 315k during validation, and 340k during testing. We train DLDFD in three different scenarios, combined image manipulation where we achieve an accuracy of 96.07% compared to 85.14% of state-of-the-art (SOTA), single image manipulation techniques where we get 100% accuracy for neural textures, and finally, cross-image manipulation techniques where we achieve an accuracy of 94.28% on the unseen category of face swap much higher than SOTA. Our approach requires only 2D convolutions without recurrence as compared to SOTA.

Paper Citation

in Harvard Style

Singh J. and Ramachandra R. (2022). DLDFD: Recurrence Free 2D Convolution Approach for Deep Fake Detection. In Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP; ISBN 978-989-758-555-5, SciTePress, pages 568-574. DOI: 10.5220/0010880500003124

in Bibtex Style

@conference{visapp22,
author={Jag Mohan Singh and Raghavendra Ramachandra},
title={DLDFD: Recurrence Free 2D Convolution Approach for Deep Fake Detection},
booktitle={Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP},
year={2022},
pages={568-574},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0010880500003124},
isbn={978-989-758-555-5},
}

in EndNote Style

TY - CONF

JO - Proceedings of the 17th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP 2022) - Volume 4: VISAPP
TI - DLDFD: Recurrence Free 2D Convolution Approach for Deep Fake Detection
SN - 978-989-758-555-5
AU - Singh J.
AU - Ramachandra R.
PY - 2022
SP - 568
EP - 574
DO - 10.5220/0010880500003124
PB - SciTePress