Video Deepfake Detection Using EfficientNet

Abstract

Deepfake detection has become a critical area of research with the growing prevalence of sophisticated face manipulation technologies, which pose severe ethical and security challenges. In this study, we propose an advanced deepfake detection system leveraging the EfficientNetB0 model, a state-of-the-art convolutional neural network (CNN) architecture, to address the challenges of efficiency and accuracy in identifying manipulated media. Our system utilizes video frame extraction and comprehensive data augmentation techniques to preprocess inputs, ensuring enhanced generalization on limited training data. EfficientNetB0, pre-trained on the ImageNet dataset, serves as the backbone for feature extraction, employing its highly efficient architecture with depth wise separable convolutions. Evaluated on the Celeb-DF dataset, the proposed system demonstrates high accuracy and robustness in detecting deepfake content while maintaining computational efficiency, making it suitable for real-world applications. Experimental results validate the effectiveness of this approach, highlighting its potential to contribute significantly to mitigating the adverse impacts of deepfakes.

Country : India

1 Satwika.M2 Pranavya.A3 Neha.K4 Rishika.K5 Siva Sankar Namani

  1. Department of CSE (AI & ML), G. Narayanamma Institute of Technology and Science, Hyderabad, India
  2. Department of CSE (AI & ML), G. Narayanamma Institute of Technology and Science, Hyderabad, India
  3. Department of CSE (AI & ML), G. Narayanamma Institute of Technology and Science, Hyderabad, India
  4. Department of CSE (AI & ML), G. Narayanamma Institute of Technology and Science, Hyderabad, India
  5. Assistant Professor, Department of CSE (AI & ML), G. Narayanamma Institute of Technology and Science, Hyderabad, India

IRJIET, Volume 8, Issue 12, December 2024 pp. 145-150

doi.org/10.47001/IRJIET/2024.812022

References

  1. Agarwal S, Farid H, Fried O, and Agrawala M (2020) Detecting Deep-Fake Videos from Phoneme-Viseme Mismatches. In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.
  2. Amerini I, Galteri L, Caldelli R, and Del Bimbo A (2019) Deepfake Video Detection through Optical Flow Based CNN. In: IEEE/CVF International Conference on Computer Vision Workshop (ICCVW), Seoul, Korea (South).
  3. Ding X, Raziei Z, Larson E.C. et al. (2020).
  4. Dolhansky B, Howes R, Pflaum B, Baram N, Ferrer C (2019) The Deepfake Detection Challenge (DFDC) Preview Dataset. arXiv:1910:08854.
  5. Fei J, Xia Z, Yu P, Xiao F (2020), Exposing AI-generated videos with motion magnification. Multimedia Tools Appl. 80(20), 30789–30802.
  6. Hashmi M.F., Ashish B.K.K., Keskar A.G., Bokde N.D., Yoon J.H., Geem Z.W. (2020) An Exploratory Analysis on Visual Counterfeits Using Conv-LSTM Hybrid Architecture. IEEE Access 8, 101293–101308.
  7. Hsu C.-C., Zhuang Y-Xiu., Lee C.-Y. (2020) Deep fake image detection based on pairwise learning. Applied Sciences 10(1), 370.
  8. Huy H. Nguyen, Fuming Fang, Junichi Yamagishi, Isao Echizen (2019) Multi-task Learning For Detecting and Segmenting Manipulated Facial Images and Videos. In: IEEE International Conference on Biometrics: Theory, Applications and Systems (BTAS).
  9. Komal Chugh, Parul Gupta, Abhinav Dhall, and Ramanathan Subramanian (2018) Not made for eachother–Audio-Visual Dissonance-based Deepfake Detection and Localization. In Woodstock ’18: ACM Symposium on Neural Gaze Detection, June 03–05.
  10. Li, Haodong; Li, Bin; Tan, Shunquan; Huang, Jiwu: Identification of deep network generated images using disparities in color components. Signal Process. (2020).
  11. Li Y, Lyu S (2018) Exposing Deep Fake Videos By Detecting Face Warping Artifacts. In: IEEE Conference Computer. Vision Pattern Recognition.
  12. Li, Y.; Chang, M.; Lyu, S. (2018) In Ictu Oculi Exposing AI Created Fake Videos by Detecting Eye Blinking. In: IEEE International Workshop on Information Forensics and Security (WIFS), Hong Kong, Hong Kong.
  13. Matern F, Riess C, Stamminger M (2019) Exploiting Visual Artifacts to Expose Deep fakes and Face Manipulations. In: IEEE Winter Applications of Computer Vision Workshops (WACVW), Waikoloa Village, HI, USA.
  14. Matthews T.F., Cootes J.A., Bangham S.C., Harvey R. (2002) Extraction of visual features for lip reading. IEEE Trans. Pattern Anal. Mach. Intell. 24(2), 198–213.
  15. zingxing Tan, Quoc V. Le (2019) EfficientNet: Re-thinking Model Scaling for Convolutional Neural Networks. Cornell University.
  16. Minh Dang L., Hassan S.I., Im S., Moon H. (2019) Face image manipulation detection based on a convolutional neural network. Expert Syst. Appl. 129, 156–168.
  17. Montserrat D.M. et al. (2020) Deepfakes Detection with Automatic Face Weighting In: IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle, WA, USA.
  18. Rössler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Nießner M. (2018) FaceForensics: A large-scale video dataset for forgery detection in human faces.
  19. Rössler A, Cozzolino D, Verdoliva L, Riess C, Thies J, Niessner M. (2019) FaceForensics++: learning to detect manipulated facial images. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV).
  20. Sabir E, Cheng J, Jaiswal A, Almageed W.A., Masi I, Natarajan P. (2019) Recurrent Convolutional Strategies for Face Manipulation Detection in Videos. IEEE Conf. Comput. Vision Pattern Recogn. 3, 80–87.
  21. Torfi A, Iranmanesh S.M., Nasrabadi N., Dawson J. (2017) 3D Convolutional Neural Networks for Cross Audio-Visual Matching Recognition. IEEE Access 5, 22081–22091.