3D Animation Generation & Image Enhancement Using Deep Learning

Abstract

The field of 3D animation is undergoing a transformative shift through deep learning. This paper presents a robust system that automates 3D facial animation from a static image using Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs). With real-time deployment on cloud platforms, the approach bypasses the need for manual animation and motion-capture tools. Our system accepts a static face image and a driving video, mapping expressions and movements with high fidelity. Performance metrics such as SSIM (0.87), FID (23.4), and 23 FPS illustrate its capability. The proposed framework is adaptable to human, cartoon, and avatar faces, demonstrating a scalable path toward democratized 3D animation.

Country : India

1 Sanskruti P. Upadhyay2 Noor Siddiqui3 Pranay Vitekar4 Mahek Pathan5 Pushpa Tandekar

  1. Student, Computer Science & Engineering, Shri Sai College of Engineering & Technology, Maharashtra, India
  2. Student, Computer Science & Engineering, Shri Sai College of Engineering & Technology, Maharashtra, India
  3. Student, Computer Science & Engineering, Shri Sai College of Engineering & Technology, Maharashtra, India
  4. Student, Computer Science & Engineering, Shri Sai College of Engineering & Technology, Maharashtra, India
  5. Professor, Computer Science & Engineering, Shri Sai College of Engineering & Technology, Maharashtra, India

IRJIET, Volume 9, Issue 6, June 2025 pp. 128-132

doi.org/10.47001/IRJIET/2025.906015

References

  1. A.Siarohin et al., 'First Order Motion Model for Image Animation,' CVPR 2019.
  2. E. Zakharov et al., 'Few-Shot Adversarial Learning of Talking Heads,' ICCV 2019.
  3. J. Thies et al., 'Deep Video Portraits,' ACM TOG, 2018.
  4. Y. Deng et al., 'Accurate 3D Face Reconstruction,' arXiv:1903.08527.
  5. M. Abu Zeid et al., 'Real-Time Facial Animation using Deep Learning,' IEEE TVCG 2021.
  6. T. Karras et al., 'A Style-Based Generator Architecture for GANs,' CVPR 2019.
  7. M. Liang et al., 'Liquid Warping GAN++,' arXiv:2003.04013.
  8. K. Olszewski et al., 'High-Fidelity Facial Avatars from a Single Image,' arXiv 2023.
  9. Artificial Neural Network, May 2022, DOI: 10.17148/IJARCCE.2022.115196, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  10. python.net, December 2022, DOI:10.17148/IJARCCE.2022.111237, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  11. Combining Vedic & Traditional Mathematic Practices for Enhancing Computational Speed in Day-To-Day Scenarios, Speed in Day-To-Day Scenarios, Conference: Industrial Engineering Journal ISSN: 0970-2555 Website: www.ivyscientific.org, At: Industrial Engineering Journal (UGC JOURNAL).
  12. Lowlesh Yadav, Predictive Acknowledgement using TRE System to reduce cost and Bandwidth, March 2019. International Journal of Research in Electronics and Computer Engineering (IJRECE), VOL. 7 ISSUE 1 (JANUARY- MARCH 2019) ISSN: 2393-9028 (PRINT) | ISSN: 2348-2281 (ONLINE).
  13. Research on Techniques for Resolving Big Data Issues, May 2022, DOI: 10.17148/IJARCCE.2022.115192, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  14. Photometric and spectroscopic analysis of the Type II SN 2020jfo with a short plateau, November 2022.
  15. DOI:10.48550/arXiv.2211.02823, License CC BY 4.0.
  16. Research on Data Mining, May 2022, DOI: 10.17148/IJARCCE.2022.115176, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  17. Research on Association Rule Mining Algorithms, May 2022, DOI: 10.17148/IJARCCE.2022.115152, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  18. STUDY on INTERNET of THINGS BASED APPLICATION, May2022, DOI: 10.17148/IJARCCE.2022.115179, Conference: International Journal of Advanced Research in Computer and Communication Engineering.
  19. An Efficient Way to Detect the Duplicate Data in Cloud by using TRE Mechanism, May 2022, DOI:10.17148/IJARCCE.2022.115139, Conference: International Journal of Advanced Research in Computer and Communication Engineering, Volume:11.
  20. Using Encryption Algorithms in CC for Data Security and Privacy, May 2022, DOI:10.17148/IJARCCE.2022.115149.