Colorization of Black and White Images Using a Hybrid Deep Learning Framework

Abstract

With the development of deep learning algorithms and their great success in the field of computer vision, the field of automatic image colorization has witnessed significant improvements in accuracy and realism. This study introduces a novel deep learning-based method for colorizing black and white photographs, utilizing the powerful feature extraction of the InceptionResNetV2 model and the generative capabilities of autoencoders. A custom data generator was developed for efficient preprocessing, data augmentation, and batch processing, enhancing memory usage and scalability. The system encodes grayscale images and extracts high-level features, which are then fused and decoded into two color channels, combined with the original luminance to recreate the image in the LAB color space. The method demonstrates strong performance with a PSNR of 22.8154 and a SSIM of 0.9097, showcasing its potential for applications like historical image restoration and media enhancement.

Country : Lebanon

1 Baraa Qasim Ibraheem2 Kassem Danach3 Ahmad Ghandour

  1. Department of Computer and Communications, Faculty of Engineering, Islamic University of Lebanon, Wardanieh, Lebanon
  2. Department of Computer and Communications, Faculty of Engineering, Islamic University of Lebanon, Wardanieh, Lebanon
  3. Department of Computer and Communications, Faculty of Engineering, Islamic University of Lebanon, Wardanieh, Lebanon

IRJIET, Volume 8, Issue 5, May 2024 pp. 6-11

doi.org/10.47001/IRJIET/2024.805002

References

  1. R. Zhang, J. Y. Zhu, P. Isola, X. Geng, A. S. Lin, T. Yu, and A. A. Efros, “Real-time user-guided image colorization with learned deep priors,” ACM Transactions on Graphics, vol. 36, no. 4, 2017.
  2. H. Dalal, A. Dangle, M. J.  Radhika, and S. Gore, “Image Colorization Progress: A Review of Deep Learning Techniques for Automation of Colorization,” Int. J. Adv. Trends Comput. Sci. En, vol. 10, no. 4, 2021.
  3. R. Dhir, M. Ashok, and S. Gite, “An overview of advances in image colorization using computer vision and deep learning techniques,” Rev. Comput. Eng. Res, vol. 7, no. 2, pp. 86-95, 2020.
  4. L. Jiao, and J. Zhao, “A Survey on the New Generation of Deep Learning in Image Processing,” in IEEE Access, vol. 7, pp. 172231-172263, 2019.
  5. K. Weiss, T. M. Khoshgoftaar, and D. Wang, “A survey of transfer learning,” Journal of Big data, vol. 3, pp. 1-40, 2016.
  6. A. Levin, D. Lischinski, and Y. Weiss, “Colorization using optimization,” ACM SIGGRAPH 2004 Papers, pp. 689-694, 2004.
  7. Z. Cheng, Q. Yang, and B. Sheng, “Deep colorization,” Proceedings of the IEEE international conference on computer vision, pp. 415-423, 2015.
  8. J. Li, H. Xiao, D. Tan, M. Zhang, and Y. Liu, “Image colorization based on texture by using of CNN,”2019 IEEE 4th International Conference on Image, Vision and Computing (ICIVC), pp. 167-171, 2019.
  9. M. He, D. Chen, J. Liao, P. V.  Sander, and L. Yuan, “Deep exemplar-based colorization,” ACM Transactions on Graphics (TOG), vol. 37, no. 4, pp. 1-16, 2018.
  10. Y. Wu, X. Wang, Y. Li, H. Zhang, X. Zhao, and Y. Shan, “Towards vivid and diverse image colorization with generative color prior,” Proceedings of the IEEE/CVF international conference on computer vision, pp. 14377-14386, 2021.
  11. X. Dong, W. Li, X. Wang, and Y. Wang, Y, “Cycle-CNN for colorization towards real monochrome-color camera systems,” Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, no. 07, pp. 10721-10728, 2020.
  12. D. Tao, J. Shi, and F. Cheng, “Intelligent colorization for thermal infrared image based on CNN,”2020 IEEE International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA), vol. 1, pp. 1184-1190, 2020.
  13. C. Qiu, H. Cao, Q. Ren, R. Li, and Y. Qiu, “Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks,” Automatic Image Colorization with Convolutional Neural Networks and Generative Adversarial Networks, 2020.
  14. L. Kiani, M. Saeed, and H. Nezamabadi-Pour, “Image colorization using a deep transfer learning,”2020 8th Iranian Joint Congress on Fuzzy and intelligent systems (CFIS). IEEE, pp. 027-032, 2020.
  15. J. W. Su, H. K. Chu, and J. B. Huang, “Instance-aware image colorization,” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 7968-7977, 2020.
  16. N. Wang, G. D. Chen, and Y. Tian, “Image colorization algorithm based on deep learning,” Symmetry, vol. 14, no. 11, 2022.
  17. Q. V. Le, “A tutorial on deep learning part 2: Autoencoders, convolutional neural networks and recurrent neural networks,” Google Brain, vol. 20, pp. 1-20, 2015.
  18. J. Xu, K. Lu, X. Shi, S. Qin, H. Wang, and J. Ma, “A DenseUnet generative adversarial network for near-infrared face image colorization,” Signal Processing, vol. 183, 2021.