Cosmetic Product Suggestion System Based on Facial Features and Skin Features

Abstract

The cosmetic product suggestion system based on facial, skin, hair and scalp features areproposed solution to help individuals find suitable cosmetic products for their unique skin and facial features. The proposed system employs a fusion of machine learning algorithms and advanced image processing techniques for the comprehensive analysis of facial images, enabling the precise identification of distinctive skin attributes such as skin type, texture, tone, and blemishes. Based on the identified features, the system recommends cosmetic products that are best suited for the user's skin type and facial features. The suggested products include skincare products such as cleansers, toners, moisturizers, and treatments. Overall, the cosmetic product suggestion system based on facial features and skin features has the potential to help individuals make informed decisions about the cosmetic products they use, leading to improved skin health and appearance. The efficacy of the devised model is assessed across diverse metrics, including accuracy, precision, and recall. Findings demonstrate the proposed model's adeptness in accurately discerning gender and skin conditions. This model has the potential to be used in various applications such as medical diagnosis, cosmetics, and personalized skincare recommendations.

Country : Sri Lanka

1 Shenal Perera2 Sulakshana Ranaweera3 Ravindu Induwara4 Rasindu Indusara5 Geethanjali Wimalaratne6 Sathira Hattiarachchi

  1. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka
  2. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka
  3. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka
  4. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka
  5. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka
  6. Department of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka

IRJIET, Volume 7, Issue 10, October 2023 pp. 503-510

doi.org/10.47001/IRJIET/2023.710066

References

  1. A.De and A. Saha, “A comparative study on different approaches of real time human emotion recognition based on facial expression detection,” in 2015 International Conference on Advances in Computer Engineering and Applications, 2015, pp. 483–487.
  2. S. Gong, X. Liu, and A. K. Jain, “Jointly DE-biasing face recognition and demographic attribute estimation,” in Computer Vision – ECCV 2020, Cham: Springer International Publishing, 2020, pp. 330–347.
  3. A.Das, A. Dantcheva, and F. Bremond, “Mitigating bias in gender, age and ethnicity classification: A multi-task convolution neural network approach,” in Lecture Notes in Computer Science, Cham: Springer International Publishing, 2019, pp. 573–585.
  4. Huynh, Q. et al. (2022) “Automatic Acne Object Detection and Acne Severity Grading Using Smartphone Images and Artificial Intelligence,” Diagnostics, 12(8), p. 1879.
  5. Wu, D. et al. (2021) “Facial Recognition Intensity in Disease Diagnosis Using Automatic Facial Recognition,” Journal of Personalized Medicine, 11(11), p. 1172.
  6. J. Lemley, S. Abdul-Wahid and R. Andonie, "Comparison of Recent Machine Learning Techniques for Gender Recognition from Facial Images", 2016.
  7. G. Levi and T. Hassncer, “Age and gender classification using convolutional neural networks,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015.
  8. B. Jaeger, W. Sleegers, and A. Evans, "Automated classification of demographics from face images: A tutorial and validation," Social and Personality Psychology Compass, vol. 14, (3), 2020.
  9. K. A. Muhaba, K. Dese, T. M. Aga, F. Zewdu, and G. L. Simegn, “Automatic skin disease diagnosis using deep learning from clinical image and patient information,” Skin Health and Disease, vol. 2, no. 1, Nov. 2021, doi: 10.1002/ski2.81.
  10. W. -J. Chang, L. -B. Chen, M. -C. Chen, Y. -C. Chiu and J. -Y. Lin, "ScalpEye: A Deep Learning-Based Scalp Hair Inspection and Diagnosis System for Scalp Health," in IEEE Access, vol. 8, pp. 134826-134837, 2020, doi: 10.1109/ACCESS.2020.3010847.
  11. Roy, M., & Protity, A. T. (2023). Hair and Scalp Disease Detection using Machine Learning and Image Processing. European Journal of Information Technologies and Computer Science, 3(1), 7–13.
  12. Ibrahim, S., Noor Azmy, Z. A., Abu Mangshor, N. N., Sabri, N., Ahmad Fadzil, A. F., & Ahmad, Z. (2020, October 1). Pre-trained classification of scalp conditions using image processing | Ibrahim | Indonesian Journal of Electrical Engineering and Computer Science. Pre-trained Classification of Scalp Conditions Using Image Processing | Ibrahim | Indonesian Journal of Electrical Engineering and Computer Science.
  13. N. S. Alk. ALEnezi, “A Method of Skin Disease Detection Using Image Processing And Machine Learning,” Procedia Computer Science, vol. 163, pp. 85–92, Jan. 2019, doi: 10.1016/j.procs.2019.12.090.
  14. L. Wei, Q. Gan, and T. Ji, “Skin Disease Recognition Method Based on Image Color and Texture Features,” Computational and Mathematical Methods in Medicine, vol. 2018, pp. 1–10, Aug. 2018, doi: 10.1155/2018/8145713.
  15. M. A. E.-H. Kassem, K. M. Hosny, R. Damaševičius, and M. M. Eltoukhy, “Machine Learning and Deep Learning Methods for Skin Lesion Classification and Diagnosis: A Systematic Review,” Diagnostics, vol. 11, no. 8, p. 1390, Jul. 2021, doi: 10.3390/diagnostics11081390.
  16. M. Maduranga and D. Nandasena, “Mobile-Based Skin Disease Diagnosis System Using Convolutional Neural Networks (CNN),” International Journal of Image, Graphics and Signal Processing, vol. 14, no. 3, pp. 47–57, Jun. 2022, doi: 10.5815/ijigsp.2022.03.05.
  17. P. N. Srinivasu, J. G. SivaSai, M. Ijaz, A. K. Bhoi, W. Kim, and J. D. Kang, “Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM,” Sensors, vol. 21, no. 8, p. 2852, Apr. 2021, doi: 10.3390/s21082852.
  18. Automatic Face & Gesture Recognition (FG 2017) - Rule-Based Facial Makeup Recommendation System | 10.1109/FG.2017.47. (n.d.). Sci-Hub | [IEEE 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) - Washington, DC, DC, USA (2017.5.30-2017.6.3)].
  19. Lin, T. Y., Chan, H. T., Hsia, C. H., & Lai, C. F. (2022, January 3). Facial Skincare Products’ Recommendation with Computer Vision Technologies. MDPI.