Cosmetic Product Suggestion System Based on Facial Features and Skin Features

Shenal PereraDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLankaSulakshana RanaweeraDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLankaRavindu InduwaraDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLankaRasindu IndusaraDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLankaGeethanjali WimalaratneDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLankaSathira HattiarachchiDepartment of Information Technology, Sri Lanka Institute of Information Technology, Malabe, SriLanka

Vol 7 No 10 (2023): Volume 7, Issue 10, October 2023 | Pages: 503-510

International Research Journal of Innovations in Engineering and Technology

OPEN ACCESS | Research Article | Published Date: 05-11-2023

doi Logo doi.org/10.47001/IRJIET/2023.710066

Abstract

The cosmetic product suggestion system based on facial, skin, hair and scalp features areproposed solution to help individuals find suitable cosmetic products for their unique skin and facial features. The proposed system employs a fusion of machine learning algorithms and advanced image processing techniques for the comprehensive analysis of facial images, enabling the precise identification of distinctive skin attributes such as skin type, texture, tone, and blemishes. Based on the identified features, the system recommends cosmetic products that are best suited for the user's skin type and facial features. The suggested products include skincare products such as cleansers, toners, moisturizers, and treatments. Overall, the cosmetic product suggestion system based on facial features and skin features has the potential to help individuals make informed decisions about the cosmetic products they use, leading to improved skin health and appearance. The efficacy of the devised model is assessed across diverse metrics, including accuracy, precision, and recall. Findings demonstrate the proposed model's adeptness in accurately discerning gender and skin conditions. This model has the potential to be used in various applications such as medical diagnosis, cosmetics, and personalized skincare recommendations.

Keywords

Product Recommendation, Demographics Identification, Facial Skin Conditions Detection, Skin Diseases detection, Hair and scalp Condition Detection


Citation of this Article

Shenal Perera, Sulakshana Ranaweera, Ravindu Induwara, Rasindu Indusara, Geethanjali Wimalaratne, Sathira Hattiarachchi, “Cosmetic Product Suggestion System Based on Facial Features and Skin Features” Published in International Research Journal of Innovations in Engineering and Technology - IRJIET, Volume 7, Issue 10, pp 503-510, October 2023. Article DOI https://doi.org/10.47001/IRJIET/2023.710066

References
  1. A.De and A. Saha, “A comparative study on different approaches of real time human emotion recognition based on facial expression detection,” in 2015 International Conference on Advances in Computer Engineering and Applications, 2015, pp. 483–487.
  2. S. Gong, X. Liu, and A. K. Jain, “Jointly DE-biasing face recognition and demographic attribute estimation,” in Computer Vision – ECCV 2020, Cham: Springer International Publishing, 2020, pp. 330–347.
  3. A.Das, A. Dantcheva, and F. Bremond, “Mitigating bias in gender, age and ethnicity classification: A multi-task convolution neural network approach,” in Lecture Notes in Computer Science, Cham: Springer International Publishing, 2019, pp. 573–585.
  4. Huynh, Q. et al. (2022) “Automatic Acne Object Detection and Acne Severity Grading Using Smartphone Images and Artificial Intelligence,” Diagnostics, 12(8), p. 1879.
  5. Wu, D. et al. (2021) “Facial Recognition Intensity in Disease Diagnosis Using Automatic Facial Recognition,” Journal of Personalized Medicine, 11(11), p. 1172.
  6. J. Lemley, S. Abdul-Wahid and R. Andonie, "Comparison of Recent Machine Learning Techniques for Gender Recognition from Facial Images", 2016.
  7. G. Levi and T. Hassncer, “Age and gender classification using convolutional neural networks,” in 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2015.
  8. B. Jaeger, W. Sleegers, and A. Evans, "Automated classification of demographics from face images: A tutorial and validation," Social and Personality Psychology Compass, vol. 14, (3), 2020.
  9. K. A. Muhaba, K. Dese, T. M. Aga, F. Zewdu, and G. L. Simegn, “Automatic skin disease diagnosis using deep learning from clinical image and patient information,” Skin Health and Disease, vol. 2, no. 1, Nov. 2021, doi: 10.1002/ski2.81.
  10. W. -J. Chang, L. -B. Chen, M. -C. Chen, Y. -C. Chiu and J. -Y. Lin, "ScalpEye: A Deep Learning-Based Scalp Hair Inspection and Diagnosis System for Scalp Health," in IEEE Access, vol. 8, pp. 134826-134837, 2020, doi: 10.1109/ACCESS.2020.3010847.
  11. Roy, M., & Protity, A. T. (2023). Hair and Scalp Disease Detection using Machine Learning and Image Processing. European Journal of Information Technologies and Computer Science, 3(1), 7–13.
  12. Ibrahim, S., Noor Azmy, Z. A., Abu Mangshor, N. N., Sabri, N., Ahmad Fadzil, A. F., & Ahmad, Z. (2020, October 1). Pre-trained classification of scalp conditions using image processing | Ibrahim | Indonesian Journal of Electrical Engineering and Computer Science. Pre-trained Classification of Scalp Conditions Using Image Processing | Ibrahim | Indonesian Journal of Electrical Engineering and Computer Science.
  13. N. S. Alk. ALEnezi, “A Method of Skin Disease Detection Using Image Processing And Machine Learning,” Procedia Computer Science, vol. 163, pp. 85–92, Jan. 2019, doi: 10.1016/j.procs.2019.12.090.
  14. L. Wei, Q. Gan, and T. Ji, “Skin Disease Recognition Method Based on Image Color and Texture Features,” Computational and Mathematical Methods in Medicine, vol. 2018, pp. 1–10, Aug. 2018, doi: 10.1155/2018/8145713.
  15. M. A. E.-H. Kassem, K. M. Hosny, R. Damaševičius, and M. M. Eltoukhy, “Machine Learning and Deep Learning Methods for Skin Lesion Classification and Diagnosis: A Systematic Review,” Diagnostics, vol. 11, no. 8, p. 1390, Jul. 2021, doi: 10.3390/diagnostics11081390.
  16. M. Maduranga and D. Nandasena, “Mobile-Based Skin Disease Diagnosis System Using Convolutional Neural Networks (CNN),” International Journal of Image, Graphics and Signal Processing, vol. 14, no. 3, pp. 47–57, Jun. 2022, doi: 10.5815/ijigsp.2022.03.05.
  17. P. N. Srinivasu, J. G. SivaSai, M. Ijaz, A. K. Bhoi, W. Kim, and J. D. Kang, “Classification of Skin Disease Using Deep Learning Neural Networks with MobileNet V2 and LSTM,” Sensors, vol. 21, no. 8, p. 2852, Apr. 2021, doi: 10.3390/s21082852.
  18. Automatic Face & Gesture Recognition (FG 2017) - Rule-Based Facial Makeup Recommendation System | 10.1109/FG.2017.47. (n.d.). Sci-Hub | [IEEE 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017) - Washington, DC, DC, USA (2017.5.30-2017.6.3)].
  19. Lin, T. Y., Chan, H. T., Hsia, C. H., & Lai, C. F. (2022, January 3). Facial Skincare Products’ Recommendation with Computer Vision Technologies. MDPI.