Empowering Virtual Education and Lecturing through AI and ML Advancements

Abstract

The fast rise of online learning, intensified by the COVID-19 issue, highlighted operational challenges such as manual grading, student apathy, and irregularities in attendance. This study presents an enhanced e-learning system with four major innovative components: facial recognition based attendance combined with interaction heat maps; machine learning-driven evaluation of subjective replies; Enhanced lecturing by using automated whiteboard drawing; and student engagement analysis using facial and postural measurements. Our solution merges cutting-edge machine learning and computer vision to reduce instructors' manual labour, increase student interaction, and improve the learning experience. According to our findings, these changes provide a comprehensive and engaging online educational environment. Future developments will concentrate on iterative feedback, the exploration of various machine learning frameworks, the expansion of visual tool capabilities, and the development of biometric attendance systems.

Country : Sri Lanka

1 Theebanraj U.2 Kanishkar R.3 Gunathilake C.D4 Hennayake H.M.G.J5 Ms. Supipi Karunathilaka

  1. Faculty of Computing, Sri Lanka Institute of Information Technology (SLIIT), Malabe, Colombo, Sri Lanka
  2. Faculty of Computing, Sri Lanka Institute of Information Technology (SLIIT), Malabe, Colombo, Sri Lanka
  3. Faculty of Computing, Sri Lanka Institute of Information Technology (SLIIT), Malabe, Colombo, Sri Lanka
  4. Faculty of Computing, Sri Lanka Institute of Information Technology (SLIIT), Malabe, Colombo, Sri Lanka
  5. Faculty of Computing, Sri Lanka Institute of Information Technology (SLIIT), Malabe, Colombo, Sri Lanka

IRJIET, Volume 7, Issue 10, October 2023 pp. 57-65

doi.org/10.47001/IRJIET/2023.710008

References

  1. C. Leacock and M. Chodorow, Comput. Hum., vol. 37, no. 4, pp. 389–405, 2003.
  2. C. Roy and C. Chaudhari, “Case-Based Modeling of answer points to expedite the semi-automated evaluation of subjective papers”,” in IEEE 8th International Advance Computing Conference (IACC), 2018, pp. 85–90.
  3. M. Devi, “Machine Learning Techniques with Ontology for Subjective Answer Evaluation”, International Journal on Natural Language Computing (IJNLC), vol. 5, 2016.
  4. K. Surya, E. Gayakwad, and M. K. Nallakaruppan, “Deep learning for Short Answer Scoring”, International Journal of Recent Technology and Engineering (IJRTE), vol. 7, pp. 2277–3878, 2019.
  5. P. Sharma et al., “Student engagement detection using emotion analysis, eye tracking and head movement with machine learning,” in Communications in Computer and Information Science, Cham: Springer Nature Switzerland, 2022, pp. 52–68.
  6. K. Chen, “Sitting Posture Recognition Based on OpenPose,” IOP Conf,” A Gamified Virtual Learning Environment to Enhance Online Teaching and Learning Experience, vol. 677, 2019.
  7. W. C. M. K. Tharaka, R. M. T. Dilanka, H. D. D. S. Perera, R. H. C. S. Rathnayake, N. Kodagoda, and K. Suriyawansa, A Gamified Virtual Learning Environment to Enhance Online Teaching and Learning Experience.
  8. L. Tang, C. Gao, X. Chen, and Y. Zhao, “Pose detection in complex classroom environment based on improved Faster RCNN,” IET Image Process., vol. 13, no. 3, pp. 451–457, 2019.
  9. Tan, Fuwen, Song Feng, and Vicente Ordonez. "Text2scene: Generating compositional scenes from textual descriptions." In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 6710-6719. 2019.
  10. Reed, Scott, Zeynep Akata, Xinchen Yan, Lajanugen Logeswaran, Bernt Schiele, and Honglak Lee. "Generative adversarial text to image synthesis." In International conference on machine learning, pp. 1060-1069. PMLR, 2016.
  11. Narawita, C.R. and Vidanage, K. (2017). "UML generator - An automated system for model-driven development." In 16th International Conference on Advances in ICT for Emerging Regions, ICTer 2016 - Conference Proceedings, pp. 250-256. Available from: https://doi.org/10.1109/ICTER.2016.7829928 [Accessed 25 October 2022].
  12. S. Ghosh et al., "Automated generation of e-r diagram from a given text in natural language," in Proceedings - International Conference on Machine Learning and Data Engineering, iCMLDE 2018, pp. 97-102, 2019. Available: https://doi.org/10.1109/ICMLDE.2018.00026. Accessed: Oct. 13, 2022.
  13. J. Hu, Y. Zhou, and L. Zhang, "Automatic Attendance System Based on Face Recognition," in 2016 IEEE International Conference on Image Processing (ICIP), Phoenix, AZ, USA, 2016, pp. 3788-3792.
  14. M. R. Islam, S. K. M. Rahman, and S. Saha, "Analysis of Student Interaction Patterns on Educational Websites using Heatmap Visualization," in 2018 IEEE Region 10 Symposium (TENSYMP), Dhaka, Bangladesh, 2018, pp. 601-606.
  15. S. H. Ahn and S. D. Lee, "Classification of Educational Websites using Machine Learning Algorithms," in 2019 IEEE International Conference on Big Data and Smart Computing (BigComp), Kyoto, Japan, 2019, pp. 1-4.
  16. S. Islam, M. R. Kabir, and A. Roy, "Automated Attendance and Engagement Monitoring System for E-learning Platforms," in 2020 IEEE 11th Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON), Vancouver, BC, Canada, 2020, pp. 567-572.