International Research Journal of Innovations in Engineering and Technology - IRJIET International Open Access, Monthly, Peer Reviewed, Reputed Journal ISSN (online): 2581-3048

Impact Factor (2025): 6.9

DOI Prefix: 10.47001/IRJIET

SignMath: Enhancing Mathematical Skills for Hearing-Impaired Students through Interactive Sign Language Learning

Abstract

This research paper explores the development and impact of SignMath, a groundbreaking web application designed to address the unique challenges faced by deaf children in their mathematics education. With a significant population of deaf children and a prevalence of illiteracy, there is an urgent need for inclusive educational solutions that cater to their specific needs. SignMath integrates sign language, machine learning, and interactive learning materials to create an accessible and engaging mathematics learning environment. By leveraging visual aids, personalized learning features, and the seamless integration of sign language with mathematical concepts, SignMath aims to improve numeracy skills and promote inclusivity for deaf children in primary education. The paper discusses the design and development process of SignMath, highlighting its innovative features and pedagogical approach. Furthermore, an evaluation of Sign Math’s effectiveness and usability is presented, showcasing its potential to enhance mathematical understanding, and learning outcomes for deaf children. The research paper concludes by emphasizing the significance of SignMath in promoting equitable access to quality mathematics education and fostering the educational success of deaf children in Sri Lanka.

Country : Sri Lanka

1 Praveen Deshan P.A.2 Lakshitha W.A.G.3 Wickramarathna T.D.4 Thathsarani G.D.5 Wijendra D.6 Krishara J.

  1. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka
  2. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka
  3. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka
  4. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka
  5. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka
  6. Faculty of Computing, Sri Lanka Institute of Information Technology, New Kandy Road, Malabe, Sri Lanka

IRJIET, Volume 7, Issue 11, November 2023 pp. 185-192

doi.org/10.47001/IRJIET/2023.711026

Full Paper
Download

References

  1. P. S. Rajam and G. Balakrishnan, “Recognition of Tamil Sign Language Alphabet using Image Processing to aid Deaf-Dumb People,” Procedia Eng., vol. 30, pp. 861–868, 2012, doi: 10.1016/j.proeng.2012.01.938.
  2. M. A. Et. al., “TAMIL SIGN LANGUAGE RECOGNITION IN REAL TIME,” Inf. Technol. Ind., vol. 9, no. 2, pp. 1112–1116, 2021, doi: 10.17762/itii.v9i2.459.
  3. R. Raavi and P. C. K. Hung, “American Sign Language Detection,” in Encyclopedia of Computer Graphics and Games, 2023, pp. 1–3. doi: 10.1007/978-3-319-08234-9_483-1.
  4. J. Henner, C. Pagliaro, S. Sullivan, and R. Hoffmeister, “Counting Differently: Assessing Mathematics Achievement of Signing Deaf and Hard of Hearing Children Through a Unique Lens,” Am. Ann. Deaf, vol. 166, no. 3, pp. 318–341, 2021, doi: 10.1353/aad.2021.0023.
  5. E. Ray, “Discovering mathematics: The challenges that deaf/hearing-impaired children encounter,” in ACE Papers, 2001, pp. 62–75. [Online]. Available: https://researchspace.auckland.ac.nz/bitstream/handle/2292/25109/ACE_Paper_6_Issue_11.pdf?sequence=1
  6. C. M. Pagliaro and K. L. Kritzer, “The Math Gap: A Description of the Mathematics Performance of Preschool-aged Deaf/Hard-of-Hearing Children,” J. Deaf Stud. Deaf Educ., vol. 18, no. 2, pp. 139–160, Apr. 2013, doi: 10.1093/deafed/ens070.
  7. S. J. Swetha and S. R. Mary, “Tamil Sign Language Recognition using Machine Learning to Aid Deaf and Dumb People,” Int. Res. J. Eng. Technol., p. 3195, 2008, [Online]. Available: www.irjet.net
  8. P. Fernando and P. Wimalaratne, “Sign Language Translation Approach to Sinhalese Language,” GSTF J. Comput., vol. 5, no. 1, p. 9, Sep. 2016, doi: 10.7603/s40601-016-0009-8.
  9. A.Thahseen, N. Aaron, and T. Fernando, “Smart System to Support Hearing Impaired Students in Tamil,” 2023.
  10. M. N. Saiful et al., “Real-Time Sign Language Detection Using CNN,” in 2022 International Conference on Data Analytics for Business and Industry (ICDABI), IEEE, Oct. 2022, pp. 697–701. doi: 10.1109/ICDABI56818.2022.10041711.
  11. D. Kothadiya, C. Bhatt, K. Sapariya, K. Patel, A.-B. Gil-González, and J. M. Corchado, “Deepsign: Sign Language Detection and Recognition Using Deep Learning,” Electronics, vol. 11, no. 11, p. 1780, Jun. 2022, doi: 10.3390/electronics11111780.
  12. M. Schindler, J. H. Doderer, A. L. Simon, E. Schaffernicht, A. J. Lilienthal, and K. Schäfer, “Small number enumeration processes of deaf or hard-of-hearing students: A study using eye tracking and artificial intelligence,” Front. Psychol., vol. 13, Aug. 2022, doi: 10.3389/fpsyg.2022.909775.
  13. V. Mishra, J. Uppal, H. Srivastav, D. Agarwal, and Harshit, “Sign Language Recognition for Indian Sign Language,” 2023, pp. 161–170. doi: 10.1007/978-981-99-3250-4_12.
  14. A.Stančić, V. Vyroubal, and V. Slijepčević, “Classification Efficiency of Pre-Trained Deep CNN Models on Camera Trap Images,” J. Imaging, vol. 8, no. 2, p. 20, Jan. 2022, doi: 10.3390/jimaging8020020.
  15. T. Diwan, G. Anirudh, and J. V. Tembhurne, “Object detection using YOLO: challenges, architectural successors, datasets and applications,” Multimed. Tools Appl., vol. 82, no. 6, pp. 9243–9275, Mar. 2023, doi: 10.1007/s11042-022-13644-y.
  16. S. Dixit and N. Soni, “Comparative Study on Image Detection using Variants of CNN and YOLO,” in 2022 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COM-IT-CON), IEEE, May 2022, pp. 201–207. doi: 10.1109/COM-IT-CON54601.2022.9850748.
  17. J. Du, “Understanding of Object Detection Based on CNN Family and YOLO,” J. Phys. Conf. Ser., vol. 1004, p. 012029, Apr. 2018, doi: 10.1088/1742-6596/1004/1/012029.
  18. W. Liu, G. Ren, R. Yu, S. Guo, J. Zhu, and L. Zhang, “Image-Adaptive YOLO for Object Detection in Adverse Weather Conditions,” in Proceedings of the 36th AAAI Conference on Artificial Intelligence, AAAI 2022, Jun. 2022, pp. 1792–1800. doi: 10.1609/aaai.v36i2.20072.

Copyright @ 2026-2017 IRJIET. All Right Reserved.

Developed by Byzero Technologies