Android Application for Sign Language to Text and Speech Conversation

Abstract

Deaf and dumb persons are facing great challenges communicating with people in society despite the fact that they are part of the society and are enrolled in the normal school system where teaching and learning take place using spoken language. This challenge calls for the need to address the problem of communication through the use of mobile technology. Developing a mobile app to enhance learning and communication is of great importance and thus the focus of this paper. Obviously most of the applications available were developed using foreign languages which is not easy to use. In this paper, we introduce the Simple Sign Language Translator Application that will help people to learn and master sign language. So this project deals with an application which will translate some common sign language gesture through image processing by detecting the hand gestures via mobile camera and convert into a text message format and send it through the social media site so the person with no knowledge of sign language gestures can also understand it and communicate with the opposite person. The proposed system will fully be based on the software and try to reduce the hardware burdens of the existing one. It will help to reduce the language barrier from the deaf and dumb community.

Country : India

1 Prof. Sagar S. Mane2 Swapnil Ohol3 Adarsh Nayse4 Akshay Patil5 Rohit Teke

  1. Professor, Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  2. Student, Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  3. Student, Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  4. Student, Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  5. Student, Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India

IRJIET, Volume 7, Issue 12, December 2023 pp. 47-50

doi.org/10.47001/IRJIET/2023.712005

References

  1. Anant Maitrey, Vanshika Tyagi, Kanika Singhal, “A Framework for Sign Language to Speech Conversion Using Hand Gesture Recognition Method,” 2023 International Conference on Computational Intelligence, Communication Technology and Networking (CICTN) | 979-8-3503-3802-7/23/©2023 IEEE | DOI: 10.1109/CICTN57981.2023.1014073.
  2. Om Kumar C.U., K.P.K.Devan, Renukadevi .P, Adarsh Srinivas, “Real Time Detection and Conversion of Gestures to Text and Speech to Sign System,” 2022 3rd International Conference on Electronics and Sustainable Communication Systems (ICESC) | 978-1-6654-7971-4/22/©2022 IEEE | DOI: 10.1109/ICESC54411.2022.9885562.
  3. Sangeetha, K. and Barathi Krishna, L. “Gesture Detection for Deaf and Dumb People ” International Journal of Development Research Vol. 4, Issue, 3, pp. 749-752, March, 2014.
  4. Shanmukha Swamy, Chethan M P, Mahantesh Gatwadi, “Indian Sign Language Interpreter with Android Implementation”, International Journal of Computer Applications (0975 – 8887) Volume 97– No.13, pp. 36-41, July 2014.
  5. Sinora Ghosalkar, Saurabh Pandey, Shailesh Padhra, Tanvi Apte, “Android Application on Examination Using Speech Technology for Blind People”, International Journal of Research in Computer and Communication Technology, Vol 3, Issue3, March-2014.
  6. Tapas Kumar Patra, Biplab Patra, Puspanjali Mohapatra, “Text to Speech Conversion with Phonematic Concatenation”, International Journal of Electronics Communication and Computer Technology (IJECCT) Volume 2 Issue 5 , pp.223-226, September 2012.
  7. Hand Gesture Recognition and Voice Conversion for Deaf and Dumb (Rupesh Prajapati1, Vedant Pandey2, Nupur Jamindar3, Neeraj Yadav4, Prof. Neelam Phadnis, Department of Computer Engineering, Shree L.R. Tiwari College of Engineering, Maharashtra, India-16).
  8. Design of Communication Interpreter for Deaf and Dumb Person (Pallavi Verma1, Shimi S. L. 2, Richa Priyadarshani 3, Electrical and Electronics Department, Amity University, Greater Noida, Uttar Pradesh, India 2Assistant Professor, NITTTR, Chandigarh, India).
  9. Design and Implementation of A Signto Speech/Text System for Deaf and Dumb People (Dalal Abdulla, Shahrazad Abdulla and Rameesa Manaf Electrical and Computer Engineering Department University of Sharjah 27272, UAE Dalal_d@sharjah.ac.ae).
  10. Sign Language Recognition (Anup Kumar, Karun Thankachan and Mevin M. Dominic Department of Computer Science and Engineering National Institute of Technology, Calicut, India 673601).