Android Application for Sign Language to Text and Speech Conversation

Abstract

Living in the 21st century we are still facing the problem of communicating deaf and dumb disability people. As we know they having a particular set of sign languages they make gestures through hands to convey their message to the opposite person but in the major of cases sign language becomes a barrier for a normal person because only the trained person can understand it by decoding the sign gesture. So this project deals with an application which will translate some common sign language gesture through image processing by detecting the hand gestures via mobile camera and convert into a text message format and send it through the social media site so the person with no knowledge of sign language gestures can also understand it and communicate with the opposite person. The proposed system will fully be based on the software and try to reduce the hardware burdens of the existing one. It will help to reduce the language barrier from the deaf and dumb community.

Country : India

1 Prof. Sagar S. Mane2 Swapnil Ohol3 Adarsh Nayse4 Akshay Patil5 Rohit Teke

  1. Professor, Department of Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  2. Student, Department of Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  3. Student, Department of Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  4. Student, Department of Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India
  5. Student, Department of Computer Engineering, NBN Sinhgad Technical Institutes Campus, Pune, Maharashtra, India

IRJIET, Volume 8, Issue 4, April 2024 pp. 330-335

doi.org/10.47001/IRJIET/2024.804052

References

  1. Raghavendhar Reddy.B, Mahender.E, “Speech to Text Conversion using Android Platform”, International Journal of Engineering Research and Applications (IJERA) Vol. 3, Issue 1, pp.253-258, January -February 2013.
  2. Sangeetha, K. and Barathi Krishna, L. “Gesture Detection for Deaf and Dumb People ” International Journal of Development Research Vol. 4, Issue, 3, pp. 749-752, March, 2014.
  3. Shanmukha Swamy, Chethan M P, Mahantesh Gatwadi, “Indian Sign Language Interpreter with Android Implementation”, International Journal of Computer Applications (0975 – 8887) Volume 97– No.13, pp. 36-41, July 2014.
  4. Sinora Ghosalkar, Saurabh Pandey, Shailesh Padhra, Tanvi Apte, “Android Application on Examination Using Speech Technology for Blind People”, International Journal of Research in Computer and Communication Technology, Vol 3, Issue3, March-2014.
  5. Tapas Kumar Patra, Biplab Patra, Puspanjali Mohapatra, “Text to Speech Conversion with Phonematic Concatenation”, International Journal of Electronics Communication and Computer Technology (IJECCT) Volume 2 Issue 5 , pp.223-226, September 2012.
  6. Hand Gesture Recognition and Voice Conversion for Deaf and Dumb, Rupesh Prajapati1, Vedant Pandey2, Nupur Jamindar3, Neeraj Yadav4, Prof. Neelam Phadnis, Department of Computer Engineering, Shree L.R. Tiwari College of Engineering, Maharashtra, India 16).
  7. Design of Communication Interpreter for Deaf and Dumb Person, Pallavi Verma1, Shimi S. L. 2, Richa Priya darshani 3 Electrical and Electronics Department, Amity University, Greater Noida, Uttar Pradesh, India 2Assistant Professor, NITTTR, Chandigarh, India.
  8. Design and Implementation of A Sign to Speech/Text System for Deaf and Dumb People, DalalAbdulla, Shahrazad Abdulla and Rameesa Manaf Electrical and Computer Engineering Department University of Sharjah Sharjah 27272, UAE.
  9. Sign Language Recognition, Anup Kumar, Karun Thank achan and Mevin M. Dominic Department of Computer Science and Engineering National Institute of Technology, Calicut, India 673601.
  10. Image Caption Generation using Deep Learning Technique, Chetan Amritkar Department of EnTC Vishwakarma Institute of Technology Pune, India.