Third Eye - A Voice Assistant-Based Mobile Application for Blind and Colorblind People

Abstract

The eye is one of the five major sensory organs of a living being. Because some situations and incidents can be cured and treated but others cannot, losing sight causes a person to become partially deactivated in his or her daily activities. The two most common conditions that cannot be easily cured in a variety of situations are total blindness and color blindness. Even though there are many traditional and modern assistive devices, most of them are unable to meet the requirements of visually impaired people because of usability, data accuracy, and cost issues. The ideology behind this research was to develop a mobile application that helps visually challenged people do their daily tasks without any external assistance. Instead of using an external device, this system recommends hanging up the phone using a code or keeping the phone in the upper pocket of the shirt so that the phone's camera can easily capture the data. This developed mobile application’s aim is to help visually challenged people do their daily tasks without external assistance. It activates an intelligent voice assistant to guide the user using voice commands in navigation, object identification, text, and currency reading, and also weather forecasting. The application also helps colorblind people identify which color blindness category they belong to by using Ishihara test plates. The goal is to reduce the latency of data processing and increase the accuracy and effectiveness of this application.

Country : Sri Lanka

1 Costa M.C.J.2 Amarasinghe A.D.3 Jayasekara K.D.J.4 Aththanayake A.M.N.D.5 Uthpala Samarakoon6 Suriyaa Kumari

  1. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  2. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  3. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  4. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  5. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  6. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka

IRJIET, Volume 7, Issue 6, June 2023 pp. 12-19

doi.org/10.47001/IRJIET/2023.706003

References

  1. A.A. Díaz-Toro, S. E. Campaña-Bastidas, and E. F. Caicedo-Bravo, “Vision-Based System for Assisting Blind People to Wander Unknown Environments in a Safe Way,” Journal of Sensors, vol. 2021, p. e6685686, Mar. 2021, doi: 10.1155/2021/6685686.
  2. M. Z. Wale, Y. Abebe, Y. Adamu, and A. Zelalem, “Prevalence of color blindness among school children in three primary schools of Gish –Abay town district, Amhara regional state, north-west Ethiopia,” BMC Ophthalmology, vol. 18, no. 1, Nov. 2018, doi: 10.1186/s12886-018-0970-4.
  3. J. A. Barry, S. Mollan, M. A. Burdon, M. Jenkins, and A. K. Denniston, “Development and validation of a questionnaire assessing the quality of life impact of Colour Blindness (CBQoL),” BMC Ophthalmology, vol.17, no.1, Oct.2017, doi:10.1186/s12886-017-0579-z.
  4. “Saliency-based image correction for colorblind patients - researchgate.” [Online]. Available: https://www.researchgate.net/publication/342092723_Saliencybased_image_correction_for_colorblind_patients. [Accessed: 13-Oct-2022]
  5. M. Bousbia-Salah, M. Bettayeb, and A. Larbi, “A Navigation Aid for blind people,” Journal of Intelligent & Robotic Systems, vol.64, no.3, pp. 387–400, 2011.
  6. A.Abdolrahmani, R. Kuber, and S. M. Branham, “Siri talks at you,” Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 2018.
  7. H. Jiang, T. Gonnot, W.-J. Yi, and J. Saniie, “Computer Vision and text recognition for assisting visually impaired people using Android smartphone,” 2017 IEEE International Conference on Electro Information Technology (EIT), 2017.
  8. A.A. Panchal, S. Varde, and M. S. Panse, “Character detection and recognition system for visually impaired people,” 2016 IEEE International Conference on Recent Trends in Electronics, Information & amp; Communication Technology (RTEICT), 2016.
  9. “Research advances of indoor navigation for blind people: A brief review ...” [Online]. Available: https://ieeexplore.ieee.org/document/9126068/. [Accessed: 28-Feb-2023]
  10. E. Cardillo and A. Caddemi, “Insight on Electronic Travel AIDS for visually impaired people: A review on the electromagnetic technology,” MDPI, 04-Nov-2019. [Online]. Available: https://www.mdpi.com/2079-9292/8/11/1281. [Accessed: 14-Jan-2023]
  11. A.Badave, R. Jagtap, R. Kaovasia, S. Rahatwad, and S. Kulkarni, “Android based Object Detection System for visually impaired,” 2020 International Conference on Industry 4.0 Technology (I4Tech), 2020.