Integrated Assistive System for Precise Indoor Navigation, Object Recognition, and Interaction for Visually Impaired Individuals

Lakmal RupasingheAssistant Professor, Faculty of Computing, Computer Systems Engineering, Sri Lanka Institute of Information Technology, Malabe, Sri LankaChethana LiyanapathiranaLecturer, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri LankaCaldera H.P.Y.RUndergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri LankaHerath H.M.T.YUndergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri LankaDharmarathna T.O.MUndergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri LankaHeshan T.H.CUndergraduate, Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka

Vol 7 No 10 (2023): Volume 7, Issue 10, October 2023 | Pages: 177-184

International Research Journal of Innovations in Engineering and Technology

OPEN ACCESS | Research Article | Published Date: 29-10-2023

doi Logo doi.org/10.47001/IRJIET/2023.710023

Abstract

Indoor navigation poses significant challenges for those with visual impairments. To address this, an integrated system is proposed, aiming to empower visually impaired individuals by enhancing their indoor navigation and object recognition capabilities, ultimately promoting independence and safety. This innovative system amalgamates cutting-edge technologies such as IoT, deep learning, and machine learning. It incorporates IoT for real-time object detection, precise distance estimation, and collision avoidance features, ensuring users are well-informed about their surroundings. Moreover, the system employs a Wi-Fi-based indoor positioning system, combining machine learning algorithms and triangulation techniques to provide accurate indoor localization data, a critical component for effective navigation. To further enhance user experience, an audio assistant integrated into a mobile application leverages machine learning. This assistant delivers real-time guidance, object descriptions, and contextual information, enabling users to interact naturally with the system. This comprehensive research paper thoroughly explores the system's components, the underlying technologies that power it, and the results of comprehensive evaluations. It holds the promise of significantly improving the indoor navigation experience and quality of life for individuals with visual impairments.

Keywords

Internet of Things, Indoor Positioning, Object Detection, Path Planning


Citation of this Article

Lakmal Rupasinghe, Chethana Liyanapathirana, Caldera H.P.Y.R, Herath H.M.T.Y, Dharmarathna T.O.M, Heshan T.H.C, “Integrated Assistive System for Precise Indoor Navigation, Object Recognition, and Interaction for Visually Impaired Individuals” Published in International Research Journal of Innovations in Engineering and Technology - IRJIET, Volume 7, Issue 10, pp 177-184, October 2023. Article DOI https://doi.org/10.47001/IRJIET/2023.710023

References
  1. Siddharth Sagar Nijhawan; Aditi Kumar; Shubham Bhardwaj; Geeta Nijhawan “Real-time Object Detection for Visually Impaired with Optimal Combination of Scores”.
  2. Amlan Basu; KeeratiKaewrak; Lykourgos Petropoulakis; Gaetano Di Caterina; John J. Soraghan “Indoor Home Scene Recognition through Instance Segmentation Using a Combination of Neural Networks”.
  3. Behnaz Bahmei; Elina Birmingham; Siamak Arzanpour “CNN-RNN and Data Augmentation Using Deep Convolutional Generative Adversarial Network for Environmental Sound Classification”Bahl, P., & Padmanabhan, V. N. (2000). RADAR: An In-Building RF-based User Location and Tracking System. Proceedings IEEE INFOCOM 2000. doi:10.1109/infcom.2000.832252.
  4. Hightower, J., & Borriello, G. (2001). Location Systems for Ubiquitous Computing. Computer, 34(8), 57-66. doi:10.1109/2.940014.
  5. Ashraf, I., Hur, S., & Park, Y. (2018). BLocate: A building identification scheme in GPS denied environments using smartphone sensors. Gyeongbuk: Yeungnam University.
  6. Ashraf, I., Hur, S., & Park, Y. (2019). Indoor Positioning on Disparate Commercial.
  7. Youssef, M. A., Agrawala, A., & Ullah, S. (2007). The Horus WLAN Location Determination System. International Journal of Computer Science and Network Security, 7(12), 264-271.
  8. H. Z. A. C. Ye, "An Indoor Wayfinding System Based on Geometric Features Aided Graph SLAM for the Visually Impaired," IEEE, p. 13, 2017.
  9. A.L.F.B. Xiaojing Zhanga, "Optimization-Based Collision Avoidance," p. 27, 2018.
  10. R. K. K. S. T. B. A. L. G. D. R. Hsueh-Cheng Wang, "Enabling Independent Navigation for Visually Impaired People through a Wearable Vision-Based Feedback System," p. 8.
  11. S. M. Felix, S. Kumar and A. Veeramuthu, "A Smart Personal AI Assistant for Visually," in Proceedings of the 2nd International Conference on Trends in Electronics and Informatics, 2018.