Online Blind Assistive System using Object Recognition

Abstract

Everybody deserve to live independently, especially those who disabled, with the last decades, technology gives attention to disabled to make them control their life as possible. In this work, assistive system for blind is suggested, to let him knows what is around him, by using YOLO for detecting objects within images and video streams quickly based on deep neural network to make accurate detection, and OpenCV under Python using Raspberry Pi3. The obtained results indicated the success of the proposed model in giving blind users the capability to move around in unfamiliar indoor outdoor environment, through a user friendly device by person and object identification model.

Country : Iraq

1 Abdul Muhsin M2 Farah F. Alkhalid3 Bashra Kadhim Oleiwi

  1. Control and Systems Engineering Department, University of Technology, Iraq
  2. Control and Systems Engineering Department, University of Technology, Iraq
  3. Control and Systems Engineering Department, University of Technology, Iraq

IRJIET, Volume 3, Issue 12, December 2019 pp. 47-51

References

  1. Kedar Potdar, Chinmay Pai and Sukrut Akolkar, ”A Convolutional Neural Network based Live Object Recognition System as Blind Aid”, arXiv:1811.10399v1 [cs.CV] 26 Nov 2018 https://arxiv.org/pdf/1811.10399.pdf
  2. Chi-Sheng, Hsieh. ”Electronic talking stick for the blind.” U.S. Patent No. 5,097,856, 24 Mar. 1992.
  3. Evanitsky, Eugene. ”Portable blind aid device.” U.S. Patent No. 8,606,316, 10 Dec. 2013.
  4. Cervantes, Humberto Orozco. ”Intelligent glasses for the visually impaired.” U.S. Patent No. 9,488,833. 8 Nov. 2016.
  5. Jothimani, A., Shirly Edward, and G. K. Divyashree. ”Object Identification for Visually Impaired.” Indian Journal of Science and Technology 9.S1, 2016.
  6. Zraqou, Jamal S., Wissam M. Alkhadour, and Mohammad Z. Siam.”Real-Time Objects Recognition Approach for Assisting Blind People”, 2017.
  7. Bay, Herbert, Tinne Tuytelaars, and Luc Van Gool. ”Surf: Speeded up robust features.” Computer vision ECCV 2006 (2006): 404-417.
  8. Rahul Kumar and Sukadev Meher, “Assistive System for Visually Impaired using Object Recognition, M.Sc. Thesis at Department of Electronics and Communication Engineering, National Institute of Technology Rourkela, Rourkela, Odisha-769 008, India, May 2015.
  9. Prof. Seema Udgirkar, Shivaji Sarokar, Sujit Gore, Dinesh Kakuste, Suraj Chaskar, 2006, “Object Detection System for Blind People,” International Journal of Innovative Research in Computer and Communication Engineering.
  10. Daniyal Rajput, Faheem Ahmed, Habib Ahmed, Engr Zakir Ahmed Shaikh, Aamir Shamshad, 2014, “Smart Obstacle Detector for Blind Person,” Journal of Biomedical Engineering and Medical Imaging.
  11. Khushboo Khurana, Reetu Awasthi, 2013, “Techniques for Object Recognition in Images and Multi-Object Detection,” International Journal of Advanced Research in Computer Engineering & Technology.
  12. Learning OpenCV 3by Gary Bradski, Adrian Kaehler Publisher: O'Reilly Media, Inc. Release Date: December 2016.
  13. Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi, “You Only Look Once: Unified, Real-Time Object Detection”, University of Washington, Allen Institute for AI , Facebook AI Research, 2016.
  14. J. Redmon and A. Farha, Yolov3: An incremental improvement. arXiv, 2018.
  15. J. Redmon and A. Farhadi. Yolo9000: Better, faster, stronger. In Computer Vision and Pattern Recognition (CVPR), 2017 IEEE Conference on, pages 6517–6525. IEEE, 2017.
  16. A.Culjak, D. Abram, T. Pribanic, H. Dzapo and M. Cifrek, A brief introduction to OpenCV," 2012 Proceedings of the 35th International Convention MIPRO, Opatija, 2012, pp. 1725-1730.