Human, Object and Pose Detection for Theft Prevention through Surveillance System

Abstract

The rise in theft incidents within institutional spaces has prompted the need for innovative security solutions. In response to this challenge, our research focuses on the development and implementation of a comprehensive theft prevention system through object and pose detection technologies. We employ cutting-edge techniques and models to safeguard institutional property and create a secure environment. For object detection, we leverage the powerful ”Segment Anything” model, which enables us to identify and track objects within the institutional space. This model provides us with a robust foundation for monitoring and safeguarding valuable items. In our pursuit of advanced object detection and classification, we explore the capabilities of multiple machine learning models, including Ridge, Logistic, Random Forest, and Gradient Boosting. These models enhance our ability to accurately classify objects and further strengthen our theft prevention strategies. Additionally, we utilize the state-of-the-art Media pipe Holistic model for real-time pose detection, enabling us to identify human poses and behaviors within the institutional space. This valuable insight adds an extra layer of security by recognizing suspicious activities and potential threats. Our research encompasses a holistic approach to security, integrating object and pose detection to ensure the highest level of theft prevention. By combining these technologies, we aim to significantly reduce theft incidents and enhance security within institutional spaces. As we continue to advance our research, we anticipate future challenges and complexities related to the integration of these technologies. This research sets the stage for ongoing exploration and innovation in the realm of institutional security, ultimately contributing to safer and more secure environments.

Country : Sri Lanka

1 Chathuranga K. G. S2 Vidanage K. H3 Dr. Harinda Fernando4 Dr. Lakmini Abeywardhana

  1. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  2. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  3. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka
  4. Faculty of Computing, Sri Lanka Institute of Information Technology, Malabe, Sri Lanka

IRJIET, Volume 7, Issue 11, November 2023 pp. 160-169

doi.org/10.47001/IRJIET/2023.711023

References

  1. A Review of Yolo Algorithm Developments. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S1877050922001363 [2]Bo Wan, Desen Zhou, Yongfei Liu, Rongjie Li, Xuming He; Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2019, pp. 9469-9478.
  2. Wang, Limin, et al. ”Temporal segment networks: Towards good practices for deep action recognition.” Proceedings of the European Conference on Computer Vision. 2018.
  3. R. Punmiya and S. Choe, ”Energy Theft Detection Using Gradient Boosting Theft Detector With Feature Engineering-Based Preprocess- ing,” in IEEE Transactions on Smart Grid, vol. 10, no. 2, pp. 2326-2329, March 2019, doi: 10.1109/TSG.2019.2892595.
  4. M.  Kisantal,  S.  Sharma,  T.  H.  Park,  D.  Izzo,  M.  M  a¨rtens  and  S. D’Amico, ”Satellite Pose Estimation Challenge: Dataset,  Competi-  tion Design, and Results,” in IEEE Transactions on Aerospace and Electronic Systems, vol. 56, no. 5, pp. 4083-4098, Oct. 2020, doi: 10.1109/TAES.2020.2989063.
  5. G. Rogez, P.  Weinzaepfel and C. Schmid, ”LCR-Net++: Multi-Person  2D and 3D Pose Detection in Natural Images,” in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 5, pp. 1146- 1161, 1 May 2020, doi: 10.1109/TPAMI.2019.2892985.
  6. Pauzi, A.S.B. et al. (2021). Movement Estimation Using Mediapipe Blaze Pose. In: Badioze Zaman, H., et al. Advances in Visual Informatics. IVIC 2021. Lecture Notes in Computer Science(), vol 13051. Springer, Cham. https://doi.org/10.1007/978-3-030-90235-3-49.
  7. X. Yang, H. Sun, X. Sun, M. Yan, Z. Guo and K. Fu, ”Position Detection and Direction Prediction for Arbitrary-Oriented Ships via Multitask Rotation Region Convolutional Neural Network,” in IEEE Access, vol. 6, pp. 50839-50849, 2018, doi: 10.1109/ACCESS.2018.2869884.
  8. Yin Li, Xiaodi Hou, Christof Koch, James M. Rehg, and Alan L Yuille. 2014. . The secrets of salient object segmentation. In Proceedings of the IEEE Conference.
  9. A Comparative Study of Multiple Object Detection Using Haar-Like Feature Selection and Local Binary Patterns in Several Platforms. [On- line]. Available: https://www.hindawi.com/journals/mse/2015/948960/
  10. Real-Time Tracking of Multiple People Using Continuous Detection. [Online].
  11. R. De Geest and T. Tuytelaars, ”Modeling Temporal Structure with LSTM for Online Action Detection,” 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), Lake Tahoe, NV, USA, 2018, pp. 1549-1557, doi: 10.1109/WACV.2018.00173.
  12. C. Peng and Q. Cheng, ”Discriminative Ridge Machine: A Classifier for High-Dimensional Data or Imbalanced Data,” in IEEE Transactions on Neural Networks and Learning Systems, vol. 32, no. 6, pp. 2595-2609, June 2021, doi: 10.1109/TNNLS.2020.3006877.
  13. A survey of techniques for human detection from video. [Online]. Avail- able: http://www.cs.umd.edu/grad/scholarlypapers/papers/neetiPaper.pdf
  14. J.  Yun   et  al.,  ”Grasping  Pose  Detection  for  Loose  Stacked  Ob-    ject Based on Convolutional Neural Network with Multiple Self- Powered Sensors Information,” in IEEE Sensors Journal, 2022, doi: 10.1109/JSEN.2022.3190560.
  15. YOLO-ACN: Focusing on Small Target and Occluded Object Detection. [Online].
  16. Hetang, Congrui, et al. ”Impression network for video object detection.” Proceedings of the European Conference on Computer Vision. 2020. [18]Chuan Yang, Lihe Zhang, Huchuan Lu, Xiang Ruan, and Ming-Hsuan Yang. 2013. Saliency detection via graph-based.
  17. G. Eason, B. Noble, and I. N. Sneddon, ”On certain integrals of Lipschitz-Hankel type involving products of Bessel functions,” Phil. Trans. Roy. Soc. London, vol. A247, pp. 529–551, April 1955. [Online]. Available: https://arxiv.org/pdf/1712.05896.pdf
  18. C. Lugaresi, J. Tang, H. Nash, C. McClanahan, E. Uboweja, M. Hays, F. Zhang, C.-L. Chang, M. Yong, J. Lee, W.-T. Chang, W. Hua, M. Georg, M. Grundmann (2019) MediaPipe: a framework for building perception pipelines.
  19. Feichtenhofer, Christoph, et al., “Detect to track and track to detect.” Proceedings of the IEEE International Conference on Computer Vision. 2017.
  20. Sun, Xingyi, et al. ”Deep high-resolution representation learning for visual recognition.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2019.
  21. F. Zhang, V. Bazarevsky, A. Vakunov, A. Tkachenka, G. Sung, C.L. Chang, and M. Grundmann, ”MediaPipe Hands: On-device Real- time Hand Tracking,” in Proceedings of CVPR Workshop on Computer Vision for Augmented and Virtual Reality, Seattle, WA, USA, 2020, pp. 5 pages, 7 figures. [Online]. Available: https://arxiv.org/abs/2006.10214
  22. Human Detection Using Oriented Histograms of Flow and Appearance. [Online].
  23. W. Shi, J. Cao, Q. Zhang, Y. Li and L. Xu, ”Edge Computing: Vision and Challenges,” in IEEE, 2020.
  24. T. Baltru sˇaitis, P. Robinson and L.-P. Morency, “OpenFace: An open source facial behavior analysis toolkit,” in IEEE Transactions on Bio- metrics, Behavior, and Identity Science, 2022.
  25. F. D. P.,. Z. C. L. Chaoning Zhang, “A Survey on Segment Anything Model (SAM): Vision Foundation Model Meets Prompt Engineering,” 2023.
  26. H. N.-p. 1. R. a. R. D. Behzad Mirzaei, “Small Object Detection and Tracking: A Comprehensive Review,” 2023.
  27. W. Li1, “Analysis of Object Detection Performance Based on Faster RCNN,” in Journal of Physics: Conference Series, 2021.
  28. C. Wan, “Gait Recognition Based on Deep Learning: A Survey,” Brazil, 2022.
  29. M. Mehra, V. Sahai, P.  Chowdhury and  E.  Dsouza, “Home Security System using IOT and AWS Cloud Services,” in IEEE Trust- com/BigDataSE/ICESS, 2017.
  30. “Local ridge regression for face recognition,” in Hui Xue, Yulian Zhu, 2009.
  31. D. Sudiana, M. Rizkinia and F. Alamsyah, “Performance Evaluation of Machine Learning Classifiers for Face Recognition,” in IEEE, Depok, Indonesia, 2021.