3D Modeling of X-Ray Images using Virtual Reality

Abstract

Nowadays, advanced medical imaging is a widely accepted scientific discipline in the healthcare industry due to technological advances and software breakthroughs. Traditionally using digital images of X-Ray for diagnosing diseases in healthcare is very common. Many researchers have proposed different methods like X-Ray, CT-scan, and MRI for bone implantation. But the problem is while implantation it does not get the actual size as original, so it causes a bad impact on the health and the person suffers from pain. Therefore, to solve this problem, the proposed system uses a canny edge detection that can sketch the edges of knee bone present in an x-ray image with the size of the bone for implantation by using a virtual reality technique. The system will convert the 2D image to 3D and then the 3D model will be shown in a VR headset. So, we can get a clear visualization of the image. This model provides accurate measurements and detailed visualization of bones in virtual reality with 95.58% accuracy. Virtual reality-based visualization using X-ray images is more effective than CT-Scan in improving radiologists' accuracy and efficiency in diagnosing certain medical conditions, leading to a preference for X-ray images in certain diagnostic scenarios.

Country : India

1 Kevin Sheth2 Yash Paliwal3 Ajay Gaur4 Kadambari Kate5 Mrs. Sonal Fatangare

  1. Department of Computer Engineering, RMD Sinhgad School of Engineering, Warje Pune, India
  2. Department of Computer Engineering, RMD Sinhgad School of Engineering, Warje Pune, India
  3. Department of Computer Engineering, RMD Sinhgad School of Engineering, Warje Pune, India
  4. Department of Computer Engineering, RMD Sinhgad School of Engineering, Warje Pune, India
  5. Department of Computer Engineering, RMD Sinhgad School of Engineering, Warje Pune, India

IRJIET, Volume 7, Special Issue of ICRTET- 2023 pp. 177-185

IRJIET.ICRTET37

References

  1. Stolojescu-Crisan, Cristina, and Stefan Holban. "An Interactive X-Ray Image Segmentation Technique for Bone Extraction." In IWBBIO, pp. 1164-1171. 2014.
  2. Goswami, Baishali, and Santanu Kr Misra. "3D modeling of X-ray images: a review." International Journal of Computer Applications 132, no. 7 (2015): 40-46.
  3. Dixit, Sunanda, Vishwas G. Pai, Vivian Claud Rodrigues, Karan Agnani, and SR Vaishna Priyan. "3D reconstruction of 2D X-ray images." In 2019 4th International Conference on Computational Systems and Information Technology for Sustainable Solution (CSITSS), vol. 4, pp. 1-5. IEEE, 2019.
  4. Huang, Weicheng, Xun Cao, Ke Lu, Qionghai Dai, and Alan Conrad Bovik. "Toward naturalistic 2D- to-3D conversion." IEEE Transactions on Image Processing 24, no. 2 (2014): 724-733.
  5. Mamdouh, Rafeek, and M. Hazem. "El-Bakry, Alaa Riad, Nashaat El-Khamisy, Converting 2D-Medical Image Files “DICOM” into 3D-Models, based on Image Processing, and Analysing their Results with Python Programming." WSEAS Transactions on Computers 19 (2020): 10-20.
  6. Karade, Vikas, and Bhallamudi Ravi. "3D femur model reconstruction from biplane X-ray images: a novel method based on Laplacian surface deformation." International journal of computer assisted radiology and surgery 10 (2015): 473-485.
  7. Zhang, Lei, Zheng Wen Lai, and Mohd Asif Shah. "Construction of 3D model of knee joint motion based on MRI image registration." Journal of Intelligent Systems 31, no. 1 (2021): 15-26.
  8. Kim, Hangkee, Kisuk Lee, Dongchun Lee, and Nakhoon Baek. "3D reconstruction of leg bones from X-ray images using CNN-based feature analysis." In 2019 International Conference on Information and Communication Technology Convergence (ICTC), pp. 669-672. IEEE, 2019.
  9. Hnatkova, Eva, Petr Kratky, and Zdenek Dvorak. "Conversion of 2D medical scan data into 3D printed models." Advances in Environmental Sciences, Development and Chemistry (2014): 315-318.
  10. Van Sinh Nguyen, Manh Ha Tran and Hoang Minh Quang Vu, "A Research on 3D Model Construction from 2D DICOM," in International Conference on Advanced Computing and Applications (ACOMP), Can Tho, Vietnam, 2016.
  11. Gamage, Pavan, Sheng Quan Xie, Patrice Delmas, and Peter Xu. "3D reconstruction of patient specific bone models from 2D radiographs for image guided orthopedic surgery." In 2009 Digital Image Computing: Techniques and Applications, pp. 212-216. IEEE, 2009.
  12. Chernuhin, Nikita A. "On an approach to object recognition in X-ray medical images and interactive diagnostics process." In Ninth International Conference on Computer Science and Information Technologies Revised Selected Papers, pp. 1-6. IEEE, 2013.
  13. Dougherty, Geoff, ed. Medical image processing: techniques and applications. Springer Science & Business Media, 2011.
  14. Mahendran, S. K., and S. Santhosh Baboo. "Enhanced automatic X-ray bone image segmentation using wavelets and morphological operators." In Proc. of the International Conference on Information and Electronics Engineering. 2011.
  15. Stolojescu-CriŞan, Cristina, and Ştefan Holban. "A comparison of X-ray image segmentation techniques." Advances in electrical and computer engineering 13, no. 3 (2013): 85-92.
  16. Muthukrishman, R. and M. Radha., Edge Detection Techniques for Image Segmentation, International Journal of Computer Science & Information Technology (IJCSIT), Vol. 3, No. 6, Dec. 2011.
  17. Maini, Raman, and Himanshu Aggarwal. "Study and comparison of various image edge detection techniques." International journal of image processing (IJIP) 3, no. 1 (2009): 1-11.
  18. Lakshmi, S., and Dr V. Sankaranarayanan. "A study of edge detection techniques for segmentation computing approaches." IJCA Special Issue on “Computer Aided Soft Computing Techniques for Imaging and Biomedical Applications” CASCT (2010): 35-40.
  19. Thakare, Punam. "A study of image segmentation and edge detection techniques." International Journal on Computer Science and Engineering 3, no. 2 (2011): 899-904.
  20. Chen, Liang-Chieh, George Papandreou, Iasonas Kokkinos, Kevin Murphy, and Alan L. Yuille. "Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs." IEEE transactions on pattern analysis and machine intelligence 40, no. 4 (2017): 834-848.
  21. Al-Amri, Salem Saleh, N. V. Kalyankar, and S. D. Khamitkar. "Image segmentation by using edge detection." International journal on computer science and engineering 2, no. 3 (2010): 804-807.
  22. Yadav, D. P., and Sandeep Rathor. "Bone fracture detection and classification using deep learning approach." In 2020 International Conference on Power Electronics & IoT Applications in Renewable Energy and its Control (PARC), pp. 282-285. IEEE, 2020.
  23. Tanzi, Leonardo, Enrico Vezzetti, Rodrigo Moreno, and Sandro Moos. "X-ray bone fracture classification using deep learning: a baseline for designing a reliable approach." Applied Sciences 10, no. 4 (2020): 1507.
  24. Myint, Wint Wah, Khin Sandar Tun, and Hla Myo Tun. "Analysis on leg bone fracture detection and classification using X-ray images." Machine Learning Research 3, no. 3 (2018): 49-59.
  25. Tripathi, Ankur Mani, Abhishek Upadhyay, Akanksha Singh Rajput, Ajay Pal Singh, and Brajesh Kumar. "Automatic detection of fracture in femur bones using image processing." In 2017 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), pp. 1-5. IEEE, 2017.
  26. Johari, Nancy, and Natthan Singh. "Bone fracture detection using edge detection technique." In Soft Computing: Theories and Applications: Proceedings of SoCTA 2016, Volume 2, pp. 11-19. Springer Singapore, 2018.
  27. Kurniawan, Samuel Febrianto, I. DARMA PUTRA, and AA Kompiang Oka Sudana. "BONE FRACTURE DETECTION USING OPENCV." Journal of Theoretical & Applied Information Technology 64, no. 1 (2014).
  28. Anu, T. C., and R. Raman. "Detection of bone fracture using image processing methods." Int J Comput Appl 975 (2015): 8887.
  29. Cao, Yu, Hongzhi Wang, Mehdi Moradi, Prasanth Prasanna, and Tanveer F. Syeda-Mahmood. "Fracture detection in x-ray images through stacked random forests feature fusion." In 2015 IEEE 12th international symposium on biomedical imaging (ISBI), pp. 801-805. IEEE, 2015.
  30. Umadevi, N., and S. N. Geethalakshmi. "Multiple classification system for fracture detection in human bone x-ray images." In 2012 Third International Conference on Computing, Communication and Networking Technologies (ICCCNT'12), pp. 1-8. IEEE, 2012.
  31. Al-Amri, Salem Saleh, and Namdeo V. Kalyankar. "Image segmentation by using threshold techniques." arXiv preprint arXiv:1005.4020 (2010).
  32. Senthilkumaran, N., and Reghunadhan Rajesh. "Image segmentation-a survey of soft computing approaches." In 2009 International Conference on Advances in Recent Technologies in Communication and Computing, pp. 844-846. IEEE, 2009.
  33. Susmitha, A., A. Mishra, D. Sharma, P. Wadhwa, and L. Dash. "Implementation of canny’s edge detection technique for real world images." International Journal of Engineering Trends and Technology (IJETT) 48, no. 4 (2017): 176-181.
  34. Muthukrishnan, Ranjan, and Miyilsamy Radha. "Edge detection techniques for image segmentation." International Journal of Computer Science & Information Technology 3, no. 6 (2011): 259.
  35. Swathika, R., T. Sree Sharmila, and Debadyuti Bhattacharya. "Edge Detection Using Simple Image Arithmetic." In 2018 International Conference on Computer, Communication, and Signal Processing (ICCCSP), pp. 1-5. IEEE, 2018.
  36. Zhang, Chao-Chao, and Jian-Dong Fang. "Edge detection based on improved sobel operator." In 2016 International Conference on Computer Engineering and Information Systems, pp. 129-132. Atlantis Press, 2016.
  37. Kumar, S. N., A. Lenin Fred, Ajay H. Kumar, and Sebastin Varghese. "Medical image edge detection using Gauss Gradient operator." Journal of Pharmaceutical Sciences and Research 9, no. 5 (2017): 695.
  38. Bretaudeau, Francois. "A novel edge detection method based on efficient." International Journal of Advances in Intelligent Informatics 7, no. 2 (2021): 211-222.
  39. Yang, Lei, Xiaoyu Wu, Dewei Zhao, Hui Li, and Jun Zhai. "An improved Prewitt algorithm for edge detection based on noised image." In 2011 4th International congress on image and signal processing, vol. 3, pp. 1197-1200. IEEE, 2011.
  40. Acharjya, Pinaki Pratim, and Ritaban Das. "Study and comparison of different edge detectors for image segmentation." Global Journal of Computer Science and Technology 12, no. F13 (2012): 29-32.
  41. Myint, San, Aung Soe Khaing, and Hla Myo Tun. "Detecting leg bone fracture in x-ray images." International Journal of Scientific & Research 5 (2016): 140-144.