Cursor Movement by Hand Gestures

Abstract

Our project develops a system that can recognize the air-written words in 3D space, and then classify the recognized character into one of the possible classes. Air-writing is the new way of writing the linguistic characters or words in free area using hand or finger movements. Writing within the air may be a method to jot down one thing in an exceedingly 3D house with our finger-tip. This paper presents a simple yet effective air-writing recognition approach based on deep convolutional neural networks (CNNs). A robust and efficient hand tracking algorithm is proposed to extract air-writing trajectories collected by a single web camera. The algorithm addresses the push-to-write problem and avoids restrictions on the users’ writing without using a delimiter and an imaginary box. A novel preprocessing scheme is also presented to convert the writing trajectory into appropriate forms of data, making the CNNs trained with these forms of data simpler and more effective. This project could be a combination of computer vision object chase and handwriting recognition machine learning. The air writing recognition system uses the digital camera of a pc to trace character, digits written within the air by the user and then uses a convolutional neural network to classify the character and digits into one of the possible classes. Several current systems use advanced and high-priced chase setups to realize gesture recognition, however, we tend to get to form a system that may attain similar work with a far cheaper setup.

Country : India

1 Umesh Bhosale2 Abhishek Badade3 Rushikesh Bhalerao4 Samiksha Chorge5 Prof. M.P. Desai

  1. Student, Information Technology, Smt. Kashibai. Navale College of Engineering, Pune, Maharashtra, India
  2. Student, Information Technology, Smt. Kashibai. Navale College of Engineering, Pune, Maharashtra, India
  3. Student, Information Technology, Smt. Kashibai. Navale College of Engineering, Pune, Maharashtra, India
  4. Student, Information Technology, Smt. Kashibai. Navale College of Engineering, Pune, Maharashtra, India
  5. Professor, Information Technology, Smt. Kashibai. Navale College of Engineering, Pune, Maharashtra, India

IRJIET, Volume 8, Issue 3, March 2024 pp. 242-246

doi.org/10.47001/IRJIET/2024.803035

References

  1. Badi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., Devin, M. and Ghemawat, S., 2015. TensorFlow: Large-scale machine learning on heterogeneous systems.
  2. Bradski, G., 2000. The openCV library. Dr. Dobb’s Journal: Software Tools for the Pro- fessional Programmer, 25(11), pp.120-123.
  3. Ganger, M., Duryea, E. and Hu, W., 2016. Double Sarsa and double expected Sarsa with shallow and deep learning. Journal of Data Analysis and Information Processing, 4(4), pp.159-176.
  4. Gregory Cohen, Saeed Afshar, Jonathan Tapson, and Andre´ van Schaik. 2017. EMNIST: an extension of MNIST to handwritten letters. arXiv preprint arXiv:1702.05373 (2017).
  5. F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
  6. K. Gaurav and Bhatia P. K., “Analytical Review of Preprocessing Techniques for Offline Handwritten Character Recognition”, 2nd International Conference on Emerging Trends in Engineering Management, ICETEM, 2013.
  7. Renata F. P. Neves, Alberto N. G. Lopes Filho, Carlos A.B.Mello, Cleber Zanchettin, “A SVM Based Off-Line Handwritten Digit Recognizer”, International conference on Sys- tems, Man and Cybernetics, IEEE Xplore, pp. 510-515, 9-12 Oct, 2011, Brazil.
  8. Air-writing Recognition, Part 1: Modeling and Recognition of Characters, Words and Connecting Motions Mingyu Chen, Ghassan AlRegib, Senior Member, IEEE, and Biing- Hwang Juang, Fellow, IEEE.
  9. C.-M. Karat, C. Halverson, D. Horn, and J. Karat, “Patterns of entry and correction in large vocabulary continuous speech recognition systems,” in Proc. of the SIGCHI Conference on Human Factors in Computing Systems, 1999, pp. 568–575.
  10. Yuan-Hsiang Chang, Chen-Ming Chang, “Automatic Hand-Pose Trajectory Tracking Sys- tem Using Video Sequences”, INTECH, pp. 132- 152, Croatia, 2010.