Title: Real-Time Fingertip Gesture Recognition for Embedded Systems
Year of Publication: 2017
Publisher: International Journal of Computer Systems (IJCS)
ISSN: 2394-1065
Series: Volume 04, Number 12, December 2017
Authors: Ji Kwang Kim, Jung Hwan Oh, Jun Hyeok Yang, Seung Eun Lee


Ji Kwang Kim, Jung Hwan Oh, Jun Hyeok Yang, Seung Eun Lee, "Real-Time Fingertip Gesture Recognition for Embedded Systems", In International Journal of Computer Systems (IJCS), pp: 176-179, Volume 4, Issue 12, December 2017. BibTeX

	author = {Ji Kwang Kim, Jung Hwan Oh, Jun Hyeok Yang, Seung Eun Lee},
	title = {Real-Time Fingertip Gesture Recognition for Embedded Systems},
	journal = {International Journal of Computer Systems (IJCS)},
	year = {2017},
	volume = {4},
	number = {12},
	pages = {176-179},
	month = {December}


Augmented and virtual reality systems depend on accurate, real-time hand and fingertip tracking for seamless integration between real objects and associated digital information. In this paper, we propose a real-time fingertip gesture recognition system. We adopt microelectromechanical system (MEMS) Gyroscope device for tracking the movement of the fingertip. The fingertip gesture is spotted and recognized based on cross-correlation and mean feature. Our system is implemented on Field-Programmable Gate Array (FPGA) and the experimental results show the feasibility of our system with the average recognition rate of 86%.


[1] H. P. Gupta, H. S. Chudgar, S. Mukherjee, T. Dutta and K. Sharma, "A Continuous Hand Gestures Recognition Technique for Human-Machine Interaction Using Accelerometer and Gyroscope Sensors," in IEEE Sensors Journal, vol. 16, no. 16, pp. 6425-6432, Aug.15, 2016.
[2] S. Patil, I. Bidari, B. Sunag, S. V. Gulahosur and P. Shettar, "Application of HMI technology in automotive sector," 2016 International Conference on Electrical, Electronics, Communication, Computer and Optimization Techniques (ICEECCOT), Mysuru, 2016, pp. 322-324.
[3] T. Kasai and K. Takano, "Design of Sketch-Based Image Search UI for Finger Gesture," 2016 10th International Conference on Complex, Intelligent, and Software Intensive Systems (CISIS), Fukuoka, 2016, pp. 516-521.
[4] J. H. Oh, J. K. Kim and S. E. Lee, “Design of read-out IC for wearable computing,” International Journal of Computer Systems, Volume 03– Issue 12, December, 2016, pp. 666-669.
[5] T. Chakraborty, M. Nasim, S. M. B. Malek, M. T. H. Majumder, M. S. Saeef and A. B. M. A. A. Islam, "Low-cost finger gesture recognition system for disabled and elderly people," 2017 International Conference on Networking, Systems and Security (NSysS), Dhaka, 2017, pp. 180-184.
[6] P. Salunkhe and A. R. Patil, "A device controlled using eye movement," 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT), Chennai, 2016, pp. 732-735.
[7] L. Long, X. Fu, Honglei Zhu and T. Ge, "Finger gesture-based natural user interface for 3D highway alignment design in virtual environment," 2015 4th International Conference on Computer Science and Network Technology (ICCSNT), Harbin, 2015, pp. 105-111.
[8] Z. Yan and R. W. Lindeman, "A multi-touch finger gesture based low-fatigue VR travel framework," 2015 IEEE Symposium on 3D User Interfaces (3DUI), Arles, 2015, pp. 193-194.
[9] S. Khare, "Finger gesture and pattern recognition based device security system," 2015 International Conference on Signal Processing and Communication (ICSC), Noida, 2015, pp. 443-447.
[10] M. I. Quraishi, K. G. Dhal, J. P. Choudhury, P. Ghosh, P. Sai and M. De, "A novel human hand finger gesture recognition using machine learning," 2012 2nd IEEE International Conference on Parallel, Distributed and Grid Computing, Solan, 2012, pp. 882-887.
[11] C. Quan and J. Liang, "A Simple and Effective Method for Hand Gesture Recognition," 2016 International Conference on Network and Information Systems for Computers (ICNISC), Wuhan, 2016, pp. 302-305.
[12] R. R. Itkarkar and A. V. Nandi, "A survey of 2D and 3D imaging used in hand gesture recognition for human-computer interaction (HCI)," 2016 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE), Pune, India, 2016, pp. 188-193.
[13] X. Dang, W. Wang, K. Wang, M. Dong and L. Yin, "A user-independent sensor gesture interface for embedded device," 2011 IEEE SENSORS Proceedings, Limerick, 2011, pp. 1465-1468.
[14] S. M. Lee, S. D. Kim, J. H. Jang, S. M. Lee and S. E. Lee, "Design of an EMG signal recognition system for human-smartphone interface," 2015 International SoC Design Conference (ISOCC), Gyungju, 2015, pp. 337-338.
[15] F. T. Liu, Y. T. Wang and H. P. Ma, "Gesture recognition with wearable 9-axis sensors," 2017 IEEE International Conference on Communications (ICC), Paris, 2017, pp. 1-6.
[16] H. G. Doan, H. Vu and T. H. Tran, "Dynamic hand gesture recognition from cyclical hand pattern," 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA), Nagoya, 2017, pp. 97-100.
[17] B. Noronha, S. Dziemian, G. A. Zito, C. Konnaris and A. A. Faisal, "Wink to grasp" — comparing eye, voice & EMG gesture control of grasp with soft-robotic gloves, International Conference on Rehabilitation Robotics (ICORR), London, United Kingdom, 2017, pp. 1043-1048.


Human-machine interface, Gesture recognition, Embedded system, Augmented Reality, Virtual Reality.