Vision-Based Control By Hand-Directional Gestures Converting To Voice

Currently, remote vision-based control, which is converted into a voice, is a research becoming one of the major focuses among researchers due to various applications in terms of Human-Computer-Interaction (HCI). The proposed idea is to learn a robot how to receive hand directional gestures as left, right, up and down, and pronounce these directions according to the originated directions. To implement this, a technique is proposed by using index-finger of a hand in order to point out random directions, in which the feature extraction is based on the area of the object pixels. It is static hand directional gesture recognition. This method starts by inserting a video to extract frames, which are processed one by one to output 4-possible-direction. After that, each specific direction will switch on its corresponding voice pronouncing the direction sign as a robot speaking. Experiments were conducted on 10-video frames for testing by using 10 individuals. The total frames for this experiment is having 442 frames. Results demonstrate high successful recognition rate in terms the performance accuracy up to 94.57%.

REFERENCES

[1]. G. Murthy and R. Jadon, "A review of vision based hand gestures recognition," International Journal of Information Technology and Knowledge Management, vol. 2, pp. 405-410, 2009.

[2]. F. L. MALALLAH, et al., "HYBRID HAND-DIRECTIONAL GESTURES FOR BAIOMETRIC BASED ON AREA FEATURE EXTRACTION AND EXPERT SYSTEM," Journal of Theoretical & Applied Information Technology, vol. 95, 2017.

[3]. F. L. Malallah, et al., "A Review of Biometric Template Protection Techniques for Online Handwritten Signature Application," International Review on Computers and Software (I. RE. CO. S.), vol. 8, 2013.

[4]. F. L. Malallah, et al., "Online handwritten signature recognition by length normalization using up-sampling and down-sampling," International Journal of Cyber-Security and Digital Forensics (IJCSDF), vol. 4, pp. 302-313, 2015.

[5]. S. S. Rautaray and A. Agrawal, "Vision based hand gesture recognition for human computer interaction: a survey," Artificial Intelligence Review, vol. 43, pp. 1-54, 2015.

[6]. N. Sae-Bae, et al., "Biometric-rich gestures: a novel approach to authentication on multi-touch devices," in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2012, pp. 977-986.

[7]. N. Sae-Bae, et al., "Multitouch gesture-based authentication," IEEE transactions on information forensics and security, vol. 9, pp. 568-582, 2014.

[8]. M. S. M. Asaari and S. A. Suandi, "Hand gesture tracking system using Adaptive Kalman Filter," in 2010 10th International Conference on Intelligent Systems Design and Applications, 2010, pp. 166-171.

[9]. J. Doublet, et al., "Contactless hand recognition based on distribution estimation," in Biometrics Symposium, 2007, 2007, pp. 1-6.

[10]. A. Morales, et al., "Comparing infrared and visible illumination for contactless hand based biometric scheme," in 2008 42nd Annual IEEE International Carnahan Conference on Security Technology, 2008, pp. 191-197.
[11]. S. Berman and H. Stern, "Sensors for gesture recognition systems," IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 42, pp. 277-290, 2012.

[12]. M. Chen, et al., "Air-Writing Recognition�Part I: Modeling and Recognition of Characters, Words, and Connecting Motions," IEEE Transactions on Human-Machine Systems, vol. 46, pp. 403-413, 2016.

[13]. K. Natarajan, et al., "Hand Gesture Controlled Drones: An Open Source Library," in Data Intelligence and Security (ICDIS), 2018 1st International Conference on, 2018, pp. 168-175.

[14]. Z. Zhao, et al., "Web-based interactive drone control using hand gesture," Review of Scientific Instruments, vol. 89, p. 014707, 2018.

[15]. Y. Y. Pang, et al., "A real time vision-based hand gesture interaction," in Mathematical/Analytical Modelling and Computer Simulation (AMS), 2010 Fourth Asia International Conference on, 2010, pp. 237-242.

[16]. F. Chen, et al., "Finger Angle-Based Hand Gesture Recognition for Smart Infrastructure Using Wearable Wrist-Worn Camera," Applied Sciences, vol. 8, p. 369, 2018.

[17]. Z. Qiu-yu, et al., "Hand Gesture Segmentation Method Based on YCbCr Color Space and K-Means Clustering," Interaction, vol. 8, pp. 106-116, 2015.

[18]. P. Jackson, "Introduction to expert systems," 1986.