International Journal of Scientific & Technology Research

Home About Us Scope Editorial Board Blog/Latest News Contact Us
10th percentile
Powered by  Scopus
Scopus coverage:
Nov 2018 to May 2020


IJSTR >> Volume 8 - Issue 8, August 2019 Edition

International Journal of Scientific & Technology Research  
International Journal of Scientific & Technology Research

Website: http://www.ijstr.org

ISSN 2277-8616

Lip Feature Extraction And Movement Recognition Methods: A Review

[Full Text]



Priyanka P. Kapkar, S.D.Bharkad



Lipreading, preprocessing, features extraction, database, Classifiers



Research on methods of biometric has gained attention in recent year’s and brought an increase in security concepts. In the day-to-day developed world attitude towards terrorism has influenced people and their government bodies to take action and more alertness in the security issues. For this purpose, many biometric techniques are developed and been improved with the most successful security applications. Lip reading is one of the biometric like fingerprint, iris etc. Lip feature extraction and lip movement recognition are the challenging task. Many researchers proposed methods for feature extraction and lip movement recognition. In this paper a detail survey of existing feature extraction and feature classification algorithms are presented. Lip reading is basically converting the lip movement into some information. This can be used as text or unique feature for biometrics. It is still under developing the technology of lip reading. Researchers are still finding the new methods to increase the efficiency of the lip reading systems.



[1] E.Gomez, C.M.Travieso, J.C.Briceno and M.A.Ferrer, “Biometric identification system by lip shape”, Proceedings. 36th Annual 2002 International Carnahan Conference on Security Technology, Atlantic City, USA, 2002,pp.39-42
[2] P.S.Aleksic and A.K.Katsaggelos, “Audio-Visual Biometrics”, Proceedings of the IEEE, Vol.94, no.11, pp.2025-2044
[3] S.H.Leung, A.W.C.Liew, W.H.Lau, S.L.Wang, S.H.Leung, A.W.C.Liew, W.H.Lau, S.L.Wang, “Automatic Lipreading with Limited Training Data”, 18th International Conference on Pattern recognition (ICPR’06), Hong Kong, 2006, pp.881-884
[4] S.L.Wang, A.W.C. Liew, W.H.Lau and S.H.Leung, “An Automatic Lipreading System for Spoken Digits With Limited Training Data”, IEEE Transactions on Circuits and Systems for Video Technology,2008, vol.18, no.12, pp.1760-1765
[5] S.Alizadeh, R.Boostani and V.Asadpour, “Lip feature extraction and reduction for HMM-based visual speech recognition systems”, in 2008 9th International Conference on Signal Processing, Beijing, 2008, pp.561-564
[6] M.Li and Y.Cheung, “A Novel Motion Based Lip Feature Extraction for Lip-Reading”, 2008 International Conference on Computational Intelligence and Security, Suzhou, 2008, pp.361-365
[7] I.Matthews, T.F.Cootes, J.A.Bangham, S.Cox and R.Harvey, “Extraction of visual features for lipreading”, IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, vol.24, no.2, pp.198-213
[8] Chen, Jingying and Tiddeman, Bernard and Zhao, Gang, “Real-Time Lip Contour Extraction and Tracking Using an Improved Active Contour Model”, Bebis G. et al. (eds) Advances in Visual Computing. ISVC,2008, vol.5359, pp. 236-245
[9] M.Wang, “Lip feature selection based on BPSO and SVM”, in IEEE 2011 10th International Conference on Electronic Measurement & Instruments,Chengdu, 2011, pp. 56-59
[10] Carlos M.Travieso, Jianguo Zhang, Paul Miller, Jesús B.Alonso, Miguel A.Ferrer, “Bimodal biometric verification based on face and lips”, Neurocomputing, 2011, Volume 74, Issues 14–15, Pages 2407-2410
[11] H.Talea and K.Yaghmaie, “Automatic combined lip segmentation in color images”, IEEE 3rd International Conference on Communication Software and Networks, 2011, pp.109-112
[12] Marouf, Hoda and Faez, Karim, “Zernike Moment Based Feature Extraction for Facial Recognition off Identical Twins”, International Journal of Computer Science, Engineering and Information Technology, 2013, vol.3, no.6, pp. 1-8
[13] V.Sahu and M.Sharma, “Result based analysis of various lip tracking systems”, International Conference on Green High Performance Computing (ICGHPC), 2013,pp.1-7
[14] Sebastien Stillittano, Vincent Girondel, Alice Caplier, “Lip contour segmentation and tracking compliant with lip-reading application constraints”, Machine Vision and Applications, 2013, vol.24, pp.1-18
[15] H.Liu, T.Fan and P.Wu, “Audio-visual keyword spotting based on adaptive decision fusion under noisy conditions for human-robot interaction”, IEEE International Conference on Robotics and Automation (ICRA),Hong Kong, 2014, pp. 6644-6651
[16] Sunil Sangve and Nilakshi Mule, “Lip Recognition for Authentication and Security”, IOSR Journal of Computer Engineering (IOSR-JCE), 2014, vol.16, issue 3, pp.18-23
[17] Ahmad Hassanat , “Visual Passwords Using Automatic Lip Reading”, International Journal of Sciences: Basic and Applied Research (IJSBAR), 2014,vol.13, pp. 218-231.
[18] X.Liu and Y.Cheung, “An Exemplar-Based Hidden Markov Model with Discriminative Visual Features for Lipreading”, Tenth International Conference on Computational Intelligence and Security, Kunming, 2014,pp.90-93
[19] S.Mathulaprangsan, C.Wang, A.Z.Kusum, T.Tai and J.Wang, “A survey of visual lip reading and lip-password verification”, International Conference on Orange Technologies (ICOT),Hong Kong, 2015, pp. 22-25
[20] F.S.Lesani, F.F.Ghazvini and R.Dianat, “Mobile phone security using automatic lip reading”, 9th International Conference on e-Commerce in Developing Countries: With focus on e-Business (ECDC),Isfahan, 2015, pp. 1-5
[21] Neeru Rathee, Dinesh Ganotra, “Analysis of human lip features: a review”, Int. J. Applied Systemic Studies, 2015, Vol. 6, No. 2, pp.137–184.
[22] P.Wu, H.Liu, X.Li, T.Fan and X.Zhang, “A Novel Lip Descriptor for Audio-Visual Keyword Spotting Based on Adaptive Decision Fusion”, in IEEE Transactions on Multimedia, 2016,vol. 18, no. 3, pp. 326-338
[23] Y.Li, Y.Takashima, T.Takiguchi and Y.Ariki, “Lip reading using a dynamic feature of lip images and convolutional neural networks”, IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS),Okayama, 2016, pp. 1-6
[24] S.Agrawal, V.R.Omprakash and Ranvijay, “Lip reading techniques: A survey”, 2nd International Conference on Applied and Theoretical Computing and Communication Technology (iCATccT),Bangalor, 2016, pp. 753-757
[25] Daehyun Lee and Kyungsik Myung, “Read my lips, login to the virtual world”, IEEE International Conference on Consumer Electronics (ICCE),Las Vegas, 2017, pp. 434-435
[26] Z.Thabet, A.Nabih, K.Azmi, Y.Samy, G.Khoriba and M.Elshehaly, “Lipreading using a comparative machine learning approach”, First International Workshop on Deep and Representation Learning (IWDRL),Cairo, 2018, pp. 19-25
[27] R.Ding, C.Pang and H.Liu, “Audio-Visual Keyword Spotting Based on Multidimensional Convolutional Neural Network”, 25th IEEE International Conference on Image Processing (ICIP),Athens,2018, pp.4138-4142
[28] D.Shang, X.Zhang and X.Xu, “Face and Lip-reading Authentication System Based on Android Smart Phones”, Chinese Automation Congress (CAC), 2018, pp. 4178-4182
[29] Krzysztof Worbel, Rafal Doroz, Piotr Porwik, Jacek Naruniec, Marek Kowalski, “ Using a Probabilistic neural network for lip-based biometric verification”, Journal of Engineering Applications of Artificial Intelligence, 2017, vol.64,issue C, pp.112-127