Driver Drowsiness Monitoring Based On Eye Map And Mouth Contour
Kamal Reddy, Amir Sikandar, Pranav Savant, Adityam Choudhary
Keywords: Active contour model, Canny Edge Detection, Eye Map, Yawn detection.
Abstract: Number of accidents occurs now a days due to the drowsiness of driver. Therefore to assist the driver with the problem of drowsiness, the system must be design to carefully developed to provide an interface and interaction the make sense for the driver. This article introduces a new approach towards detection of drives’ drowsiness based on yawning detection. The main aim is to reduce the number of accidents occurred due to drivers fatigue and hence increases the road safety. The special gestures of body and face are used as the sign of driver fatigue, including yawning, eye tiredness and mouth movement, and it indicate that the driver is no more in a proper driving condition. This involves several steps including the real time detection and tracking of driver’s face detection, tracking of the mouth contour, eye and the detection of yawning based on measuring both the rate and the amount of changes in the mouth contour area, Eye detection using Eye Map.
. S.G. Klauer , T. A. Dingus, Neale, V. L., Sudweeks, J.D., and Ramsey, DJ,”The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data,” Virginia Tech Transportation Institute, Technical Report # DOT HS 810 594
. U. Yufeng, W. Zengcai, “Detecting driver yawning in successive images.” In: Proc. 1st International Conf. on Bioinformatics and Biomedical Engineering, 2007 , pp. 581-583.
. X. Fan, B. Yin, Y. Fun. “Yawning Detection For Monitoring Driver Fatigue.” In: Proc. Sixth International Conf. on Machine Learning and Cybernetics, Hong Kong, 2007, pp. 664-668.
. T. Azim, M.A. Jaffar, A.M. Mirza. “Automatic Fatigue Detection of Drivers through Pupil Detection and Yawning Analysis.” In: Proc. Fourth International Conf. on Innovative Computing, Information and Control, 2009, pp. 441-445.
. L. Li, Y. Chen , Z. Li. “Yawning Detection for Monitoring Driver Fatigue Based on Two Cameras.” In: Proc. 12th International IEEE Conf. on Intelligent Transportation Systems, St. Louis, MO, USA, 2009, pp. 12-17.
. T.Wang, P. Shi. “Yawning Detection For Determining Driver Drowsiness.” IEEE International Workshop VLSI Design & Video Tech. Suzhou,China, 2005, pp. 373-376.
. Y. Ying , S. Jing, Z. Wei, “The Monitoring Method of Driver’s Fatigue Based on Neural Network”, In: Proc. International Conf. on Mechatronics and Automation, China, 2007 , pp. 3555-3559.
. M. Saradadevi , P. Bajaj, “Driver Fatigue Detection Using Mouth and Yawning Analysis” , IJCSNS International Journal of Computer Science and Network Security, VOL.8 No.6, June 2008- pp. 183-188
. E. Vural, M. Cetin, A. Ercil, G. Littlewort, M. Bartlett and J. Movellan, “Drowsy Driver Detection Through Facial Movement Analysis”
. K. Barry, "Yawn If You Dare. Your Car Is Watching You", Wired magazine, Autopia section, July 30, 2009, http://www.wired.com/autopia/2009/07/sleep-detection/
. S. Abtahi, B. Hariri, S. Shirmohammadi, "Driver Drowsiness Monitoring Based on Yawning Detection", Proc. IEEE International Instrumentation and Measurement Technology Conferencet, Binjiang (Hangzhou), China, May 10-12, 2011
. M.H. Yang, D.J. Kriegman, N. Ahuja,: “Detecting faces in images: A survey.” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 24, No. 1, pp. 34-58, 2002
. H. Sellahewa, S.A. Jassim, "Image-Quality-Based Adaptive Face Recognition," Instrumentation and Measurement, IEEE Transactions on , vol.59, no.4, pp.805-813, April 2010.
. W. Jian-Gang , E. Sung , "Facial Feature Extraction in an Infrared Image by Proxy With a Visible Face Image," Instrumentation and Measurement, IEEE Transactions on , vol.56, no.5, pp.2057-2066, Oct. 2007
. G. Yang and T. S. Huang, "Human Face Detection in Complex Background," Pattern Recognition, vol. 27, no. 1, pp. 53-63, 1994.
. K.C. Yow and R. Cipolla, "Feature-Based Human Face Detection," Image and Vision Computing, vol. 15, no. 9, pp. 713-735, 1997.
. T.K. Leung, M.C. Burl, and P. Perona, “Finding Faces in Cluttered Scenes Using Random Labeled Graph Matching,” Proc. Fifth IEEE Int’l Conf. Computer Vision, pp. 637-644, 1995.
. Y. Dai and Y. Nakano, "Face-Texture Model Based on SGLD and Its Application in Face Detection in a Color Scene", Pattern Recognition, vol. 29, no. 6, pp. 1007-1017, 1996.
. R. Kjeldsen and J. Kender, "Finding Skin in Color Images," Proc. Second Int'l Conf. Automatic Face and Gesture Recognition, pp. 312-317, 1996.
. S. McKenna, S. Gong, and Y. Raja, "Modelling Facial Colour and Identity with Gaussian Mixtures," Pattern Recognition, vol. 31, no. 12, pp. 1883-1892, 1998.
. I. Craw, D. Tock, and A. Bennett, "Finding Face Features," Proc. Second European Conf. Computer Vision, pp. 92-96, 1992.
. A. Lanitis, C.J. Taylor, and T.F. Cootes, "An Automatic Face Identification System Using Flexible Appearance Models," Image and Vision Computing, vol. 13, no. 5, pp. 393-401, 1995.
. E. Osuna, R. Freund, and F. Girosi, “Training Support Vector Machines: An Application to Face Detection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130-136, 1997.
. H. Schneiderman , T. Kanade, “Probabilistic Modeling of Local Appearance and Spatial Relationships for Object Recognition,” IEEE Conf. Computer Vision and Pattern Recognition, pp. 45-51, 1998.
. A. Rajagopalan, K. Kumar, J. Karlekar, R. Manivasakan, M. Patil, U. Desai, P. Poonacha, and S. Chaudhuri, “Finding Faces in Photographs,” IEEE Int’l Conf. Computer Vision, pp. 640- 645, 1998.
. P. Viola and M. Jones, Rapid Object Detection Using a Boosted Cascade of Simple Features, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), ISSN: 1063-6919, Vol.1, pp. 511-518, December 2001.
. N. A. A.Rahman, K.C. Wei and J. See. “RGB-H-CbCr Skin Colour Model for Human Face Detection.” In Proceedings of The MMU International Symposium on Information & Communications Technologies, 2006
. Hsu Rein-Lien, M. Abdel-Mottaleb, and. A. K. Jain. “Face detection in color images.” IEEE Trans. Pattern Analysis and Mechine Intelligence, Vol. 24, issue 5. 2002
. C. Chen, “Information Fusion of wavelet projection features for face recognition” In: Proc. International Joint Conf. on Neaural Network, Hong Kong, September 2008 , pp. 3881-3887.
. L.Zhen-yu, W. Miao-miao, “ Eyes detection based on One-Dimensional Wavelet Transform”, International Symposium on Computational Intelligence and Design, Hangzhou, China 2010, pp. 123-127
. Z. Yan, M.B Yeary., S. Cheng, N. Kehtarnavaz, , "An Object-Tracking Algorithm Based on Multiple-Model Particle Filtering With State Partitioning," Instrumentation and Measurement, IEEE Transactions on, vol.58, no.5, pp.1797-1809, May 2009
. M. Kass, A. Witkin, D. Terzopoulos,” Snakes: Active contour models”, In’l Journal of Computer Vistion, vol. 1, no. 4, pp. 321-331, 1987
. M. Barnard, E.Holden, R. Owens,”Lip tracking using pattern matching snakes”, The 5th Asian conference on Computer Vision, Melbourne, Australia, January 2002, pp. 1-6
. G.I. Chiou, J.Hwang,“Lipreading from color video” IEEE Transactions on Image Processing, vol. 6, no. 8, pp. 1192-1195, August 1997
. R. Séguier and Nicolas Cladel, Genetic Snakes. Application on Lipreading, International Conference on Artificial Neural Networks and zGenetic Algorithms (ICANNGA), 2003.
. A. Benoit, A. Caplier, “ Hypovigilence analysis: open or closed eyes or mouth? Blinking or yawning frequency?”, Proc. IEEE Conference on advanced video and signal based surveillance, 2005, pp.207-212
. Sergei Azernikov. Sweeping solids on manifolds. In Symposium on Solid and Physical Modeling, pages 249–255, 2008.
. John Canny. A computational approach to edge detection. Pattern Analysis and Machine Intelligence, IEEE Transactions on, PAMI-8(6):679–698, Nov. 1986.
. F. Mai, Y. Hung, H. Zhong, and W. Sze. A hierarchical approach for fast and robust ellipse extraction. Pattern Recognition, 41(8):2512–2524, August 2008.
. Thomas B. Moeslund. Image and Video Processing. August 2008.