Color-based lip localization method

Ahmad B. A. Hassanat; Sabah Jassim

doi:10.1117/12.850629

28 April 2010 Color-based lip localization method

Ahmad B. A. Hassanat, Sabah Jassim

Proceedings Volume 7708, Mobile Multimedia/Image Processing, Security, and Applications 2010; 77080Y (2010) https://doi.org/10.1117/12.850629
Event: SPIE Defense, Security, and Sensing, 2010, Orlando, Florida, United States

Abstract

This paper is concerned with lip localization for visual speech recognition (VSR) system. We shall present an efficient method for localization human's lips/mouth in video images. This method is based on using the YCbCr approach to find at least any part of the lip as an initial step. Then we use all the available information about the segmented lip-pixels such as r, g, b, warped hue, etc. to segment the rest of the lip. The mean is calculated for each value, then for each pixel in ROI, Euclidian distance from the mean vector is calculated. Pixels with smaller distances are further clustered as lip pixels. Thus, the rest of the pixels in ROI will be clustered (to lip/non-lip pixel) depending on their distances from the mean vector of the initial segmented lip region. The method is evaluated on a new-recorded database of 780,000 frames; the experiments show that the method localizes the lips efficiently, with high level of accuracy (91.15%) that outperforms existing lip detection approaches.

Citation Download Citation

Ahmad B. A. Hassanat and Sabah Jassim "Color-based lip localization method", Proc. SPIE 7708, Mobile Multimedia/Image Processing, Security, and Applications 2010, 77080Y (28 April 2010); https://doi.org/10.1117/12.850629

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available