Current speaker detection system using lip motion information

Heak-bong Kwon; Young-jun Song; Un-dong Chang; Jae-hyeong Ahn

doi:10.1117/12.587578

1 March 2005 Current speaker detection system using lip motion information

Heak-bong Kwon, Young-jun Song, Un-dong Chang, Jae-hyeong Ahn

Proceedings Volume 5672, Image Processing: Algorithms and Systems IV; (2005) https://doi.org/10.1117/12.587578
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

We propose a system that detects the current speaker in multi-speaker videoconferencing by using lip motion. First, the system detects the face and lip region of each of the candidate speakers using face color and shape information. Then, to detect the current speaker, it calculates the change between the current frame and the previous frame in lip region. To close-up the detected current speaker, we used two CCD cameras. One is a general CCD camera, the other is a PTZ camera controlled by RS-232C serial port. The experimental result is the proposed system capable of detecting the face of current speaker in a video feed with more than three people, regardless of orientation of the faces. With this system, it only takes 4 to 5 seconds to zoom in on the speaker from the initial reference image. Also, it is a more efficient image transmission system for such things as video conferencing and internet broadcasting because it offers a close up face image at a resolution of 320x240, while at the same time providing a whole background image.

Citation Download Citation

Heak-bong Kwon, Young-jun Song, Un-dong Chang, and Jae-hyeong Ahn "Current speaker detection system using lip motion information", Proc. SPIE 5672, Image Processing: Algorithms and Systems IV, (1 March 2005); https://doi.org/10.1117/12.587578

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Laser induced plasma spectroscopy

Facial recognition systems

Cameras

Video

CCD cameras

Detection and tracking algorithms

Image transmission

Show All Keywords

Keywords/Phrases

Search In:

Publication Years