Establishing eye contact for home video communication using stereo analysis and free viewpoint synthesis

Christian Weigel; Niklas Treutner

doi:10.1117/12.906594

30 January 2012 Establishing eye contact for home video communication using stereo analysis and free viewpoint synthesis

Christian Weigel, Niklas Treutner

Author Affiliations +

Proceedings Volume 8290, Three-Dimensional Image Processing (3DIP) and Applications II; 829003 (2012) https://doi.org/10.1117/12.906594
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Eye contact has been proven to be an important visual cue in video communication applications. We present a method to re-establish eye contact in a home video communication scenario caused by misalignment between the camera and the communication window the participant looks at. Our method covers the complete algorithm chain from acquisition to rendering and uses a pixel-based 3D analysis and rendering approach to create a virtual view of a camera placed at the position of the communication window. The outcomes of a large scale subjective study identified the crucial problems of such an approach. Based on the significant observations during the study in this paper we address the most important problems. We propose a method that produces spatially consistent depth maps using cross-check based filling. We address aliasing artifacts during point rendering and present a method to enhance the virtual view by image inpainting based on robust contour warping.

Citation Download Citation

Christian Weigel and Niklas Treutner "Establishing eye contact for home video communication using stereo analysis and free viewpoint synthesis", Proc. SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, 829003 (30 January 2012); https://doi.org/10.1117/12.906594

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available