Gaze correction in video communication with single camera

In face-to-face video communication, we commonly use only a single camera placed on top of a monitor screen. This general configuration gives poor eye contact problem to decrease the feeling of natural conversation since the user stares at the monitor screen rather than directly staring at the camer...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings. International Conference on Image Processing Vol. 3; pp. 857 - 860 vol.3
Main Authors: Insuh Lee, Byeungwoo Jeeon
Format: Conference Proceeding
Language:English
Published: IEEE 2002
Subjects:
Cameras
Computerized monitoring
Contacts
Eyes
Image converters
Image quality
Lenses
Rendering (computer graphics)
Shape
Solid modeling
ISBN:0780376226, 9780780376229
ISSN:1522-4880
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In face-to-face video communication, we commonly use only a single camera placed on top of a monitor screen. This general configuration gives poor eye contact problem to decrease the feeling of natural conversation since the user stares at the monitor screen rather than directly staring at the camera lens. In this paper we present a new approach for natural feeling in video communication using image-based modeling and rendering techniques. Our facial modeling approach has two components. The first component is to estimate the eye position from an input image to find the gaze-correction angle and generate the basic model to represent the user's facial shape. The second component is a model-based shape approximation from motion which generates the user's simple facial shape to be used in rendering. To render a good eye-contact image, we propose 3D mesh warping technique, a method to rotate input image with the correction angle and the facial model. Our approach is effective and convenient since it uses the characteristic information about a facial scene. Preliminary experimental results with real facial image shows the enhanced naturalness which the face-to-face video communication has to offer.
ISBN:0780376226
9780780376229
ISSN:1522-4880
DOI:10.1109/ICIP.2002.1039107