SecondSkin: An interactive method for appearance transfer

SecondSkin estimates an appearance model for an object visible in a video sequence, without the need for complex interaction or any calibration apparatus. This model can then be transferred to other objects, allowing a non‐expert user to insert a synthetic object into a real video sequence so that i...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum Vol. 28; no. 7; pp. 1735 - 1744
Main Authors: Van Den Hengely, A., Sale, D., Dick, A. R.
Format: Journal Article
Language:English
Published: Oxford, UK Blackwell Publishing Ltd 01.10.2009
Subjects:
Computer graphics
Digital imaging
I.3.6 [Computer Graphics]: Methodolgy and Techniques-Computing Methodologies
I.4.8 [Image Processing and Computer Vision]: Scene Analysis - Shading
Image processing systems
Interactive computer systems
Lighting
Studies
ISSN:0167-7055, 1467-8659
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:SecondSkin estimates an appearance model for an object visible in a video sequence, without the need for complex interaction or any calibration apparatus. This model can then be transferred to other objects, allowing a non‐expert user to insert a synthetic object into a real video sequence so that its appearance matches that of an existing object, and changes appropriately throughout the sequence. As the method does not require any prior knowledge about the scene, the lighting conditions, or the camera, it is applicable to video which was not captured with this purpose in mind. However, this lack of prior knowledge precludes the recovery of separate lighting and surface reflectance information. The SecondSkin appearance model therefore combines these factors. The appearance model does require a dominant light‐source direction, which we estimate via a novel process involving a small amount of user interaction. The resulting model estimate provides exactly the information required to transfer the appearance of the original object to new geometry composited into the same video sequence.
Bibliography:istex:5CC993C4B254C3E59844A86DEAC1330C7EAB3F24
ark:/67375/WNG-CJJS6QVJ-1
ArticleID:CGF1550
This research has been funded by the Australian Research Council and the South Australian Premier's Science and Research Fund
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ISSN:0167-7055
1467-8659
DOI:10.1111/j.1467-8659.2009.01550.x