Silhouette-Aware Warping for Image-Based Rendering

Image‐based rendering (IBR) techniques allow capture and display of 3D environments using photographs. Modern IBR pipelines reconstruct proxy geometry using multi‐view stereo, reproject the photographs onto the proxy and blend them to create novel views. The success of these methods depends on accur...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum Vol. 30; no. 4; pp. 1223 - 1232
Main Authors: Chaurasia, Gaurav, Sorkine, Olga, Drettakis, George
Format: Journal Article
Language:English
Published: Oxford, UK Blackwell Publishing Ltd 01.06.2011
Wiley
Series:Proceedings of the Eurographics Symposium on Rendering
Subjects:
Computer graphics
Computer Graphics [1.3.3]: Picture/Image Generation-Display algorithms
Computer Science
Discontinuity
Graphics
Image coding
Proxy client servers
Reconstruction
Rendering
Studies
Three dimensional
Warp
silhouette
Image-based rendering
image warping
optimization
multi-view stereo
ISSN:0167-7055, 1467-8659
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Image‐based rendering (IBR) techniques allow capture and display of 3D environments using photographs. Modern IBR pipelines reconstruct proxy geometry using multi‐view stereo, reproject the photographs onto the proxy and blend them to create novel views. The success of these methods depends on accurate 3D proxies, which are difficult to obtain for complex objects such as trees and cars. Large number of input images do not improve reconstruction proportionally; surface extraction is challenging even from dense range scans for scenes containing such objects. Our approach does not depend on dense accurate geometric reconstruction; instead we compensate for sparse 3D information by variational image warping. In particular, we formulate silhouette‐aware warps that preserve salient depth discontinuities. This improves the rendering of difficult foreground objects, even when deviating from view interpolation. We use a semi‐automatic step to identify depth discontinuities and extract a sparse set of depth constraints used to guide the warp. Our framework is lightweight and results in good quality IBR for previously challenging environments.
Bibliography:istex:EB3B323768336FE71E9FC7D49892659C315B1F9D
ArticleID:CGF1981
ark:/67375/WNG-XMQ0XG3R-R
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ObjectType-Article-2
content type line 23
ISSN:0167-7055
1467-8659
DOI:10.1111/j.1467-8659.2011.01981.x