Hardware-Accelerated Rendering of Photo Hulls

This paper presents an efficient hardware‐accelerated method for novel view synthesis from a set of images or videos. Our method is based on the photo hull representation, which is the maximal photo‐consistent shape. We avoid the explicit reconstruction of photo hulls by adopting a view‐dependent pl...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum Vol. 23; no. 3; pp. 635 - 642
Main Authors: Li, Ming, Magnor, Marcus, Seidel, Hans-Peter
Format: Journal Article
Language:English
Published: Oxford, UK and Boston, USA Blackwell Publishing, Inc 01.09.2004
Blackwell Publishing Ltd
Subjects:
3-D graphics
Computer graphics
Studies
ISSN:0167-7055, 1467-8659
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This paper presents an efficient hardware‐accelerated method for novel view synthesis from a set of images or videos. Our method is based on the photo hull representation, which is the maximal photo‐consistent shape. We avoid the explicit reconstruction of photo hulls by adopting a view‐dependent plane‐sweeping strategy. From the target viewpoint slicing planes are rendered with reference views projected onto them. Graphics hardware is exploited to verify the photo‐consistency of each rasterized fragment. Visibilities with respect to reference views are properly modeled, and only photo‐consistent fragments are kept and colored in the target view. We present experiments with real images and animation sequences. Thanks to the more accurate shape of the photo hull representation, our method generates more realistic rendering results than methods based on visual hulls. Currently, we achieve rendering frame rates of 2–3 fps. Compared to a pure software implementation, the performance of our hardware‐accelerated method is approximately 7 times faster. Categories and Subject Descriptors (according to ACM CCS): CR Categories: I.3.3 [Computer Graphics]: Picture/Image Generation; I.3.7 [Computer Graphics]: Three‐Dimensional Graphics and Realism.
Bibliography:istex:B3845C6988B2065CBAB6DC95FC6A9DA40E0993BB
ArticleID:CGF795
ark:/67375/WNG-DG82752F-T
SourceType-Scholarly Journals-1
ObjectType-Feature-1
content type line 14
ISSN:0167-7055
1467-8659
DOI:10.1111/j.1467-8659.2004.00795.x