Search Results - Computing methodologies: Image-based rendering

Deep Video‐Based Performance Cloning by Aberman, K., Shi, M., Liao, J., Liscbinski, D., Chen, B., Cohen‐Or, D.

“…We present a new video‐based performance cloning technique. After training a deep generative network using a reference video capturing the appearance and…”
Get full text

NoPe‐NeRF++: Local‐to‐Global Optimization of NeRF with No Pose Prior by Shi, Dongbo, Cao, Shen, Wu, Bojian, Guo, Jinhui, Fan, Lubin, Chen, Renjie, Liu, Ligang, Ye, Jieping

“…In this paper, we introduce NoPe‐NeRF++, a novel local‐to‐global optimization algorithm for training Neural Radiance Fields (NeRF) without requiring pose…”
Get full text

Does 3D Gaussian Splatting Need Accurate Volumetric Rendering? by Celarek, A., Kopanas, G., Drettakis, G., Wimmer, M., Kerbl, B.

“…), which preceded 3DGS, are based on a principled ray‐marching approach for volumetric rendering. In contrast, while sharing a similar image formation model with NeRF, 3DGS uses…”
Get full text

Perceptual Quality Assessment of NeRF and Neural View Synthesis Methods for Front‐Facing Views by Liang, H., Wu, T., Hanji, P., Banterle, F., Gao, H., Mantiuk, R., Öztireli, C.

“…Neural view synthesis (NVS) is one of the most successful techniques for synthesizing free viewpoint videos, capable of achieving high fidelity from only a…”
Get full text

GS‐Octree: Octree‐based 3D Gaussian Splatting for Robust Object‐level 3D Reconstruction Under Strong Lighting by Li, J., Wen, Z., Zhang, L., Hu, J., Hou, F., Zhang, Z., He, Y.

“…‐view images, enabling real‐time rendering. While point‐based rasterization effectively reduces computational demands for rendering, it often struggles to accurately…”
Get full text

ClothingTwin: Reconstructing Inner and Outer Layers of Clothing Using 3D Gaussian Splatting by Jung, Munkyung, Lee, Dohae, Lee, In‐Kwon

“…We introduce ClothingTwin, a novel end‐to‐end framework for reconstructing 3D digital twins of clothing that capture both the outer and inner fabric —without…”
Get full text

PVP: Personalized Video Prior for Editable Dynamic Portraits using StyleGAN by Lin, K.‐E., Trevithick, A., Cheng, K., Sarkis, M., Ghafoorian, M., Bi, N., Reitmayr, G., Ramamoorthi, R.

“…Portrait synthesis creates realistic digital avatars which enable users to interact with others in a compelling way. Recent advances in StyleGAN and its…”
Get full text

D‐NPC: Dynamic Neural Point Clouds for Non‐Rigid View Synthesis from Monocular Video by Kappel, Moritz, Hahlbohm, Florian, Scholz, Timon, Castillo, Susana, Theobalt, Christian, Eisemann, Martin, Golyanik, Vladislav, Magnor, Marcus

“…Dynamic reconstruction and spatiotemporal novel‐view synthesis of non‐rigidly deforming scenes recently gained increased attention. While existing work…”
Get full text

GauLoc: 3D Gaussian Splatting‐based Camera Relocalization by Xin, Zhe, Dai, Chengkai, Li, Ying, Wu, Chenming

“… Unlike previous methods that rely on pose regression or photometric alignment, our proposed method leverages the differential rendering capability provided by 3DGS…”
Get full text

Interactive Control over Temporal Consistency while Stylizing Video Streams by Shekhar, Sumit, Reimann, Max, Hilscher, Moritz, Semmo, Amir, Döllner, Jürgen, Trapp, Matthias

“…Image stylization has seen significant advancement and widespread interest over the years, leading to the development of a multitude of techniques. Extending…”
Get full text

CP‐NeRF: Conditionally Parameterized Neural Radiance Fields for Cross‐scene Novel View Synthesis by He, Hao, Liang, Yixun, Xiao, Shishi, Chen, Jierun, Chen, Yingcong

“…Neural radiance fields (NeRF) have demonstrated a promising research direction for novel view synthesis. However, the existing approaches either require…”
Get full text

Deep Flow Rendering: View Synthesis via Layer‐aware Reflection Flow by Dai, Pinxuan, Xie, Ning

“… It is a challenge because of inaccurate lighting optimization and geometry inference. Although current neural rendering methods have made significant progress…”
Get full text

Image‐Based Tree Variations by Argudo, Oscar, Andújar, Carlos, Chica, Antoni

“… The new models are represented either as single billboards (suitable for still image generation in areas such as architecture rendering…”
Get full text

HMLFC: Hierarchical Motion‐Compensated Light Field Compression for Interactive Rendering by Pratapa, S., Manocha, D.

“…) that is suitable for interactive rendering. Our method combines two different approaches, motion compensation schemes and hierarchical compression methods, to exploit redundancies in LFI…”
Get full text

RGB2AO: Ambient Occlusion Generation from RGB Images by Inoue, N., Ito, D., Hold‐Geoffroy, Y., Mai, L., Price, B., Yamasaki, T.

“…We present RGB2AO, a novel task to generate ambient occlusion (AO) from a single RGB image instead of screen space buffers such as depth and normal. RGB2AO…”
Get full text

Image‐Based Spatio‐Temporal Interpolation for Split Rendering by Steiner, M., Köhler, T., Radl, L., Budge, B., Steinberger, M.

“… Our method enables spatio‐temporal interpolation via bidirectional reprojection to efficiently generate intermediate frames in a split rendering setting, while limiting the communication cost and relying purely on image‐based rendering…”
Get full text

Software Based Visual Aberration Correction for HMDs by Xu, Feng, Li, Dayang

“…When using current head-mounted displays (HMDs), users with optical aberrations need to wear the equipment on the top of their own glasses. As both the HMDs…”
Get full text

Interactive Photo Editing on Smartphones via Intrinsic Decomposition by Shekhar, Sumit, Reimann, Max, Mayer, Maximilian, Semmo, Amir, Pasewaldt, Sebastian, Döllner, Jürgen, Trapp, Matthias

“…Intrinsic decomposition refers to the problem of estimating scene characteristics, such as albedo and shading, when one view or multiple views of a scene are…”
Get full text

RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering by Li, Chaojian, Li, Sixu, Zhao, Yang, Zhu, Wenbo, Lin, Yingyan

“…Neural Radiance Field (NeRF) based rendering has attracted growing attention thanks to its state-of-the-art (SOTA…”
Get full text

Generating VR Live Videos with Tripod Panoramic Rig by Xu, Feng, Zhao, Tianqi, Luo, Bicheng, Dai, Qionghai

“…Recent breakthrough in consumer-level virtual reality (VR) devices brings an increasing demand of VR live content. As converting real life content into VR need…”
Get full text