3DGS-HD: Elimination of Unrealistic Artifacts in 3D Gaussian Splatting

3D Gaussian Splatting (3DGS) can achieve higher-quality novel view synthesis (NVS) results in a relatively short period of time. Nevertheless, when sampling rates are not aligned with the camera track, unreal artifacts that are not part of the view often emerge, including floaters. This phenomenon h...

Full description

Saved in:
Bibliographic Details
Published in:2024 6th International Conference on Data-driven Optimization of Complex Systems (DOCS) pp. 696 - 702
Main Authors: Sun, Hao, Qin, Junping, Wang, Lei, Yan, Kai, Liu, Zheng, Jia, Xinglong, Shi, Xiaole
Format: Conference Proceeding
Language:English
Published: IEEE 16.08.2024
Subjects:
3D diffusion model
Cameras
Complex systems
Context modeling
Diffusion models
high-quality 3D reconstruction
Image reconstruction
novel view synthesis (NVS)
Optimization methods
Robustness
Solid modeling
Three-dimensional displays
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:3D Gaussian Splatting (3DGS) can achieve higher-quality novel view synthesis (NVS) results in a relatively short period of time. Nevertheless, when sampling rates are not aligned with the camera track, unreal artifacts that are not part of the view often emerge, including floaters. This phenomenon has a significant impact on the quality of the reconstruction results. Furthermore, existing regularization methods are ineffective in terms of both inference speed and optimization. Accordingly, this study proposes the elimination of unrealistic artifacts in 3D Gaussian Splatting (3DGS-HD), a scene optimization method based on the 3D diffusion model. This method optimizes the adaptive density mechanism by deeply understanding the local structural characteristics of the reconstructed objects, removes unrealistic artifacts, and significantly improves the reconstruction quality. Furthermore, it ensures consistency between 2D and 3D views. The results of the experiments demonstrate that this method produces notable improvements in optimization, particularly in the context of object-level reconstruction tasks.
DOI:10.1109/DOCS63458.2024.10704310