ClothingTwin: Reconstructing Inner and Outer Layers of Clothing Using 3D Gaussian Splatting

We introduce ClothingTwin, a novel end‐to‐end framework for reconstructing 3D digital twins of clothing that capture both the outer and inner fabric —without the need for manual mannequin removal. Traditional 2D “ghost mannequin” photography techniques remove the mannequin and composite partial inne...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Computer graphics forum Ročník 44; číslo 7
Hlavní autoři: Jung, Munkyung, Lee, Dohae, Lee, In‐Kwon
Médium: Journal Article
Jazyk:angličtina
Vydáno: Oxford Blackwell Publishing Ltd 01.10.2025
Témata:
3D imaging
Ablation
CCS Concepts
Computing methodologies → Image‐based rendering
Digital twins
Garments
Image acquisition
Image reconstruction
Mannequins
Shape modeling
Spherical harmonics
ISSN:0167-7055, 1467-8659
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:We introduce ClothingTwin, a novel end‐to‐end framework for reconstructing 3D digital twins of clothing that capture both the outer and inner fabric —without the need for manual mannequin removal. Traditional 2D “ghost mannequin” photography techniques remove the mannequin and composite partial inner textures to create images in which the garment appears as if it were worn by a transparent model. However, extending such method to photorealistic 3D Gaussian Splatting (3DGS) is far more challenging. Achieving consistent inner‐layer compositing across the large sets of images used for 3DGS optimization quickly becomes impractical if done manually. To address these issues, ClothingTwin introduces three key innovations. First, a specialized image acquisition protocol captures two sets of images for each garment: one worn normally on the mannequin (outer layer exposed) and one worn inside‐out (inner layer exposed). This eliminates the need to painstakingly edit out mannequins in thousands of images and provides full coverage of all fabric surfaces. Second, we employ a mesh‐guided 3DGS reconstruction for each layer and leverage Non‐Rigid Iterative Closest Point (ICP) to align outer and inner point‐clouds despite distinct geometries. Third, our enhanced rendering pipeline—featuring mesh‐guided back‐face culling, back‐to‐front alpha blending, and recalculated spherical harmonic angles—ensures photorealistic visualization of the combined outer and inner layers without inter‐layer artifacts. Experimental evaluations on various garments show that ClothingTwin outperforms conventional 3DGS‐based methods, and our ablation study validates the effectiveness of each proposed component.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0167-7055
1467-8659
DOI:10.1111/cgf.70240