ArchiDiff: Interactive design of 3D architectural forms generated from a single image

3D Reconstruction Using Images has made strides in small-scale, uncomplicated scenes but struggles with complex, large-scale architectural forms. Targeting early-stage architectural design, we introduce ArchiDiff, a platform for 3D architectural form generation and editing from images to point cloud...

Full description

Saved in:
Bibliographic Details
Published in:Computers in industry Vol. 168; p. 104275
Main Authors: Yin, Jun, Gao, Wen, Li, Jizhizi, Xu, Pengjian, Wu, Chenglin, Lin, Borong, Lu, Shuai
Format: Journal Article
Language:English
Published: Elsevier B.V 01.06.2025
Subjects:
3D diffusion model
3D interaction
Architectural design
Single-view reconstruction
Single-view reconstruction
Architectural design
3D diffusion model
3D interaction
ISSN:0166-3615
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:3D Reconstruction Using Images has made strides in small-scale, uncomplicated scenes but struggles with complex, large-scale architectural forms. Targeting early-stage architectural design, we introduce ArchiDiff, a platform for 3D architectural form generation and editing from images to point clouds. First, we curated a dataset specifically tailored for architectural design, ArchiCloudNet. Second, we proposed a 3D generation method using a conditional denoising diffusion model, with an arbitrary object segmentation model to enhance recognition capabilities in complex input. Finally, we incorporate an interactive feature enabling instantaneous 2D image editing through simple drag-and-drops with simultaneous updates to 3D forms, giving designers improved control. We evaluated ArchiDiff’s generation accuracy against cutting-edge baselines on ArchiCloudNet and two other datasets, RealCity3D and BuildingNet. We also validated it with real sketches from early-stage architectural design. The experiments indicated that our model could generate accurate architectural point clouds, providing rapid-response modification and effective processing of complex backgrounds. Demostration: http://39.101.72.109:3000/archidiff. •A tailored dataset for architecture containing 3D forms and 2D images.•Accurate generation of complex architectural forms through diffusion model.•Facilitating direct 2D-to-3D updates, enhancing design interactivity and flexibility.•Leading performance in architectural design scenarios among baseline models.
ISSN:0166-3615
DOI:10.1016/j.compind.2025.104275