StructuredMesh: 3-D Structured Optimization of Façade Components on Photogrammetric Mesh Models Using Binary Integer Programming

The absence of detailed façade elements in photogrammetric building mesh models falls short for complex applications. These models often present irregular surfaces, significant geometric noise, and subpar texture quality, complicating façade parsing. To mitigate these challenges, we introduce Struct...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on geoscience and remote sensing Vol. 62; pp. 1 - 12
Main Authors: Wang, Libin, Hu, Han, Shang, Qisen, Zeng, Haowei, Zhu, Qing
Format: Journal Article
Language:English
Published: New York IEEE 2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects:
3-D building model
3-D layout regularization
binary integer programming (BIP)
Buildings
Color imagery
Facades
Finite element method
Image processing
Image reconstruction
Integer programming
Layout
Layouts
Numerical methods
Object recognition
Optimization
photogrammetric mesh
Photogrammetry
Regularity
Solid modeling
Three-dimensional displays
Virtual cameras
Windows
ISSN:0196-2892, 1558-0644
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The absence of detailed façade elements in photogrammetric building mesh models falls short for complex applications. These models often present irregular surfaces, significant geometric noise, and subpar texture quality, complicating façade parsing. To mitigate these challenges, we introduce StructuredMesh, an innovative approach to augment façade details while adhering to architectural regularity. Our method captures multiview color and depth images with a virtual camera and implements an object detection pipeline to semiautomatically delineate façade elements-such as windows, doors, and balconies-from color images. These elements are mapped into 3-D space using depth information, forming a preliminary façade layout. By harnessing architectural intelligence, we engage binary integer programming (BIP) for 3-D layout optimization, targeting component positions, orientations, and sizes. The resulting refined layout underpins the façade reconstruction of the mesh model through instance replacement. Our method's efficacy was confirmed on three distinct datasets. Employing the 3-D layout evaluation metrics we proposed, StructuredMesh surpasses conventional methods in numerical precision and regularity enhancement.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0196-2892
1558-0644
DOI:10.1109/TGRS.2023.3348492