Deconstruct to reconstruct: an automated pipeline for parsing complex CT assemblies

Many technical products are assemblies formed from smaller, versatile building blocks. Deconstructing such assemblies is an industrially important problem and an inspiring challenge for machine learning approaches. For the first time, we present an effective and fully automated pipeline for parsing...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Machine vision and applications Jg. 37; H. 1; S. 8
Hauptverfasser: Lippmann, Peter, Remme, Roman, Hamprecht, Fred A.
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Berlin/Heidelberg Springer Berlin Heidelberg 01.01.2026
Springer Nature B.V
Schlagworte:
Algorithms
Annotations
Assemblies
Automation
Aviation
Communications Engineering
Computed tomography
Computer Science
Datasets
High resolution
Image Processing and Computer Vision
Localization
Machine learning
Medical imaging
Networks
Pattern Recognition
Quality control
Segments
Complex assemblies
3D Object recognition
Assembly reconstruction
Computed tomography
3D Segmentation
ISSN:0932-8092, 1432-1769
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Many technical products are assemblies formed from smaller, versatile building blocks. Deconstructing such assemblies is an industrially important problem and an inspiring challenge for machine learning approaches. For the first time, we present an effective and fully automated pipeline for parsing large-scale, complex 3D assemblies from computed tomography (CT) scans into their individual parts. We have generated and make available a high-quality dataset of simulated, physically accurate CT scans with ground truth annotations. It consists of seven high-resolution CT scans ( voxels) of different technical assemblies with up to 3600 parts, each annotated with instance and semantic labels. The parts strongly vary in size and sometimes differ in fine details only. Our pipeline successfully handles the high-resolution volumetric inputs (3–30 GB) and produces detailed reconstructions of complex assemblies. The pipeline combines a 3D deep boundary detection network trained only on simulated CT scans with efficient graph partitioning to segment the 3D scans. The predicted instance segments are matched and aligned with a known part catalog to form a set of candidate part poses. The subset of these proposals that jointly best reconstructs the assembly is found by solving an instance of the maximum weighted independent set problem. We demonstrate that our approach generalizes to different CT scan setups and yields promising results even on real CT scans. Our pipeline is applicable to models that include parts not seen during training, making our approach adaptable to real-world scenarios.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:0932-8092
1432-1769
DOI:10.1007/s00138-025-01717-5