PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Images

While most state-of-the-art instance segmentation methods produce binary segmentation masks, geographic and cartographic applications typically require precise vector polygons of extracted objects instead of rasterized output. This paper introduces PolyWorld, a neural network that directly extracts...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings (IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Online) pp. 1938 - 1947
Main Authors: Zorzi, Stefano, Bazrafkan, Shabab, Habenschuss, Stefan, Fraundorfer, Friedrich
Format: Conference Proceeding
Language:English
Published: IEEE 01.06.2022
Subjects:
Buildings
Codes
Computer network reliability
Computer vision
grouping and shape analysis
Image segmentation
Photogrammetry and remote sensing; Deep learning architectures and techniques; Segmentation
Predictive models
Satellites
ISSN:1063-6919
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:While most state-of-the-art instance segmentation methods produce binary segmentation masks, geographic and cartographic applications typically require precise vector polygons of extracted objects instead of rasterized output. This paper introduces PolyWorld, a neural network that directly extracts building vertices from an image and connects them correctly to create precise polygons. The model predicts the connection strength between each pair of vertices using a graph neural network and estimates the assignments by solving a differentiable optimal transport problem. Moreover, the vertex positions are optimized by minimizing a combined segmentation and polygonal angle difference loss. PolyWorld significantly outperforms the state of the art in building polygonization and achieves not only notable quantitative results, but also produces visually pleasing building polygons. Code and trained weights are publicly available at https://thub.com/zorzis/yWorl-PoldPretrainedNetwork.
ISSN:1063-6919
DOI:10.1109/CVPR52688.2022.00189