Deep Learning of Graph Matching

The problem of graph matching under node and pairwise constraints is fundamental in areas as diverse as combinatorial optimization, machine learning or computer vision, where representing both the relations between nodes and their neighborhood structure is essential. We present an end-to-end model t...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition S. 2684 - 2693
Hauptverfasser: Zanfir, Andrei, Sminchisescu, Cristian
Format: Tagungsbericht Buchkapitel
Sprache:Englisch
Veröffentlicht: IEEE 01.06.2018
Schlagworte:
Computational modeling
Computer and Information Sciences
Computer graphics and computer vision
Computer vision
Data- och informationsvetenskap (Datateknik)
Datorgrafik och datorseende
Feature extraction
Mathematical model
Natural Sciences
Naturvetenskap
Optimization
Symmetric matrices
Two dimensional displays
ISBN:9781538664209, 1538664208
ISSN:1063-6919
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The problem of graph matching under node and pairwise constraints is fundamental in areas as diverse as combinatorial optimization, machine learning or computer vision, where representing both the relations between nodes and their neighborhood structure is essential. We present an end-to-end model that makes it possible to learn all parameters of the graph matching process, including the unary and pairwise node neighborhoods, represented as deep feature extraction hierarchies. The challenge is in the formulation of the different matrix computation layers of the model in a way that enables the consistent, efficient propagation of gradients in the complete pipeline from the loss function, through the combinatorial optimization layer solving the matching problem, and the feature extraction hierarchy. Our computer vision experiments and ablation studies on challenging datasets like PASCAL VOC keypoints, Sintel and CUB show that matching models refined end-to-end are superior to counterparts based on feature hierarchies trained for other problems.
ISBN:9781538664209
1538664208
ISSN:1063-6919
DOI:10.1109/CVPR.2018.00284