CLKN: Cascaded Lucas-Kanade Networks for Image Alignment

This paper proposes a data-driven approach for image alignment. Our main contribution is a novel network architecture that combines the strengths of convolutional neural networks (CNNs) and the Lucas-Kanade algorithm. The main component of this architecture is a Lucas-Kanade layer that performs the...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) s. 3777 - 3785
Hlavní autoři: Che-Han Chang, Chun-Nan Chou, Chang, Edward Y.
Médium: Konferenční příspěvek
Jazyk:angličtina
Vydáno: IEEE 01.07.2017
Témata:
Estimation
Feature extraction
Jacobian matrices
Lighting
Mathematical model
Neural networks
Robustness
ISSN:1063-6919, 1063-6919
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:This paper proposes a data-driven approach for image alignment. Our main contribution is a novel network architecture that combines the strengths of convolutional neural networks (CNNs) and the Lucas-Kanade algorithm. The main component of this architecture is a Lucas-Kanade layer that performs the inverse compositional algorithm on convolutional feature maps. To train our network, we develop a cascaded feature learning method that incorporates the coarse-to-fine strategy into the training process. This method learns a pyramid representation of convolutional features in a cascaded manner and yields a cascaded network that performs coarse-to-fine alignment on the feature pyramids. We apply our model to the task of homography estimation, and perform training and evaluation on a large labeled dataset generated from the MS-COCO dataset. Experimental results show that the proposed approach significantly outperforms the other methods.
ISSN:1063-6919
1063-6919
DOI:10.1109/CVPR.2017.402