Extending Convolutional Pose Machines for Facial Landmark Localization in 3D Point Clouds

In this work we address the problem of landmark localization in 3D point clouds by extending the convolutional pose machine (CPM) architecture to facilitate landmark localization in 3D point clouds. Making use of PointNet++,we are able to construct an architecture that is invariant tothe ordering of...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE International Conference on Computer Vision workshops S. 4600 - 4602
Hauptverfasser: O' Sullivan, Eimear, Zafeiriou, Stefanos
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 01.10.2019
Schlagworte:
Face
Feature extraction
Heating systems
Landmark Localization
Point Clouds
Point Convolutions
Shape
Sun
Three-dimensional displays
ISSN:2473-9944
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In this work we address the problem of landmark localization in 3D point clouds by extending the convolutional pose machine (CPM) architecture to facilitate landmark localization in 3D point clouds. Making use of PointNet++,we are able to construct an architecture that is invariant tothe ordering of an input point cloud. The sequential CPM architecture facilitates allows initial heatmaps to be iteratively refined in a series of point convolutional stages to yield robust landmark predictions. We propose to evaluate our approach for 3D facial landmark localization on benchmark face databases, BU-3DFE, BP4D-Spontaneous and BP4D+. The robustness of the approach to the size of the input point cloud will be assessed, and the contribution of the CPM stages will be evaluated in an ablation study.
ISSN:2473-9944
DOI:10.1109/ICCVW.2019.00564