Toward an Automatic System for Computer-Aided Assessment in Facial Palsy

Quantitative assessment of facial function is challenging, and subjective grading scales such as House-Brackmann, Sunnybrook, and eFACE have well-recognized limitations. Machine learning (ML) approaches to facial landmark localization carry great clinical potential as they enable high-throughput aut...

Full description

Saved in:
Bibliographic Details
Published in:Facial plastic surgery & aesthetic medicine Vol. 22; no. 1; p. 42
Main Authors: Guarin, Diego L, Yunusova, Yana, Taati, Babak, Dusseldorp, Joseph R, Mohan, Suresh, Tavares, Joana, van Veen, Martinus M, Fortier, Emily, Hadlock, Tessa A, Jowett, Nate
Format: Journal Article
Language:English
Published: United States 01.02.2020
Subjects:
Adolescent
Adult
Aged
Aged, 80 and over
Anatomic Landmarks
Child
Diagnosis, Computer-Assisted
Facial Expression
Facial Paralysis - diagnosis
Female
Humans
Machine Learning
Male
Middle Aged
Photography
ISSN:2689-3622, 2689-3622
Online Access:Get more information
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Quantitative assessment of facial function is challenging, and subjective grading scales such as House-Brackmann, Sunnybrook, and eFACE have well-recognized limitations. Machine learning (ML) approaches to facial landmark localization carry great clinical potential as they enable high-throughput automated quantification of relevant facial metrics from photographs and videos. However, the translation from research settings to clinical application still requires important improvements. To develop a novel ML algorithm for fast and accurate localization of facial landmarks in photographs of facial palsy patients and utilize this technology as part of an automated computer-aided diagnosis system. Portrait photographs of 8 expressions obtained from 200 facial palsy patients and 10 healthy participants were manually annotated by localizing 68 facial landmarks in each photograph and by 3 trained clinicians using a custom graphical user interface. A novel ML model for automated facial landmark localization was trained using this disease-specific database. Algorithm accuracy was compared with manual markings and the output of a model trained using a larger database consisting only of healthy subjects. Root mean square error normalized by the interocular distance (NRMSE) of facial landmark localization between prediction of ML algorithm and manually localized landmarks. Publicly available algorithms for facial landmark localization provide poor localization accuracy when applied to photographs of patients compared with photographs of healthy controls (NRMSE, 8.56 ± 2.16 vs. 7.09 ± 2.34,  ≪ 0.01). We found significant improvement in facial landmark localization accuracy for the facial palsy patient population when using a model trained with a relatively small number photographs (1440) of patients compared with a model trained using several thousand more images of healthy faces (NRMSE, 6.03 ± 2.43 vs. 8.56 ± 2.16,  ≪ 0.01). Retraining a computer vision facial landmark detection model with fewer than 1600 annotated images of patients significantly improved landmark detection performance in frontal view photographs of this population. The new annotated database and facial landmark localization model represent the first steps toward an automatic system for computer-aided assessment in facial palsy. 4.
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2689-3622
2689-3622
DOI:10.1089/fpsam.2019.29000.gua