Facial Action Unit Detection using 3D Face Landmarks for Pain Detection

Automatic detection of facial action units (AUs) has recently gained attention for its applications in facial expression analysis. However, using AUs in research can be challenging since they are typically manually annotated, which can be time-consuming, repetitive, and error-prone. Advancements in...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:2023 45th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) Ročník 2023; s. 1 - 5
Hlavní autoři: Feghoul, Kevin, Bouazizi, Mondher, Maia, Deise Santana
Médium: Konferenční příspěvek Journal Article
Jazyk:angličtina
Vydáno: United States IEEE 24.07.2023
Témata:
Benchmark testing
Benchmarking
Biological system modeling
Deep learning
Face
Facial Expression
Gold
Humans
Pain
Pain - diagnosis
Reproducibility of Results
Three-dimensional displays
Transformers
ISSN:2694-0604, 2694-0604
On-line přístup:Získat plný text
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:Automatic detection of facial action units (AUs) has recently gained attention for its applications in facial expression analysis. However, using AUs in research can be challenging since they are typically manually annotated, which can be time-consuming, repetitive, and error-prone. Advancements in automated AU detection can greatly reduce the time required for this task and improve the reliability of annotations for downstream tasks, such as pain detection. In this study, we present an efficient method for detecting AUs using only 3D face landmarks. Using the detected AUs, we trained state-of-the-art deep learning models to detect pain, which validates the effectiveness of the AU detection model. Our study also establishes a new benchmark for pain detection on the BP4D+ dataset, demonstrating an 11.13% improvement in F1-score and a 3.09% improvement in accuracy using a Transformer model compared to existing studies. Our results show that utilizing only eight predicted AUs still achieves competitive results when compared to using all 34 ground-truth AUs.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:2694-0604
2694-0604
DOI:10.1109/EMBC40787.2023.10340059