Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications

Facial expressions are an important way through which humans interact socially. Building a system capable of automatically recognizing facial expressions from images and video has been an intense field of study in recent years. Interpreting such expressions remains challenging and much research is n...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on pattern analysis and machine intelligence Jg. 38; H. 8; S. 1548 - 1568
Hauptverfasser: Corneanu, C. A., Oliu Simon, Marc, Cohn, Jeffrey F., Escalera Guerrero, Sergio
Format: Journal Article
Sprache:Englisch
Veröffentlicht: United States IEEE 01.08.2016
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
affect
Algorithms
Emotion recognition
Encoding
Face
Facial Expression
Humans
Iron
multimodal
Pattern Recognition, Automated
RGB
Taxonomy
thermal
Three-dimensional displays
ISSN:0162-8828, 2160-9292, 1939-3539
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Facial expressions are an important way through which humans interact socially. Building a system capable of automatically recognizing facial expressions from images and video has been an intense field of study in recent years. Interpreting such expressions remains challenging and much research is needed about the way they relate to human affect. This paper presents a general overview of automatic RGB, 3D, thermal and multimodal facial expression analysis. We define a new taxonomy for the field, encompassing all steps from face detection to facial expression recognition, and describe and classify the state of the art methods accordingly. We also present the important datasets and the bench-marking of most influential methods. We conclude with a general discussion about trends, important questions and future lines of research.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ObjectType-Article-2
ObjectType-Feature-3
content type line 23
ObjectType-Review-1
ISSN:0162-8828
2160-9292
1939-3539
DOI:10.1109/TPAMI.2016.2515606