On Improving Visual-Facial Emotion Recognition with Audio-lingual and Keyboard Stroke Pattern Information

In this paper, we investigate the possibility of improving the accuracy of visual-facial emotion recognition through use of additional (complementary)information. The investigation is based on three empirical studies that we have conducted involving human subjects and human observers. The studies we...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01 Jg. 1; S. 810 - 816
Hauptverfasser: Tsihrintzis, George A., Virvou, Maria, Stathopoulou, Ioanna-Ourania, Alepis, Efthimios
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: Washington, DC, USA IEEE Computer Society 09.12.2008
IEEE
Schriftenreihe:ACM Conferences
Schlagworte:
affective user modeling
Computing methodologies > Artificial intelligence > Computer vision > Computer vision problems > Object recognition
Emotion recognition
empirical studies
Face detection
Face recognition
Facial expression analysis
Human computer interaction
Human-centered computing > Human computer interaction (HCI) > Interaction devices
Human-centered computing > Human computer interaction (HCI) > Interaction devices > Touch screens
Human-centered computing > Human computer interaction (HCI) > Interaction paradigms
Informatics
Instruments
Intelligent agent
Keyboards
multi-modal interfaces
Psychology
Speech
visual-facial affect recognition
human-computer interaction
visual-facial affect recognition
affective user modeling
Facial expression analysis
multi-modal interfaces
empirical studies
ISBN:9780769534961, 0769534961
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In this paper, we investigate the possibility of improving the accuracy of visual-facial emotion recognition through use of additional (complementary)information. The investigation is based on three empirical studies that we have conducted involving human subjects and human observers. The studies were concerned with the recognition of emotions from a visual-facial modality, audio-lingual and keyboard-stroke information, respectively. They were inspired by the relative shortage of such previous research in empirical work concerning the strengths and weaknesses of each modality so that the extent can be determined to which the keyboard-stroke and audio-lingual information complements and improves the emotion recognition accuracy of the visual-facial modality. Specifically, our research focused on the recognition of six basic emotion states, namely happiness, sadness, surprise, anger and disgust as well as the emotionless state which we refer to as neutral. We have found that the visual-facial modality may allow the recognition of certain states, such as neutral and surprise, with sufficient accuracy. However, its accuracy in recognizing anger and disgust can be improved significantly if assisted by keyboard-stroke information.
ISBN:9780769534961
0769534961
DOI:10.1109/WIIAT.2008.282