On Improving Visual-Facial Emotion Recognition with Audio-lingual and Keyboard Stroke Pattern Information

In this paper, we investigate the possibility of improving the accuracy of visual-facial emotion recognition through use of additional (complementary)information. The investigation is based on three empirical studies that we have conducted involving human subjects and human observers. The studies we...

Full description

Saved in:
Bibliographic Details
Published in:Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 01 Vol. 1; pp. 810 - 816
Main Authors: Tsihrintzis, George A., Virvou, Maria, Stathopoulou, Ioanna-Ourania, Alepis, Efthimios
Format: Conference Proceeding
Language:English
Published: Washington, DC, USA IEEE Computer Society 09.12.2008
IEEE
Series:ACM Conferences
Subjects:
affective user modeling
Computing methodologies > Artificial intelligence > Computer vision > Computer vision problems > Object recognition
Emotion recognition
empirical studies
Face detection
Face recognition
Facial expression analysis
Human computer interaction
Human-centered computing > Human computer interaction (HCI) > Interaction devices
Human-centered computing > Human computer interaction (HCI) > Interaction devices > Touch screens
Human-centered computing > Human computer interaction (HCI) > Interaction paradigms
Informatics
Instruments
Intelligent agent
Keyboards
multi-modal interfaces
Psychology
Speech
visual-facial affect recognition
human-computer interaction
visual-facial affect recognition
affective user modeling
Facial expression analysis
multi-modal interfaces
empirical studies
ISBN:9780769534961, 0769534961
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we investigate the possibility of improving the accuracy of visual-facial emotion recognition through use of additional (complementary)information. The investigation is based on three empirical studies that we have conducted involving human subjects and human observers. The studies were concerned with the recognition of emotions from a visual-facial modality, audio-lingual and keyboard-stroke information, respectively. They were inspired by the relative shortage of such previous research in empirical work concerning the strengths and weaknesses of each modality so that the extent can be determined to which the keyboard-stroke and audio-lingual information complements and improves the emotion recognition accuracy of the visual-facial modality. Specifically, our research focused on the recognition of six basic emotion states, namely happiness, sadness, surprise, anger and disgust as well as the emotionless state which we refer to as neutral. We have found that the visual-facial modality may allow the recognition of certain states, such as neutral and surprise, with sufficient accuracy. However, its accuracy in recognizing anger and disgust can be improved significantly if assisted by keyboard-stroke information.
ISBN:9780769534961
0769534961
DOI:10.1109/WIIAT.2008.282