An Explainable Student Fatigue Monitoring Module with Joint Facial Representation

Online fatigue estimation is, inevitably, in demand as fatigue can impair the health of college students and lower the quality of higher education. Therefore, it is essential to monitor college students’ fatigue to diminish its adverse effects on the health and academic performance of college studen...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Sensors (Basel, Switzerland) Jg. 23; H. 7; S. 3602
Hauptverfasser: Li, Xiaomian, Lin, Jiaqin, Tian, Zhiqiang, Lin, Yuping
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Switzerland MDPI AG 30.03.2023
MDPI
Schlagworte:
20th century
Academic achievement
Academic Performance
Benchmarking
Chronic fatigue syndrome
Classification
CNN
College students
Coronaviruses
COVID-19
Deep learning
Education
Health aspects
Humans
joint facial representation
Machine learning
Medical research
Metal fatigue
Mouth
MPA
Myopia
Neural networks
Observational studies
online fatigue detection
Pandemics
Questionnaires
Research methodology
Students
Surveys and Questionnaires
video-based online fatigue detection
United States
China
New Jersey
Germany
CNN
joint facial representation
online fatigue detection
video-based online fatigue detection
MPA
ISSN:1424-8220, 1424-8220
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Online fatigue estimation is, inevitably, in demand as fatigue can impair the health of college students and lower the quality of higher education. Therefore, it is essential to monitor college students’ fatigue to diminish its adverse effects on the health and academic performance of college students. However, former studies on student fatigue monitoring are mainly survey-based with offline analysis, instead of using constant fatigue monitoring. Hence, we proposed an explainable student fatigue estimation model based on joint facial representation. This model includes two modules: a spacial–temporal symptom classification module and a data-experience joint status inferring module. The first module tracks a student’s face and generates spatial–temporal features using a deep convolutional neural network (CNN) for the relevant drivers of abnormal symptom classification; the second module infers a student’s status with symptom classification results with maximum a posteriori (MAP) under the data-experience joint constraints. The model was trained on the benchmark NTHU Driver Drowsiness Detection (NTHU-DDD) dataset and tested on an Online Student Fatigue Monitoring (OSFM) dataset. Our method outperformed the other methods with an accuracy rate of 94.47% under the same training–testing setting. The results were significant for real-time monitoring of students’ fatigue states during online classes and could also provide practical strategies for in-person education.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
content type line 23
These authors contributed equally to this work.
ISSN:1424-8220
1424-8220
DOI:10.3390/s23073602