Sign Language Recognition Based on CNN and Data Augmentation

Sign language recognition is an important assistive communication technology, which is one of the main communication methods for hearing and language impaired individuals. However, the development of sign language recognition technology has been facing issues such as insufficient data and low recogn...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:2023 IEEE 5th International Conference on Civil Aviation Safety and Information Technology (ICCASIT) S. 951 - 955
Hauptverfasser: Li, Gaoyun, Wang, Xiong, Liu, Yong
Format: Tagungsbericht
Sprache:Englisch
Veröffentlicht: IEEE 11.10.2023
Schlagworte:
American sign language
Assistive technologies
convolutional neural networks
Data augmentation
Gesture recognition
Real-time systems
Robustness
sign language recognition
System performance
Training
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Sign language recognition is an important assistive communication technology, which is one of the main communication methods for hearing and language impaired individuals. However, the development of sign language recognition technology has been facing issues such as insufficient data and low recognition rates. This paper proposed a sign language recognition method based on convolutional neural networks and data augmentation, which effectively improves the accuracy and robustness of sign language recognition. This paper evaluated the system's performance on sign language MNIST dataset. The experimental results show that the system can achieve average accuracy of 99.32% for the dataset after data augmentation for training dataset and significantly outperformed the models in the literature using the similar dataset. The research findings presented in this study provide valuable technical assistance for the implementation of sign language recognition technology in the fields of assistive communication and human-machine interaction.
DOI:10.1109/ICCASIT58768.2023.10351737