Machine Learning-Based Classification of Programming Logic Understanding Levels by Mouse-Tracking Heatmaps

In the past decade, there has been a significant increase in the growth of the global technology employment market, primarily owing to the digital age, artificial intelligence expansion, cloud computing, and cybersecurity requirements. Consequently, the demand for IT professionals has increased. Int...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access Jg. 13; S. 89905 - 89914
Hauptverfasser: Khaesawad, Attaporn, Fukuchi, Yosuke, Yem, Vibol, Nishiuchi, Nobuyuki
Format: Journal Article
Sprache:Englisch
Veröffentlicht: Piscataway IEEE 2025
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Schlagworte:
Algorithms
Artificial intelligence
Block codes
Block coding
Classification
Cloud computing
Codes
Colleges & universities
Computer languages
Cybersecurity
Decision trees
Education
Encoding
Heating systems
Logic
Machine learning
mouse-tracking heatmap
pattern classification
Problem-solving
Programming
Programming profession
Students
teacher support
Teachers
Tracking
ISSN:2169-3536, 2169-3536
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:In the past decade, there has been a significant increase in the growth of the global technology employment market, primarily owing to the digital age, artificial intelligence expansion, cloud computing, and cybersecurity requirements. Consequently, the demand for IT professionals has increased. Introductory programming is a crucial early course in IT higher education as it aids in developing problem-solving skills. However, such courses tend to result in substantially high failure and dropout rates. Some studies have proposed solutions such as peer learning and personalized feedback, but challenges persist. One key assumption is that teacher support is likely to help mitigate these rates. However, with limited class time, teachers find it challenging to support all the students. This study aims to automatically assess the programming logic understanding level (PLUL) during introductory programming courses. We proposed a method for classifying PLUL through a block coding learning platform based on mouse-tracking heatmaps using machine learning techniques. We collected actual learning-task data from first-year university students and compared the performance of five machine learning models. The decision tree algorithm achieved an accuracy score of 76.00%, F1 score of 77.36%, sensitivity score of 75.93%, and specificity score of 76.09%. These findings demonstrate that our method can effectively classify students based on their PLUL of tasks on a block coding learning platform.
Bibliographie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2025.3571050