Using ChatGPT with Novice Arduino Programmers: Effects on Performance, Interest, Self-Efficacy, and Programming Ability

Saved in:
Bibliographic Details
Title: Using ChatGPT with Novice Arduino Programmers: Effects on Performance, Interest, Self-Efficacy, and Programming Ability
Language: English
Authors: Donald M. Johnson, Will Doss, Christopher M. Estepp
Source: Journal of Research in Technical Careers. 2024 8(1):1-17.
Availability: UNLV Department of Teaching and Learning. 4505 South Maryland Parkway PO Box 3005, Las Vegas, NV 89154. e-mail: jrtc@unlv.edu; Web site: https://digitalscholarship.unlv.edu/jrtc/
Peer Reviewed: Y
Page Count: 19
Publication Date: 2024
Sponsoring Agency: National Institute of Food and Agriculture (NIFA) (USDA)
Contract Number: 1024473
Document Type: Journal Articles
Reports - Research
Education Level: Higher Education
Postsecondary Education
Descriptors: Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Novices, Programming, Student Interests, Self Efficacy, Skill Development, Undergraduate Students, Agricultural Education, Academic Achievement
Geographic Terms: Arkansas
ISSN: 2578-2118
Abstract: A posttest-only control group experimental design compared novice Arduino programmers who developed their own programs (self-programming group, n = 17) with novice Arduino programmers who used ChatGPT 3.5 to write their programs (ChatGPT-programming group, n = 16) on the dependent variables of programming scores, interest in Arduino programming, Arduino programming self-efficacy, Arduino programming posttest scores, and types of programming errors. Students were undergraduates in an introductory agricultural systems technology course in Fall 2023. The results indicated no significant (p < 0.10) differences between groups for programming rubric scores (p = 0.50) or interest in Arduino programming (p = 0.50). There were significant differences for Arduino programming self-efficacy, (p = 0.03, Cohen's d = 0.75) and Arduino posttest scores, (p = 0.03, Cohen's d = 0.76); students in the self-programming group scored significantly higher on both measures. Analysis of students' errors indicated the ChatGPT group made significantly (p < 0.01) more program punctuation errors. These results indicated novice students writing their own programs developed greater Arduino programming self-efficacy and programming ability than novice students using ChatGPT. Nevertheless, ChatGPT may still play an important role in assisting novices to write microcontroller programs.
Abstractor: As Provided
Entry Date: 2024
Accession Number: EJ1424887
Database: ERIC
Be the first to leave a comment!
You must be logged in first