Using ChatGPT with Novice Arduino Programmers: Effects on Performance, Interest, Self-Efficacy, and Programming Ability
Saved in:
| Title: | Using ChatGPT with Novice Arduino Programmers: Effects on Performance, Interest, Self-Efficacy, and Programming Ability |
|---|---|
| Language: | English |
| Authors: | Donald M. Johnson, Will Doss, Christopher M. Estepp |
| Source: | Journal of Research in Technical Careers. 2024 8(1):1-17. |
| Availability: | UNLV Department of Teaching and Learning. 4505 South Maryland Parkway PO Box 3005, Las Vegas, NV 89154. e-mail: jrtc@unlv.edu; Web site: https://digitalscholarship.unlv.edu/jrtc/ |
| Peer Reviewed: | Y |
| Page Count: | 19 |
| Publication Date: | 2024 |
| Sponsoring Agency: | National Institute of Food and Agriculture (NIFA) (USDA) |
| Contract Number: | 1024473 |
| Document Type: | Journal Articles Reports - Research |
| Education Level: | Higher Education Postsecondary Education |
| Descriptors: | Artificial Intelligence, Technology Uses in Education, Natural Language Processing, Novices, Programming, Student Interests, Self Efficacy, Skill Development, Undergraduate Students, Agricultural Education, Academic Achievement |
| Geographic Terms: | Arkansas |
| ISSN: | 2578-2118 |
| Abstract: | A posttest-only control group experimental design compared novice Arduino programmers who developed their own programs (self-programming group, n = 17) with novice Arduino programmers who used ChatGPT 3.5 to write their programs (ChatGPT-programming group, n = 16) on the dependent variables of programming scores, interest in Arduino programming, Arduino programming self-efficacy, Arduino programming posttest scores, and types of programming errors. Students were undergraduates in an introductory agricultural systems technology course in Fall 2023. The results indicated no significant (p < 0.10) differences between groups for programming rubric scores (p = 0.50) or interest in Arduino programming (p = 0.50). There were significant differences for Arduino programming self-efficacy, (p = 0.03, Cohen's d = 0.75) and Arduino posttest scores, (p = 0.03, Cohen's d = 0.76); students in the self-programming group scored significantly higher on both measures. Analysis of students' errors indicated the ChatGPT group made significantly (p < 0.01) more program punctuation errors. These results indicated novice students writing their own programs developed greater Arduino programming self-efficacy and programming ability than novice students using ChatGPT. Nevertheless, ChatGPT may still play an important role in assisting novices to write microcontroller programs. |
| Abstractor: | As Provided |
| Entry Date: | 2024 |
| Accession Number: | EJ1424887 |
| Database: | ERIC |
| Abstract: | A posttest-only control group experimental design compared novice Arduino programmers who developed their own programs (self-programming group, n = 17) with novice Arduino programmers who used ChatGPT 3.5 to write their programs (ChatGPT-programming group, n = 16) on the dependent variables of programming scores, interest in Arduino programming, Arduino programming self-efficacy, Arduino programming posttest scores, and types of programming errors. Students were undergraduates in an introductory agricultural systems technology course in Fall 2023. The results indicated no significant (p < 0.10) differences between groups for programming rubric scores (p = 0.50) or interest in Arduino programming (p = 0.50). There were significant differences for Arduino programming self-efficacy, (p = 0.03, Cohen's d = 0.75) and Arduino posttest scores, (p = 0.03, Cohen's d = 0.76); students in the self-programming group scored significantly higher on both measures. Analysis of students' errors indicated the ChatGPT group made significantly (p < 0.01) more program punctuation errors. These results indicated novice students writing their own programs developed greater Arduino programming self-efficacy and programming ability than novice students using ChatGPT. Nevertheless, ChatGPT may still play an important role in assisting novices to write microcontroller programs. |
|---|---|
| ISSN: | 2578-2118 |