Optimizing Large Language Models for Auto-Generation of Programming Quizzes

This study analyzes the use of Large Language Models (LLMs) like ChatGPT in creating quizzes for Java programming courses, specifically Object-Oriented Programming (CS1) and Data Structures (CS2). It aims to evaluate the accuracy of LLM-generated assessments, understand the benefits and drawbacks of...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Integrated STEM Education Conference (Online) s. 1 - 5
Hlavní autori: Kumar, Yulia, Manikandan, Anjana, Li, J. Jenny, Morreale, Patricia
Médium: Konferenčný príspevok..
Jazyk:English
Vydavateľské údaje: IEEE 09.03.2024
Predmet:
Accuracy
AI-Supplemental Instructor (AI-SI)
Chatbots
Computer science education
Data structures
Education
Java
Java programming instruction
Large language models
use of LLMs in CS education
ISSN:2473-7623
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:This study analyzes the use of Large Language Models (LLMs) like ChatGPT in creating quizzes for Java programming courses, specifically Object-Oriented Programming (CS1) and Data Structures (CS2). It aims to evaluate the accuracy of LLM-generated assessments, understand the benefits and drawbacks of using LLMs in CS education from educators' viewpoints, and identify effective prompt engineering strategies to enhance the quality of educational materials. The research compares quizzes made by LLMs against human-created content to assess their consistency with Java programming principles, alignment with CS1 and CS2 learning goals, and their impact on student engagement and comprehension, providing insights into LLMs' effectiveness in academic assessment creation for computer science education.
ISSN:2473-7623
DOI:10.1109/ISEC61299.2024.10665141