Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and wa...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Journal of educational evaluation for health professions Ročník 20; s. 1
Hlavný autor: Huh, Sun
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: Korea (South) Korea Health Personnel Licensing Examination Institute 2023
Predmet:
Artificial Intelligence
Brief Report
educational measurement
Educational Measurement - methods
Humans
Knowledge
medical students
Republic of Korea
Students, Medical
Republic of Korea
Medical students
Educational measurement
Artificial intelligence
Knowledge
Republic of Korea
ISSN:1975-5937, 1975-5937
On-line prístup:Získať plný text
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1975-5937
1975-5937
DOI:10.3352/jeehp.2023.20.1