Performance of Publicly Available Large Language Models on Internal Medicine Board-style Questions

Ongoing research attempts to benchmark large language models (LLM) against physicians’ fund of knowledge by assessing LLM performance on medical examinations. No prior study has assessed LLM performance on internal medicine (IM) board examination questions. Limited data exists on how knowledge suppl...

Full description

Bibliographic Details

Published in:	PLOS digital health Vol. 3; no. 9; p. e0000604
Main Authors:	Tarabanis, Constantine, Zahid, Sohail, Mamalis, Marios, Zhang, Kevin, Kalampokis, Evangelos, Jankelson, Lior
Format:	Journal Article
Language:	English
Published:	United States Public Library of Science 01.09.2024
Subjects:	Accuracy Application programming interface Artificial intelligence Benchmarks Biology and Life Sciences Chatbots Infectious diseases Internal medicine Large language models Medicine Medicine and Health Sciences Multiple choice People and Places Social Sciences Standardized tests
ISSN:	2767-3170, 2767-3170
Online Access:	Get full text
Tags:	Add Tag No Tags, Be the first to tag this record!