Search Results - "Educational Measurement methods"

Giving partial credit during an multiple choice question assessment reappraisal does not make the assessment process fairer by Desy, Janeve, Harvey, Adrian, Martin, Kerri, Naugler, Christopher, Mclaughlin, Kevin

Get full text

Comment on Su et al. (2024) ‘Assessing question characteristic influences on ChatGPT's performance and response-explanation consistency: Insights from Taiwan's Nursing Licensing Exam’ by Cheng, Kunming, Sun, Zaijie, Yin, Chengliang, Wu, Haiyang

Get full text

Comment on Su et al. (2024) ‘Assessing question characteristic influences on ChatGPT's performance and response-explanation consistency: Insights from Taiwan's Nursing Licensing Exam’ by Li, Xiaoe, Li, Chun, Huang, Meili

Get full text

Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study by Huh, Sun

“…This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical…”
Get full text

The authors’ reply: Completing the picture on student performances in OSCEs: A mixed-methods study on integration of a standardized patient rating by Lörwald, Andrea, Lahner, Felicitas-Maria, Stricker, Daniel, Huwendiek, Sören

Get full text

Chatbot vs Medical Student Performance on Free-Response Clinical Reasoning Examinations by Strong, Eric, DiGiammarino, Alicia, Weng, Yingjie, Kumar, Andre, Hosamani, Poonam, Hom, Jason, Chen, Jonathan H

“…This study compares performance on free-response clinical reasoning examinations of first- and second-year medical students vs 2 models of a popular chatbot…”
Get more information

Performance of ChatGPT on Specialty Certificate Examination in Dermatology multiple-choice questions by Passby, Lauren, Jenko, Nathan, Wernham, Aaron

“…Abstract ChatGPT is a large language model trained on increasingly large datasets by OpenAI to perform language-based tasks. It is capable of answering…”
Get full text

Anaesthetists' non-technical skills by Flin, R, Patey, R, Glavin, R, Maran, N

“…This review presents the background to the development of the anaesthetists' non-technical skills (ANTS) taxonomy and behaviour rating tool, which is the first…”
Get more information

Performance of ChatGPT on Nephrology Test Questions by Miao, Jing, Thongprayoon, Charat, Garcia Valencia, Oscar A, Krisanapan, Pajaree, Sheikh, Mohammad S, Davis, Paul W, Mekraksakit, Poemlarp, Suarez, Maria Gonzalez, Craici, Iasmina M, Cheungpasitporn, Wisit

“…ChatGPT is a novel tool that allows people to engage in conversations with an advanced machine learning model. ChatGPT's performance in the US Medical…”
Get more information

Authors' Response: The Accuracy of the Multimodal Large Language Model GPT-4 on Sample Questions From the Interventional Radiology Board Examination by Ariyaratne, Sisith, Jenko, Nathan, Mark Davies, A, Iyengar, Karthikeyan P, Botchu, Rajesh

Get more information

One Year On: Assessing Progress of Multimodal Large Language Model Performance on RSNA 2024 Case of the Day Questions by Hou, Benjamin, Mukherjee, Pritam, Batheja, Vivek, Wang, Kenneth C, Summers, Ronald M, Lu, Zhiyong

“…Background With the growing use of multimodal large language models (LLMs), numerous vision-enabled models have been developed and made available to the…”
Get more information

How Small Differences in Assessed Clinical Performance Amplify to Large Differences in Grades and Awards: A Cascade With Serious Consequences for Students Underrepresented in Medicine by Teherani, Arianne, Hauer, Karen E, Fernandez, Alicia, King, Jr, Talmadge E, Lucey, Catherine

“…While students entering medical schools are becoming more diverse, trainees in residency programs in competitive specialties and academic medicine faculty have…”
Get more information

Artificial intelligence in dental education: ChatGPT's performance on the periodontic in‐service examination by Danesh, Arman, Pazouki, Hirad, Danesh, Farzad, Danesh, Arsalan, Vardar‐Sengul, Saynur

“…Background ChatGPT's (Chat Generative Pre‐Trained Transformer) remarkable capacity to generate human‐like output makes it an appealing learning tool for…”
Get full text

Large Language Models in Medical Education: Comparing ChatGPT- to Human-Generated Exam Questions by Laupichler, Matthias Carl, Rother, Johanna Flora, Grunwald Kadow, Ilona C, Ahmadi, Seifollah, Raupach, Tobias

“…Creating medical exam questions is time consuming, but well-written questions can be used for test-enhanced learning, which has been shown to have a positive…”
Get more information

Evaluation of Reliability, Repeatability, Robustness, and Confidence of GPT-3.5 and GPT-4 on a Radiology Board-style Examination by Krishna, Satheesh, Bhambra, Nishaant, Bleakney, Robert, Bhayana, Rajesh

“…Background ChatGPT (OpenAI) can pass a text-based radiology board-style examination, but its stochasticity and confident language when it is incorrect may…”
Get more information

How to use polarity thinking TM to manage tensions between accountability and learner agency when using a multipurpose portfolio? by van der Gulden, R., Thoonen, B.P.A., Heeneman, S., Muris, J.W.M., Sagasser, M.H., Timmerman, A.A., Scherpbier-de Haan, N.D.

“…Portfolios are often implemented to target multiple purposes, e.g. assessment, accountability and/or self-regulated learning. However, in educational practice,…”
Get full text

ChatGPT-3.5 and ChatGPT-4 dermatological knowledge level based on the Specialty Certificate Examination in Dermatology by Lewandowski, Miłosz, Łukowicz, Paweł, Świetlik, Dariusz, Barańska-Rybak, Wioletta

“…Abstract Background The global use of artificial intelligence (AI) has the potential to revolutionize the healthcare industry. Despite the fact that AI is…”
Get full text

The effect of testing versus restudy on retention: a meta-analytic review of the testing effect by Rowland, Christopher A

“…Engaging in a test over previously studied information can serve as a potent learning event, a phenomenon referred to as the testing effect. Despite a surge of…”
Get more information

Amending Miller's Pyramid to Include Professional Identity Formation by Cruess, Richard L, Cruess, Sylvia R, Steinert, Yvonne

“…In 1990, George Miller published an article entitled "The Assessment of Clinical Skills/Competence/Performance" that had an immediate and lasting impact on…”
Get more information

Performance of ChatGPT Across Different Versions in Medical Licensing Examinations Worldwide: Systematic Review and Meta-Analysis by Liu, Mingxin, Okuhara, Tsuyoshi, Chang, XinYi, Shirabe, Ritsuko, Nishiie, Yuriko, Okada, Hiroko, Kiuchi, Takahiro

“…Over the past 2 years, researchers have used various medical licensing examinations to test whether ChatGPT (OpenAI) possesses accurate medical knowledge. The…”
Get full text