Still Using Only ChatGPT? The Comparison of Five Different Artificial Intelligence Chatbots' Answers to the Most Common Questions About Kidney Stones

To evaluate and compare the quality and comprehensibility of answers produced by five distinct artificial intelligence (AI) chatbots-GPT-4, Claude, Mistral, Google PaLM, and Grok-in response to the most frequently searched questions about kidney stones (KS). Google Trends facilitated the identificat...

Celý popis

Uložené v:
Podrobná bibliografia
Vydané v:Journal of endourology Ročník 38; číslo 11; s. 1172
Hlavní autori: Şahin, Mehmet Fatih, Topkaç, Erdem Can, Doğan, Çağrı, Şeramet, Serkan, Özcan, Rıdvan, Akgül, Murat, Yazıcı, Cenk Murat
Médium: Journal Article
Jazyk:English
Vydavateľské údaje: United States 01.11.2024
Predmet:
Artificial Intelligence
Comprehension
Humans
Internet
Kidney Calculi
Grok
kidney stone
Google PaLM
Mistral
Claude
GPT-4
artificial intelligence
ISSN:1557-900X, 1557-900X
On-line prístup:Zistit podrobnosti o prístupe
Tagy: Pridať tag
Žiadne tagy, Buďte prvý, kto otaguje tento záznam!
Popis
Shrnutí:To evaluate and compare the quality and comprehensibility of answers produced by five distinct artificial intelligence (AI) chatbots-GPT-4, Claude, Mistral, Google PaLM, and Grok-in response to the most frequently searched questions about kidney stones (KS). Google Trends facilitated the identification of pertinent terms related to KS. Each AI chatbot was provided with a unique sequence of 25 commonly searched phrases as input. The responses were assessed using DISCERN, the Patient Education Materials Assessment Tool for Printable Materials (PEMAT-P), the Flesch-Kincaid Grade Level (FKGL), and the Flesch-Kincaid Reading Ease (FKRE) criteria. The three most frequently searched terms were "stone in kidney," "kidney stone pain," and "kidney pain." Nepal, India, and Trinidad and Tobago were the countries that performed the most searches in KS. None of the AI chatbots attained the requisite level of comprehensibility. Grok demonstrated the highest FKRE (55.6 ± 7.1) and lowest FKGL (10.0 ± 1.1) ratings ( = 0.001), whereas Claude outperformed the other chatbots in its DISCERN scores (47.6 ± 1.2) ( = 0.001). PEMAT-P understandability was the lowest in GPT-4 (53.2 ± 2.0), and actionability was the highest in Claude (61.8 ± 3.5) ( = 0.001). GPT-4 had the most complex language structure of the five chatbots, making it the most difficult to read and comprehend, whereas Grok was the simplest. Claude had the best KS text quality. Chatbot technology can improve healthcare material and make it easier to grasp.
Bibliografia:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1557-900X
1557-900X
DOI:10.1089/end.2024.0474