Quality of Information About Kidney Stones from Artificial Intelligence Chatbots
Kidney stones are common and morbid conditions in the general population with a rising incidence globally. Prior studies show substantial limitations of online sources of information regarding prevention and treatment. The objective of this study was to examine the quality of information about kidne...
Saved in:
| Published in: | Journal of endourology Vol. 38; no. 10; p. 1056 |
|---|---|
| Main Authors: | , , , , |
| Format: | Journal Article |
| Language: | English |
| Published: |
United States
01.10.2024
|
| ISSN: | 1557-900X, 1557-900X |
| Online Access: | Get more information |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Kidney stones are common and morbid conditions in the general population with a rising incidence globally. Prior studies show substantial limitations of online sources of information regarding prevention and treatment. The objective of this study was to examine the quality of information about kidney stones from artificial intelligence (AI) chatbots.
The most common online searches about kidney stones from Google Trends and headers from the National Institute of Diabetes and Digestive and Kidney Diseases website were used as inputs to 4 AI chatbots (ChatGPT version 3.5, Perplexity, Chat Sonic, and Bing AI). Validated instruments were used to assess the quality (DISCERN instrument from 1 low to 5 high), understandability and actionability (PEMAT, from 0 to 100%) of the chatbot outputs. In addition, we examined the reading level of the information and whether there was misinformation compared to guidelines (5 point Likert scale).
AI chatbots generally provide high-quality consumer health information (median DISCERN 4 out of 5) and did not include misinformation (median 1 out of 5). The median understandability was moderate (median 69.6%) and actionability was moderate to poor (median 40%). Responses were presented at an advanced reading level (11th grade; median Flesch-Kincaid score 11.3).
AI chatbots provide generally accurate information on kidney stones and lack misinformation; however, it is not easily actionable and is presented above the recommended reading level for consumer health information. |
|---|---|
| Bibliography: | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
| ISSN: | 1557-900X 1557-900X |
| DOI: | 10.1089/end.2023.0484 |