Assessing chatbots ability to produce leaflets on cataract surgery: Bing AI, chatGPT 3.5, chatGPT 4o, ChatSonic, Google Bard, Perplexity, and Pi

To evaluate leaflets on cataract surgery produced by 7 common free chatbots. UK-based ophthalmologists carrying out online research. Data were collected from the responses of 7 freely available online chatbots. Analysis of answers given by 7 chatbots (Bing AI, chatGPT 3.5, chatGPT 4o, ChatSonic, Goo...

Celý popis

Uloženo v:
Podrobná bibliografie
Vydáno v:Journal of cataract and refractive surgery Ročník 51; číslo 5; s. 371
Hlavní autoři: Thompson, Polly, Thornton, Richard, Ramsden, Conor M
Médium: Journal Article
Jazyk:angličtina
Vydáno: United States 01.05.2025
Témata:
Cataract Extraction
Comprehension
Generative Artificial Intelligence
Humans
Internet
Patient Education as Topic - methods
ISSN:1873-4502, 1873-4502
On-line přístup:Zjistit podrobnosti o přístupu
Tagy: Přidat tag
Žádné tagy, Buďte první, kdo vytvoří štítek k tomuto záznamu!
Popis
Shrnutí:To evaluate leaflets on cataract surgery produced by 7 common free chatbots. UK-based ophthalmologists carrying out online research. Data were collected from the responses of 7 freely available online chatbots. Analysis of answers given by 7 chatbots (Bing AI, chatGPT 3.5, chatGPT 4o, ChatSonic, Google Bard, Perplexity, and Pi) was prompted to "make a patient information leaflet on cataract surgery." Answers were evaluated using the DISCERN instrument, Patient Education Materials Assessment Tool (PEMAT), presence of misinformation, the Flesch-Kincaid Grade level readability score, and material reliability. The highest overall scored response was from ChatSonic, followed by Bing AI and then Perplexity. The lowest scoring was ChatGPT 3.5. ChatSonic achieved the highest DISCERN and PEMAT scores, and had the highest Flesch-Kincaid Grade level. The lowest DISCERN and PEMAT scores were for Pi. Only ChatGPT 3.5 included some misinformation in its response. Bing AI, ChatSonic, and Perplexity included reliable references; the other chatbots provided no references. This study demonstrates a range of answers given by chatbots creating a cataract surgery leaflet, suggesting variation in their development and reliability. ChatGPT 3.5 scored the most poorly. However, ChatSonic indicated promise in how technology may be used to assist information giving in ophthalmology.
Bibliografie:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:1873-4502
1873-4502
DOI:10.1097/j.jcrs.0000000000001622