3/28/2024 0 Comments Ai chatbot online courseCompared with human answers, chatbot answers were more frequently rated as probably or definitely written by AI (prevalence ratio, 1.72 95% CI, 1.52-1.93). Of 800 evaluations of chatbot-written answers, 168 answers (21.0%) were marked as human-written, while 517 of 800 human-written answers (64.6%) were marked as AI-written. The mean (SD) accuracy for distinguishing between AI and human responses was 61.3% (9.7%). Results A total of 200 pairs of user questions and answers by AAO-affiliated ophthalmologists were evaluated. Main Outcomes and Measures Identification of chatbot and human answers on a 4-point scale (likely or definitely artificial intelligence vs likely or definitely human) and evaluation of responses for presence of incorrect information, alignment with perceived consensus in the medical community, likelihood to cause harm, and extent of harm. Posts were dated between 20 data were accessed January 2023 and analysis was performed between March and May 2023. A masked panel of 8 board-certified ophthalmologists were asked to distinguish between answers generated by the ChatGPT chatbot and human answers. Objective To evaluate the quality of ophthalmology advice generated by an LLM chatbot in comparison with ophthalmologist-written advice.Äesign, Setting, and Participants This cross-sectional study used deidentified data from an online medical forum, in which patient questions received responses written by American Academy of Ophthalmology (AAO)–affiliated ophthalmologists. It remains unclear whether LLM-generated advice is accurate, appropriate, and safe for eye patients. Importance Large language models (LLMs) like ChatGPT appear capable of performing a variety of tasks, including answering patient eye care questions, but have not yet been evaluated in direct comparison with ophthalmologists.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |