ChatGPT Scored 72% In Clinical Decision Accuracy, MGB Study Shows

ChatGPT Scored 72% In Clinical Decision Accuracy, MGB Study Shows

According to an MGB research, ChatGPT has a 72% clinical judgment accuracy rating.According to new research from Mass General Brigham, the broad language model had inconsistent performance throughout general and emergency care, as well as for all medical specialties, although it struggled with differential diagnosis.Mass General Brigham researchers put ChatGPT to the test to see if AI can handle an entire clinical encounter with a patient, including suggesting a diagnostic workup, choosing a course of action, and making a final diagnosis. They discovered that the large language model had "impressive accuracy" despite limitations, such as potential hallucinations.

Medigy Insights

In a recent MGB study, ChatGPT achieved a 72% clinical judgment accuracy. Mass General Brigham's research found variable performance in general, emergency care, and specialties, though it struggled with differential diagnoses. Despite limitations like potential hallucinations, ChatGPT showed impressive accuracy in handling full clinical encounters, including suggesting diagnoses and treatment plans, trained on 36 clinical vignettes from Merck's manual.




Next Article

Did you find this useful?

Medigy Innovation Network

Connecting innovation decision makers to authoritative information, institutions, people and insights.

Medigy Logo

The latest News, Insights & Events

Medigy accurately delivers healthcare and technology information, news and insight from around the world.

The best products, services & solutions

Medigy surfaces the world's best crowdsourced health tech offerings with social interactions and peer reviews.


© 2024 Netspective Media LLC. All Rights Reserved.

Built on May 23, 2024 at 3:57am