Study Finds That ChatGPT Outperforms Doctors at Medical Diagnosis

New research has determined that AI chatbots may be better at diagnoses than actual doctors. The research objective was to find out whether doctors could improve their diagnoses using ChatGPT.

The research involved 50 doctors, 24 of whom were residents while the rest were attending physicians. Each physician was asked to diagnose six case histories, with the researchers grading their ability to come up with diagnoses and give reasons why they excluded them or chose them.

Everyone was allowed to make three possible diagnoses while offering evidence to support their decision. They were also required to list the steps they would take in their diagnostic process.

The case histories used were based on real patients but had never been published so medical students could be tested on them without any prior knowledge of them. This meant that the chatbot couldn’t have been trained on them either.

Some of the physicians were randomly allowed to use ChatGPT to assist them make their diagnoses, while others made their decisions without using AI. The physicians who didn’t use AI to make their decisions scored 74% while those that did scored 76%. On its own, the AI chatbot scored 90%.

The study was designed by Dr. Adam Rodman, who stated in an interview that while he expected the chatbot to help the physicians that used it, he was surprised to see it didn’t make a huge difference and even more surprised that the chatbots performed better than the physicians.

Rodman, an internal medicine expert at Boston’s Beth Israel Deaconess Medical Center, explained that artificial intelligence didn’t help the physicians that used it as much as was expected, mainly because the doctors didn’t listen to the chatbot when they didn’t agree with its results.

Most physicians, he added, firmly believed in their diagnoses and weren’t convinced that a bot knew more than they did. Rodman noted that artificial intelligence systems could offer beneficial second opinions on diagnoses.

Other issues that arose included the fact that many physicians didn’t know how to fully make use of artificial intelligence. This made it hard for them to take advantage of the system’s ability to solve complex diagnostic issues.

In their report, the authors of the study highlighted that there was a need for workforce and technology development to realize the potential of doctor-AI collaboration in clinical practice. This was based on AI’s better performance in comparison to the doctors’ performance. The study’s findings were reported in JAMA Network Open.

As more companies like Palantir Technologies Inc. (NYSE: PLTR) bring even more innovative AI solutions onto the market, we are likely to see many industries being disrupted by the influence of artificial intelligence.

About AINewsWire

AINewsWire (“AINW”) is a specialized communications platform with a focus on the latest advancements in artificial intelligence (“AI”), including the technologies, trends and trailblazers driving innovation forward. It is one of 70+ brands within the Dynamic Brand Portfolio @ IBN that delivers: (1) access to a vast network of wire solutions via InvestorWire to efficiently and effectively reach a myriad of target markets, demographics and diverse industries; (2) article and editorial syndication to 5,000+ outlets; (3) enhanced press release enhancement to ensure maximum impact; (4) social media distribution via IBN to millions of social media followers; and (5) a full array of tailored corporate communications solutions. With broad reach and a seasoned team of contributing journalists and writers, AINW is uniquely positioned to best serve private and public companies that want to reach a wide audience of investors, influencers, consumers, journalists, and the general public. By cutting through the overload of information in today’s market, AINW brings its clients unparalleled recognition and brand awareness.

AINW is where breaking news, insightful content and actionable information converge.

To receive SMS alerts from AINewsWire, text “AI” to 888-902-4192 (U.S. Mobile Phones Only)

For more information, please visit www.AINewsWire.com

Please see full terms of use and disclaimers on the AINewsWire website applicable to all content provided by AINW, wherever published or re-published: https://www.AINewsWire.com/Disclaimer

AINewsWire
Los Angeles, CA
www.AINewsWire.com
310.299.1717 Office
Editor@AINewsWire.com

AINewsWire is powered by IBN

Archives

Select A Month