They Say AI is Better Than Doctors. Let’s See Them Try That with Direct Primary Care Doctors.
A new study came out in Nature and here is what they supposedly found:
An artificial intelligence (AI) system trained to conduct medical interviews matched, or even surpassed, human doctors’ performance at conversing with simulated patients and listing possible diagnoses on the basis of the patients’ medical history1.
The chatbot, which is based on a large language model (LLM) developed by Google, was more accurate than board-certified primary-care physicians in diagnosing respiratory and cardiovascular conditions, among others. Compared with human doctors, it managed to acquire a similar amount of information during medical interviews and ranked higher on empathy.
I call BS on all this. The goal is obvious: replace physicians. The C-Suite executives hate us and want cheaper labor. They have done that over the years with NPs and PAs and now they want AI. Also, this experiment was done the following way:
To test the system, researchers enlisted 20 people who had been trained to impersonate patients, and got them to have online text-based consultations — both with AMIE and with 20 board-certified clinicians. They were not told whether they were chatting with a human or a bot.
So, the AI won because it can spew out beautifully written prose. Great. It also can access info much faster than doctors can. TIME is a critical component of all this. Those doctors in the system will always lose due to being rushed. That is why they burn out. Do you know who has all the time needed to make accurate diagnoses and empathize with patients? Yup, you guessed it, Direct Primary Care doctors.
I would put my money on DPC over AI any day of the week but it has to be face-to-face.
(This is a crossover post from DPCnews.com).
Of course they are better! Quality measures are defined by non clinician algorithms and succeeding with empathy but missing malignancy is by definition better. Don’t you know doctors are too arrogant! Everyone knows that. People are conditioned to like machines. That’s not going away.
Simulated patients are hardly anything like real patients. I bet they all have chief complaints that are the real reason for the visit and are symptoms, listen to every question and answer accurately. Also measuring expressions of empathy is very likely to include pat statements that real patients needing real empathy would find as faked. As usual, the people who say we can be replaced have no idea what we even do.