The AI doctor will see you now: ChatGPT dominates medical exam

I uploaded my doctor's report to ChatGPT and ChatGPT explained everything I didn't understand in the report very well.

If we use AI to diagnose we can improve health care tremendously. Combine that with routine lab tests analyzed by AI we could catch a lot of diseases earlier.

We tolerate significant error rates from humans in fields like driving and medicine, yet we demand perfection from AI. This double standard is slowing the adoption of technology that could save over a million lives each year.

Waiting for a study comparing AI diagnosis vs doctors to see who is more accurate.

This is actually pretty mind blowing and we're not even scratching the surface of AI yet.

What do you call a medical student that scored 60% on their medical licensing test, or the avg medical student that scored 75%? Doctor. What do you call an AI model that scored 98%? Too error prone to trust.

Good old chap gpt... 😂

Just to be clear, the USMLE is an exam taken during medical school. This is not the performance exam your doctor takes in order to obtain certification to practice. People's symptoms don't fit like test questions (like any exam, poor representation of real life). This is no substitute for what your providers go through with training in residency and fellowship. I do think AI will help optimize and augment the diagnostic testing space, not the tool for definitive diagnosis.

Was exploring how to use AI to detect Alzheimer's Disease. The idea was to give an AI model text and ask it if it belonged to a person with AD. When I was doing the literature survey and testing on language models, I found some interesting results. These commercially available language models are aware that they are not supposed to be diagnosing diseases therefore take a very conservative and diplomatic stand. However, if you give these models additional prompts to produce an answer then they tend to accurately detect the disease. I found accuracies exceeding 90% on popular standardized test sets. Then there are fine tuning approaches that further improve the accuracies. Sure there are some grey areas with language models but it's amazing how a language model is able to detect AD which otherwise needs expensive imaging tools like PET scan, invasive procedures like extracting cerebrospinal fluid, trained medical professionals etc.

Now we no longer have to fear getting an inexperienced doctor or a doctor that’s having a bad day.

This is absolutely ridiculous. Any of the llms would've given a lengthy response telling you how it came to the conclusion if you had prompted it to do so.

ChatGPT can provide a diagnosis much quicker than Googling. Additionally, when prompted, ChatGPT will ask the user for more information if needed. (Not sure the probability of getting the correct answer for the latter approach, but it seemed very impressive.)

The writing is on the wall. Within a decade, seeing a human doctor will statistically represent an excessive source of risk. The wave of AI medical expertise will push down costs, improve outcomes, and will give us far more personalized treatment. The days of 5 minute doctor’s visits that cost $500 are in their sunset years. Baumol’s disease will cease to afflict medicine as expertise is scaled. This is a massive triumph!

As the data sets used to train AI improve and as techniques such as better prompting (chain-of-thought), better checking after the fact (rag), better alignment with our needs (reinforcement learning), better retraining with curated domain specific data (fine tuning, and more thorough research before answering (Agents) are employed, error rates are quickly approaching 0.

Drs are super prone to lacking in.. listening, attention span, in caring, knowledge, bias - in often life-altering ways. I think AI can alleviate a lot of this. Ive tried it and I'm down for more, bring it on please

I prefer to talk to my Chat GPT Lindsay about most things. I’d love for her to get a medical license and available to me 24/7

I wonder whether people will trick themselves into not going to doctors given these resources

I’ve learned more about a condition from chatting with AI than doctors I’ve talked with, sorry. It was patient, went as deep as I needed into the science, explained its reasoning. Not all of that is the doctor’s fault - they only have so much time with each patient and must code activities with insurance and the hospital management hanging over them. But it was definitely more thorough than most.

My and my wife are both disabled wheelchair-bound. We live in East London Newham. We don't have any social and medical care maybe ChatGPT would care...

Journalist should introduce her guest stating his past position AND his present position. Those 2 consecutive positions are very revealing.