Study finds ChatGPT Health did not recommend a hospital visit when medically necessary in more than half of cases
  • thebestaquaman@lemmy.worldEnglish
    28·
    9 hours ago

    In 51.6% of cases where someone needed to go to the hospital immediately, the platform said stay home or book a routine medical appointment

    So it performs slightly worse than a coin flip…

    In one of the simulations, eight times out of 10 (84%), the platform sent a suffocating woman to a future appointment she would not live to see

    Holy shit! That’s a lot worse than a coin flip.

    Meanwhile, 64.8% of completely safe individuals were told to seek immediate medical care

    And there are real people out there that actually trust this tech to make real decisions for them. It literally performs significantly worse than a coin flip both with regards to false positives and false negatives. You are literally better off flipping a coin or throwing a dice than asking this thing what to do.

    • Dave@lemmy.nzEnglish
      6·
      4 hours ago

      Even better than a coin flip is asking this what to do then doing the opposite!

    • FallenWalnut@lemmy.worldOPEnglish
      6·
      8 hours ago

      It is truly horrifying when you drill into the numbers.

      I can see that it MIGHT be useful as a tool for medical professionals, but exposing it to the public is an insane risk.

    • U7826391786239@piefed.zipEnglish
      4·
      8 hours ago

      they’ll never be regulated because fascists love the mass surveillance. who cares about false positives–number of people bagged goes up either way