Search engines and Dr. Google must be feeling like they’ve missed some major artillery level bullets in this debate.
Fuckin WebMD just hunkering down in the corner.
Readit Newsselridge commented on ChatGPT Health fails to recognise medical emergencies – study theguardian.com/technolog... · Posted by u/simonebrunozzi
I think there is so much potential for AI in healthcare, but we absolutely HAVE to go through the existing ruleset of conducting years of research and trials and approvals before pushing anything out to patients. Move fast and break things is simply not an option in healthcare.
Sure it is. How many trials did we have before ER doctors started using Wikipedia?
I don't understand what you're proposing. How would you design such a study in a way that would pass IRB?
You could absolutely randomize care between a doctor and an AI under an IRB. I’d be stunned if there aren’t a dozen studies doing something like this already.
You have to justify it, but most places have sections in the document where you request review to justify it. It’s not any different from giving one patient heart medicine that you think works and another patient a sugar pill.
You're joking right? This is the 'testing on mice' phase and it failed and your idea is to start dosing humans just to see what happens.
Human use is already widespread. You might as well complain in 2015 about the use of Wikipedia among emergency room doctors. That ship has sailed.
I don't understand this reasoning. Randomizing people to AI vs standard of care is expensive and risky. Checking whether the AI can pass hypothetical scenarios seems like a perfectly reasonable approach to researching the safety of these models before running a clinical trial.
The issue is that those hypothetical scenarios do not have to look like how patients actually interact with the tool.
Real life use is full of ill posed questions open ended statements inaccurate assessment of symptoms, and conclusory remarks sprinkled in between. Real use of chat bots for Health by non-clinicians looks very different than scenario based evaluation.
I’ve never heard of in my entire life a doctor failing to recognize a medical emergency. /s
One of the things that people need to come to grips with is that like Wikipedia people will use ChatGPT because it is there. And the alternative is to be rich and have a primary care doctor that you can reach out to at a moments notice. Until that is different people will use these web services. It’s the same thing as Wikipedia or WebMD.
Well, if it's in production, it's not at my company, any of my vendors, or for that matter any of the software I use in my private life; the pace of all of that is exactly what it was 2 years ago. When it shows up I'll form an opinion.
What do you expect that it’s gonna announce itself in a modal dialogue when you run the software?
This isn’t like AI image generation where you’re going to convince yourself that you can tell the difference based on how you think it looks. Do you really think no one in the production chain of any of the software that you use picked up copilot in the last two years?
What signal are you hoping to receive that this is happening?
selridge commented on Can you reverse engineer our neural network? blog.janestreet.com/can-y... · Posted by u/jsomers
selridge commented on Can you reverse engineer our neural network? blog.janestreet.com/can-y... · Posted by u/jsomers