Depends on the company and compliance behind the app. If it's HIPAA certified, I would trust it as much as a tele health app that stores images or videos sent to a doctor. If I trust the security of my medical records with the app, then I personally wouldn't mind if AI was involved in the pipeline.
For context, I'm currently working on a HIPAA compliant app that uses AI to collect medical background info, then connects the user with an actual human doctor. To get HIPAA certified, the app code, infrastructure, and LLMs all need to be certified, using enterprise accounts with signed BAAs (contracts) that isolate PII and medical data. This prevents the medical data from being used as training data for the LLM.
HIPAA is not a foolproof system, but it's a crucial piece in the trust puzzle. I wouldn't trust an AI medical app without HIPAA certification. The chance of data leaking out through the LLM or hacks is too high without HIPAA.
Snark isn’t helpful, and is against HN guidelines. It’s actually a pretty big dodge from Delano. Trans women who are post-surgery may be VERY poorly served by these AI solutions and will likely need a very easy “escape hatch” option to get timely human review.
Delano should have said they’re going to provide that escape hatch with fast response times.
But an image analysis application like this is exactly what the tech is good at.
I also highly agree with the skeptisism regarding the companies selling the products. I would want this used along with a Dr's diagnosis, as an additional tool.
If it worked and was administered by me or a HIPAA compliant organization, yes.
But since visual analysis doesn't work for almost any STIs, and is intended to be used by uneducated partners that believe a visual inspection would protect them, then no.
Readit News
For context, I'm currently working on a HIPAA compliant app that uses AI to collect medical background info, then connects the user with an actual human doctor. To get HIPAA certified, the app code, infrastructure, and LLMs all need to be certified, using enterprise accounts with signed BAAs (contracts) that isolate PII and medical data. This prevents the medical data from being used as training data for the LLM.
HIPAA is not a foolproof system, but it's a crucial piece in the trust puzzle. I wouldn't trust an AI medical app without HIPAA certification. The chance of data leaking out through the LLM or hacks is too high without HIPAA.
Self-identified woman submits her dick pic.
AI: Massive tumor detected. Seek immediate medical help.
Delano should have said they’re going to provide that escape hatch with fast response times.
I wouldn't trust the state-of-the-art "machine learning" classifier, and the app described in the article certainly isn't state-of-the-art.
But an image analysis application like this is exactly what the tech is good at.
I also highly agree with the skeptisism regarding the companies selling the products. I would want this used along with a Dr's diagnosis, as an additional tool.
But since visual analysis doesn't work for almost any STIs, and is intended to be used by uneducated partners that believe a visual inspection would protect them, then no.