If you take a huge amount of human-written text soup, train a neural network on it, add a system prompt “You are a helpful assistant”, and then feed it a context consisting of (a) a mailbox with information about someone’s affair, and (b) the statement that this assistant is going to be switched off, then that neural network may produce a text with blackmail threats solely because similar patterns exist in the original text soup.
…and not as:
Warning! The model may develop its own questionable ethics.
The conditions that elicited this response seemed very contrived to me.
- "The takedown provision applies to a much broader category of content—potentially any images involving intimate or sexual content—than the narrower NCII definitions found elsewhere in the bill. The takedown provision also lacks critical safeguards against frivolous or bad-faith takedown requests. Lawful content—including satire, journalism, and political speech—could be wrongly censored."
So sexual or intimate themed memes which use realistic looking imagery may end up being able to be taken down. I also find myself disagreeing with the EFF here in spite of generally being a tremendous supporter of their work. In particular their main argument is that there are existing laws which work for this issue, without introducing new potentially abusable legislation:
- "If a deepfake is used for criminal purposes, then criminal laws will apply. If a deepfake is used to pressure someone to pay money to have it suppressed or destroyed, extortion laws would apply. For any situations in which deepfakes were used to harass, harassment laws apply. There is no need to make new, specific laws about deepfakes in either of these situations."
But I think on this issue one should not need to suffer some form of measurable loss or suffering to want intimate/sexual images removed from a site, let alone then having to go through the legal system and file a lawsuit to achieve such.
[1] - https://en.wikipedia.org/wiki/TAKE_IT_DOWN_Act
[2] - https://www.eff.org/deeplinks/2025/04/congress-passes-take-i...
I have friends who were the victim of revenge porn and I think this law would help them. I’m looking forward to this becoming a law.
This actually sounds more similar to Partiful, which I like for one-off events. I would describe this as an open source Partiful, but not specifically geared towards parties.