Deleted Comment
So the story is of a random person who suddenly observes their meter jump from the usual 0% to a cautious 3%. Then over the course of the day, it slowly climbs to 20%, and onwards.
No one knows why, and no one can help them.
Finish the story. There are a variety of interesting outcomes (most of which lead to the demise of our poor random Joe or Mary, but not all).
-----------------------------
Short Story
In the not-so-distant future, we’ve trained AI to predict the probability you might die on any given day. But it’s trained on so many factors, and reads so many inputs, that no one really knows how it works.
So the story is of a random person who suddenly observes their meter jump from the usual 0% to a cautious 3%. Then over the course of the day, it slowly climbs to 20%, and onwards.
No one knows why, and no one can help them. They get a call from their boss, who sends them home early, rather than risk their safety in the office. Strangers offer to take them home. A stranger on the street offers to trade cards with them, and promises that his card can help them.
The meter shows up at 30% on the subway, and the narrator tries to hide it, but it’s too late, and the people around them are already looking at them suspiciously. The narrator tries to call their spouse, but they can’t get hold of them. They go home, but their spouse isn’t there.
By the time they get home, the meter is at 40%. They try to call for help, but the police are already there, waiting. The meter hits 60%, and then 100%.
The police tell the narrator that they’re sorry, but they’ve been watching them for some time, and have seen no indications that the narrator is a threat. The narrator protests that they’ve been trying to call the police, but now the police just say that the meter made a prediction, and they’re just going by the numbers.
The police tell the narrator that they’ll have to detain them, for the next 24 hours, to prevent them from doing anything rash. The narrator protests, but the police ignore them, and cuff them.
The police take the narrator in, but they aren’t taken to a normal jail. They’re taken to a special prison — a prison for people who might die.
He spends the remainder of his life in that jail cell.
Couple of more examples about doing things which don't scale:
Instacart manually built their product catalog for the first few million products.[0]
Pandora analyzing 10,000 songs manually for recommendation. [1]
It's suddenly feasible to build businesses that require at-scale manual operations, because you can do so in a predictable, revenue-positive way.
Interestingly, this is (roughly) the Qur'anic explanation for the genesis of human consciousness.