The canonical example I have heard is hospital emergency rooms that started to be measured by wait times, so they refused to admit patients until staff was ready to receive them, literally having ambulances circling around the block. This was supposed to be a "good measure turned into bad target" situation, but of course it makes no sense. What really changed was the locus of evaluation from the patient that evaluates his end-to-end emergency care experience on many criteria, including, but not limited to, emergency room wait times, to a bureaucrat who just evaluates the hospital myopically on 1 metric.
It is always the myopia of singling out this measure/target that is bad, throwing off all other tradeoffs and considerations, not the actual desire to improve the measure/target.
I'm surprised that PhDs aren't further abused. Your multi-year investment can be taken away at any time on a whim at your supervisor's discretion. It's a great deal of discretionary power.
When I got to that appointment someone was already in his office. The professor invited me in, but told me to sit and wait until they finish with the other student. He then proceeded to berate the guy in front of me. He used no kind words. Told him his work on the PhD thesis was completely incompetent, he wasted his years and stuff like that. It shook me deeply that someone would do that to his student, not to mention do it in front of a stranger.
Needless to say, I passed the offer to do the PhD at that place. It's still one of my most vivid memories from the time I spent there - which was otherwise full of interesting work and I'm grateful for the people that made it possible. I still wonder if that was real or the scene was played to find out if I'm able to handle pressure like that. In either case, it left the impression of a toxic environment that I did not want to have a part in.
Was a rather traumatic experience for me, because I had to watch and learn that a degree these days isn't really worth much.
2) "Nobody has ever experienced a crystal ball like this" Irellevant, as many do act at many points in life as such beliefs are 100% certainty (a plotting killer believing they will get away with it, for an extreme example). Doesn't matter whether they have a "crystal ball" guarantee of outcome X: their thinking making them see the future as having the same outcome X is enough.
As for (3) I sorta agree.
"MacAskill and others are concerned about what the discount rate should be because it is important for the decisions we make about the world—how much should we care about people who have not been born yet? One might be tempted to think that science could resolve this issue, but alas, it cannot."
Of course it cannot. It's an ethical decision, which rests on personal ethics (not totally unlike personal taste), which are influenced by cultural (society's) ethics.
If we want to think "rationally" about it, it would be based on "what kind of outcome we want for those future persons and how we can best achieve it". But even the choice of outcome would rest on ethics and cultural preferences - or something also non-rational like evolutionary urges.
2) I disagree on 2 counts.
a) Thinking you'll get away with something is categorically different from knowing it. Nobody ever experiences this sort of assuredness and we cannot extrapolate our behavior under volatility to conditions of certainty. The closest we come to it are the most meaningless actions (like me reaching for a water bottle, "knowing" that I will touch it and lift it up), but no meaningfully large action, and certainly not a single one that involves other conscious beings is ever experienced as certain.
b) Humans are not fundamentally probability-modeling animals. When your bottle slips and shatters on the hiking trail, nobody - not a single human soul - runs Monte Carlo simulations on where those shards might end up and what that might mean for the future of humanity and "solves back" the right action. It is a complete category error to model human actions as such. Probability estimates have their (limited) place in (rare) human decisions, but even then it is not an exact fit.
This whole crystal-ball exercise is at best a lazy attempt by Lee, because it is easy and convenient to talk about the robo-human caricatures of his imagination. He is basically shaking his fist ADMONISHING YOU to behave more like the simplified easily-quantified caricatures so he can study you easier get his MacArthur Genius Grant goddammit.
1) There is no “you” that is meaningfully apart from “your brain”. This trickery is meant to dissociate you from your body and backdoor sneak-in the labcoat-flasher as a co-conspiritor against yourself. It is every bit as gaslighting as a mom saying “why your hands don’t want to clean your room”.
2) Crystal ball, aka “if you knew you wouldn’t get caught” or “if you knew a child would get harmed”. These are always bad faith, 100% or the time, no exceptions. Nobody has ever experienced a crystal ball like this. NO GOD, of ANY faith, has ever made guarantees like this. The only thing this trickery is meant to serve is for the labcoat-flasher to control the imaginary future via the imaginary crystal ball and PROSECUTE YOU NOW for transgressions in his imagination. This is the girlfriend mad you for cheating on her in her dream and demanding you grovel at her feet for an apology.
3) This one is harder, because it sounds good, but it is worth making explicit because it is used against you as a form of control: human egalitarianism. See, nobody actually believes this, not in the here and now among the living 7 billion humans let alone all the imaginary descendents for centuries to come. A true and complete belief in this would make you a LITERAL SLAVE, spending every second and every disposable income on sponsoring the mass of humanity unrelated to you. The labcoat-flasher himself doesn’t believe this either, but he hopes you won’t focus on him - no, he will start with your well-meaning and generous (if ultimately strictly-speaking untrue) belief that all humans should be equal and will take your benevolence, stretch it “to its logical conclusion” far beyond it was ever meant to go, wrap it up around your throat and CHOKE you with it. This is the girlfriend demanding you take a second job to buy her the $100,000 crocodile skin Hermes Birkin purse she wants because that is her love language and you said you cared about her- or do you not love her?
Mendacious to its core, this kind of manipulative gaslighting rhetoric they boldly call “research” is the parochial pastime of labcoat-flashers like this Sangil “Arthur” Lee. It is a step in their vain chase for tenure or funding or some Young Researcher Award (TM). It never did and it never will have anything to do with reality or truth or any honest pursuit of such.