And many other situations are damned if you do damned if you don't. Journalism websites have paywalls and people complain. They have ads and people complain. One way or another these people have to get paid. It's the same with shrinkflation. If costs increase, then either the product gets smaller, or the price gets higher. Either way, people complain.
Cars are special. They have some of the same issues other high-priced items that you buy occasionally and are a pain to shop for. Think mattresses, tires, and homes. There's information asymmetry, and actual comparison shopping is hassle. This is a setup for painful buying experiences.
With cars, lots of states also restrict manufacturers from selling directly to consumers. I guess it helps with competition at the consumer level, but manufacturers still have leverage over dealers (see This American Life #513).
With real estate, NAR only just (in 2024) got in trouble for price fixing commissions.
Based on this, I strongly believe that if you're providing hardware for software engineers, it rarely if ever makes sense to buy anything but the top spec Macbook Pro available, and to upgrade every 2-3 years. I can't comment on non desktop / non-mac scenarios or other job families. YMMV.
> Loading static pages from CDN to scrape training data takes such minimal amounts of resources that it's never going to be a significant part of my costs. Are there cases where this isn't true?
Why did you bring up static pages served by a CDN, the absolute best case scenario, as your reference for how crawler spam might affect server performance?
> Why did you bring up static pages served by a CDN...
This is easier said than done, but pushing the latest topic snapshot to the CDN whenever a post is made is doable.
Bitcoin has an infinite P/E.
Edit: P/E is also goofy for barely profitable companies. If you plot earnings on the x axis, P/E on the y, and hold price constant, you'll get a 1/x curve. It's not continuous at zero, and it ramps up quickly.