> Once network IO became the main bottleneck, the faster CPU mattered less.
It is surprisingly hard to keep a modern CPU core properly saturated unless you are baking global illumination, searching primes or mining crypto currency. I/O and latency will almost always dominate at scale. Moving information is way more expensive than processing it.
Or running molecular simulations, I can keep our whole cluster pegged at 100% CPU for weeks
I think the above answer was just a hype parrot
I would love it if generative AI could get us even further, we are severely compute limited and also testing in the lab is 20k a pop ... I am strongly incentivised for generative AI to be the answer, but as someone who works deeply in the field, the hype is real.