Your grid system is far less of a challenge than the amount of hills, twists, narrow streets and low visibility back streets in California.
I genuinely think the most complicated challenge for Waymo in NYC will be…winter snow and ice.
It's knowledge seems to be lacking even compared to gpt3.
No idea how you'd benchmark this though.
That is the point of these small models. Remove the bloat of obscure information (address that with RAG), leaving behind a core “reasoning” skeleton.
But if you look at the past CEOs, Intel had Krzanich (fab guy), Swan (CFO guy who didn't even want the job but they couldn't find anyone else), and Gelsinger (design guy and Grove disciple) in 11 years. I'll even throw in Jim Keller, not a CEO but still The Chip God, who left in frustration after two years.
What's the one common problem that all of them had despite all their different backgrounds? Getting relevant nodes to market and scaling them up. Their foundry efforts (v1 and v2) have been disastrous. The CEOs or MBAs perhaps were a friction, but they aren't the root cause. Technology Development has been the center of power that the fabs and products revolved around for decades.
Why not? It's just data, and a thumb drive stores data. As long as it fits.