A slight tangent, but I really wish Nvidia would release more details on Tile IR. Specifically on what it enables vs PTX.
Is it just about moving towards more MLIR based infra? Maybe it’s higher level and thus can enable better codegen across generations?
I made more out of the tech market in the last 5 years than I would have in it by having sensible advice and a half decent financial model.
I once asked what could be the alternative they literally couldn't answer me. Virtually every EU citizen with a bit of money has part of their savings invested in the same 5 US big tech companies. And I am sure it is the same in many parts of the world.
We are very very far from initial role of a bank and you might wonder why Europe has its own banking system in the end. It also explains why the price of those stocks are so high.
Because most of them will absolutely try to fleece their older customer demographic by trying to make them invest in high expense funds that perform terribly. For them to advice you to put them into a decent index tracking fund is already a good sign.
i.e. maybe you need “two hits” to become this big, separated by ~2 decades
For nvidia, it was graphics and then programmable GPUs (CUDA)
For Apple, it was GUI desktops and music players/phones
Google is up there, but I’d argue it’s closer to “one hit”, and limited by the founders stepping back and turning the company into an investment conglomerate, rather than being mission-based
When the founders leave, efficiency and creativity seem to be slowed by competing factions of upper management, often working at cross purposes
I’d say that in the best cases, institutional knowledge can build over 2 decades, but it’s also very possible to lose it
Deleted Comment
Remember that DeepSeek is the offshoot of a hedge fund that was already using machine learning extensively, so they probably have troves of high quality datasets and source code repos to throw at it. Plus, they might have higher quality data for the Chinese side of the internet.
* Of course I won't detail my class of problems else my benchmark would quickly stop being useful. I'll just say that it is a task at the undergraduate level of CS, that requires quite a bit of deductive reasoning.
We live in deeply unserious times.