The Forbes article is better than the BI blogspam:
https://www.forbes.com/sites/forbesunder30team/2023/11/28/ha...
Dead Comment
This is very similar to Reflective Towers Of Interpreters: https://blog.sigplan.org/2021/08/12/reflective-towers-of-int...
Yeah, it'd only really be useful if one was running some type of web service that called an executable, and there is no source code available to do any fastCGI or whatnot.
"We replaced our citizens with plant-based citizen alternatives, as they fart less".
AI will be used to select the net to automatically load. Nets will be cached, branch predicted etc.
The future of AI software and hardware doesn't yet support the scale we need for this type of generalized AI processor (think CPU but call it an AIPU.)
And no, GPUs aren't an AIPU, we can't even fit whole some of the largest models on these things without running them in pieces. They don't have a higher level language yet, like C, which would compile down to more specific actions after optimizations are borne (not PTX/LLVM/Cuda/OpenCL.)