I am an MLE not an expert. However, it is a fundamental problem that our current paradigm of training larger and larger LLMs cannot ever scale to the precision people require for many tasks. Even in the highly constrained realm of chess, an enormous neural net will be outclassed by a small program that can run on your phone.

https://arxiv.org/pdf/2402.04494

Ah, but, at least for generative AI, that kind of remains to be seen, surely? For every hyped thing that actually is The Future (TM), there are about ten hyped things which turn out to be Not The Future due to practical issues, cost, pointlessness once the novelty wears off, overpromising, etc. At this point, LLMs feel like they're heading more in that direction.

"I'm tired of the atomic bomb" - Someone in 1945.

Oh wait, news flash, not all technological developments are good ones, and we should actually evaluate each one individually.

AI is shit, and some people having fun with it does not balance against it's unusually efficacy in turning everything into shit. Choosing to do something because it's fun without regard to the greater consequences is the sort of irresponsibility that has gotten human society into such a mess in the first place.

I'm tired of 3d TV - Someone in 2013 (3D TV, after a big push by the industry in 2010, peaked in 2013, going into a rapid decline with the last hardware being produced in 2016).

Sometimes, the hyped thing doesn't catch on, even when the industry really, really wants it to.

At no point does the author suggest that AI is not going to happen or that it is not useful. He expresses frustration with marketing, false promises, pitching of superficial solutions for deep problems, and the usage of AI to replace meaningful human interactions. In short, the text is not about the technology itself.

I feel like I’m being gaslit about these AI code tools. I’ve got the paid copilot through work and I’ve just about never had it do anything useful ever.

I’m working on a reasonably large rails app and it can’t seem to answer any questions about anything, or even auto fill the names of methods defined in the app. Instead it just makes up names that seem plausible. It’s literally worse than the built in auto suggestions of vs code, because at least those are confirmed to be real names from the code.

Maybe these tools work well on a blank project where you are building basic login forms or something. But certainly not on an established code base.