To be fair, Gary Marcus pioneered the "LLMs will never make it" genre of complaining. Everyone else is derivative [1]. Let the man have his victory lap. He's been losing arguments for 5 years straight at this point.

[1] Due credit to Yann for his 'LLMs will stop scaling, energy based methods are the way forward' obsession.