This is actually one of the key points Yuval Noah Harari made in his landmark book 'Sapiens' (a must-read, probably the book I've recommended more than any other)
A book for which literally zero professional archaeologists or anthropologists were consulted and which promulgated more noble savage bullshit as a result. That "life of leisure" picture was based off of the work of one guy who wrote the hours literally spent hunting and gathering and none of the time spent processing food or maintaining tools and clothes, nor the hours per day spent collecting fresh water.
If agricultural life and cities were such a raw deal: why would people all over the world adopt it against their own self interest when humans were basically as intelligent (if not at all educated) as we are today?
Public transit got better.