If the Universe is computable, then human thinking is computable. All due respect to Penrose for his stellar achievements, but frankly the implications of Turing Complete, the halting problem, Church/Turing hypothesis and the point of Godel's Theorem seem to be things he does not fully understand.
I know this sounds cheeky but we all have brains that are good at some things and have failure modes as well. We are certainly seeing shadows of Human-type fallability in neural nets, which somehow seem to have a lot of similarities to human thinking.
Brains evolved in the physical world to solve problems and help organisms survive, thrive, and reproduce. Evolution is the product of a massive search over potential physical arrangements. I see no reason why the systems we develop would operate on drastically different premises.
When "blockchain" was on obvious scam, we all knew it but weren't vocal enough, now that AI is venturing into mountebank territory, it's important for everyone to speak out against this kind of charlatanism (importantly by dismissing it as nonsense and not letting them shift the narrative). I've lost so much respect for Anthropic who have done some good work but now appear to be a cult.