> Your hiring process is not optimised to further business goals,
That's a lot of things you were able to figure out based on my comments.
I don't mean to criticise you but rather suggest that the hiring process should focus less on intelligence and coding skills, and try to hire people that have intellect. That can pair judgement with intelligence. That can relate decisions to goals beyond their own personal preferences.
I have too many bad experiences with highly intelligent, but myopic and immature software developers who are left to "self organise" and just end up being lose cannons of raw intelligence, that does much more harm than good.
Software development, is more an organisational problem than a technical one.
The organisation itself is already so vastly complex that no human being can comprehend it, and that's why you have a hierarchy of information and specialisation of roles. Even if your system by some miracle has zero accidental complexity, it's still going to overwhelm even the most intelligent person, just by the amount of essential complexity. So you will need an organisation of hierarchy and/or specialisation to manage this. And the biggest determining factor for how successful you are, is this organisation and how it works as a whole, rather than any individuals superior capacity.
I just think it's a really bad idea to try to hire "extra smart" people to try to solve these issues, because it won't work.
Getting from "I have too many bad experiences with highly intelligent, but myopic and immature software developers" to "I just think it's a really bad idea to try to hire 'extra smart' people (..) because it won't work" is pretty poor logic.
I think much better and productive statement would be "Hiring intelligent people is not enough to solve the problem."
It is much more productive because from there you can go to actually discussing what else is needed to make good use of highly intelligent people.
That extra intelligence is mostly irrelevant, and sometimes negative.
Managing complexity is done with hierarchy, specialisation and careful organisation of work from accountable managers. You want this organisation to work well, and then you want to hire people who can do an acceptable job and function well within that organisation. And if you are still finding yourself in a chaos of unmanageable complexity, the organisation of the team is to blame.
The hierarchy, specialisation and organisation of the work is not done well enough, and must be fixed. You don't need more horsepower when the steering of your car has broken, that's just going to get you in the ditch faster.