The whole thing just strikes me as the continued under-valuing of this kind of maintenance work. It's not glamorous, you often work for a government/non-profit that pays less, on-call is brutal, and the chronic short-staffing is a pain multiplier. Not exactly the best foundation for an entire country's internet infrastructure to sit atop.
.au, .us, .com, .net, .gov, .io, etc all have the same challenges.
- Engagement surveys captured staff feeling fatigued and under resources at entire org level
- Hard to hire for roles due to specialisation
- Team moving away from BAU work to projects
- Issues raised by external partner but team had other immediate work pressures
- Had to contact ex-employee that use to worked there to help resolve
- Once a year critical take just done by one team member
- Many IT operations tasks have sufficient external dependencies that it is impossible to tell – for certain that the task will be successful in production without doing the task in the production environment. - We've all been there.
Sounds like InternetNZ should actually outsource all of this to an external party and just focus on governance work.
It sounds like he's the sole user on an o365 account. I wonder if his account was compromised leading to the loss of access. Seems kind of negligent on his behalf if he's the sole (admin) user. If his company has compliance requirements, meeting them would have likely addressed this issue.
Quick temporary fix would be to change public-facing DNS records: MX and likely (hopefully) SPF & DKIM, pointing them to a different mail host. At least that way he could get his email.
They won't help themselves and just switch and wait for the other provider to fix.
I can totally see how CIOs and other tech savvy leaders in business really look at anything they use Google related and wonder to themselves if it might be wise to look at alternatives.
I agree with lot of comments in that Twitter thread.
I've found them extremely unreliable both in my free account (every failure takes 1-2 mins away from my 50 minutes!) and in my employers paid subscription so we self run but run into issues with not being able to scale runners enough to meet developers demands.
Its also super annoying that you can't use your own docker containers hosted on ECR on public runners (no way to provide auth)
Seems like SVB was scarified
Insiders are pissed they don’t have billions of stock like other big tech founders.