Readit News logoReadit News
hectorm · 4 years ago
The specific URL of the incident is the following, but I cannot edit the submission.

https://status.docker.com/pages/incident/533c6539221ae15e3f0...

jtchang · 4 years ago
Ugh there goes all our CI stuff.
zamalek · 4 years ago
I'm busy experimenting with improving our CI stuff. Welp.
toomuchtodo · 4 years ago
Congrats! The perfect time to improve your process to remove Docker Hub as a dependency. Embrace the chaos.
jnwatson · 4 years ago
Seriously, this is the first time in 3 months I decide to work on CI. I could not for the life of me figure out how it broke.

Well now I know.

mlnj · 4 years ago
I guess production fixes will have to wait.
nsonha · 4 years ago
the case for self-hosted registry
hxtk · 4 years ago
At the time that you made your comment, I think it had the potential to be accurate for a lot more people because at that time my understanding is that the outage was ongoing.

With the incident now resolved, I have the benefit of hindsight to say it was down for a total of two hours, which is well within error budget to maintain 99.5% monthly uptime, and since this isn't part of a larger pattern (so far), they're within budget for 99.95% yearly.

I think that for most companies that aren't already heavily invested in a highly available container runtime platform, the cost of this kind of downtime will be less than the cost of self-hosting something better. Especially if they're not in a situation where registry downtime implies an equal amount of customer-facing service downtime.

c0balt · 4 years ago
A registry cache usually suffices too. It can catch normal executions and can reduce the amount of affected services
Spivak · 4 years ago
Not really, you're just trading one kind of downtime for another. You're not gonna get much meaningful improvement unless you implement actual redundancy. Docker makes this a giant PITA because they want you to use docker.io. It should be as easy as adding a second hosted registry or an additional private registry to the Docker search path (and it is that easy on Red Hat builds of Docker) but the official builds don't support it.
nsonha · 4 years ago
I trade multiple points of failure to a single one. If you have redundancy for docker but your CI or cloud provider is down it would be useless too.
killingtime74 · 4 years ago
There are other hosted registries. AWS/GCP/GitHub/Gitlab