Readit News logoReadit News
LaserToy commented on Deployment Confidence in Era of AI Coding   techblog.cloudkitchens.co... · Posted by u/LaserToy
mehdibl · 4 months ago
Before investing in instruments, you should have a solid static analysis, unit tests, integration test and so on. Logging help flagging issues post deployment but you can catch a lot if you test.
LaserToy · 4 months ago
100%, and we have all of those things. Canary acts as the last line of defence, and honestly, when Canary detects and rolls back, it is already an incident that is being auto-mitigated with a limited blast radius.

To reduce the potential blast radius, we are working on a cohort-based canary, which will allow us to validate against a minimal, stable subset of traffic with the desired properties.

LaserToy commented on Tell HN: Azure outage    · Posted by u/tartieret
LaserToy · 5 months ago
Azure portal still insists the issue is jsut with Console.

We had to bypass the Frontdoor

LaserToy commented on Summary of the Amazon DynamoDB Service Disruption in US-East-1 Region   aws.amazon.com/message/10... · Posted by u/meetpateltech
LaserToy · 5 months ago
TLDR: A DNS automation bug removed all the IP addresses for the regional endpoints. The tooling that was supposed to help with recovery depends on the system it needed to recover. That’s a classic “we deleted prod” failure mode at AWS scale.
LaserToy commented on Our Journey to Affordable Logging   techblog.cloudkitchens.co... · Posted by u/LaserToy
LaserToy · 5 months ago
The architecture of our in-house Rust based logging engine
LaserToy commented on Metaflow: Build, Manage and Deploy AI/ML Systems   github.com/Netflix/metafl... · Posted by u/plokker
LaserToy · 8 months ago
Cloudkitchens use them as well: https://techblog.cloudkitchens.com/p/ml-infrastructure-doesn...

They call it a DREAM stack (Daft, Ray Engine or Ray and Poetry, Argo and Metaflow)

LaserToy commented on ML Infrastructure Doesn't Have to Suck   techblog.citystoragesyste... · Posted by u/battwell
LaserToy · a year ago
Same folks presented DREAM stack and some use cases at Ray Summit last year: https://www.youtube.com/watch?v=zaaKT0IyutQ. and https://www.youtube.com/watch?v=McjH0WfdAyI
LaserToy commented on Thinking in Actors – Challenging your software modelling to be simpler   jeremycarterau.substack.c... · Posted by u/jeremycarter
LaserToy · a year ago
I love actors as a concept and I heard some large companies (Expedia) implemented large parts using them.

But I also saw how hard it is to understand a large system that built using actors. It is just hard to comprehend all the communication pathways and what happens in the system.

LaserToy commented on Monorepo – Our Experience   ente.io/blog/monorepo-ret... · Posted by u/vishnumohandas
eddd-ddde · a year ago
At least google and meta are heavy into monorepos, I'm really curious what company is using a _repo per service_. That's insane.
LaserToy · a year ago
Amazon

u/LaserToy

KarmaCake day447August 9, 2018
About
To contact: y<username>@gmail.com
View Original