Readit News logoReadit News
sagichmal commented on Log by time, not by count   johnscolaro.xyz/blog/log-... · Posted by u/JohnScolaro
Veserv · 5 months ago
Everything is events. The problem is that, as you notice, you frequently encounter situations where there are too many events to handle. Metrics, logging, and tracing are just three different ways to handle that problem.

Metrics handles too many events by aggregating them. You handle too many events by squashing them into a smaller number of events that aggregate the information.

Logging handles too many events by sampling them. If you have N times as many events as you can handle, take 1 in N of them or whatever other sampling model you want.

Tracing is logging, but where you have chains of correlated events. If you have a request started and a request ended event, it is pretty useless to get one without the other. So, you sample at the "chain of correlated events" level. You want 1 in N "chains of correlated events".

But, if you have enough throughput for all your events, just get yourself a big pile of events and throw it into a visualizer. Or better yet, just enable time travel debugging tracing so you do not need to even need to figure out how the events map to your program state.

sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
native_samples · 4 years ago
Brian disagrees, he opened his discussion of the benefits by saying: "it has allowed us to hire some of the best talent from organizations where employees are fed up with politics, infighting, and distraction".
sagichmal · 4 years ago
This is definitely not true (shrug) Attrition has more than doubled and most engineering teams are critically understaffed.
sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
Zababa · 4 years ago
You're assuming that everyone that think about things systemically end up with the same views. I don't think that's true.
sagichmal · 4 years ago
Most do, though, because there does tend to be a more correct position on this class of stuff.
sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
fleddr · 4 years ago
Saying you're a mission focused company and this being somehow controversial is ridiculous. Every company should be mission focused.

As his post demonstrates, it turns out to not be controversial at all. A handful of people left and after a few weeks the Twitter mob stops. Then you're left with reasonable people to do the job, which is the point of any company.

sagichmal · 4 years ago
> A handful of people left

They lost close to half of their engineering team, significant percentages of their operations teams, and many senior leaders.

sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
staysafeanon · 4 years ago
You're thinking of Basecamp, not Coinbase.
sagichmal · 4 years ago
No, I don't know anyone at Basecamp.
sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
Jensson · 4 years ago
The problem is when people who care about justice harasses co-workers because those co-workers doesn't care as much about justice. That has a very negative effect on those co-workers regardless if this has a negative effect on the harasser.
sagichmal · 4 years ago
I'm not sure why you think people who care about justice harass coworkers as a matter of course. It's strictly the opposite, in my (considerable) experience.

Dead Comment

sagichmal commented on 1 Year of Coinbase as a mission focused company   twitter.com/brian_armstro... · Posted by u/dsr12
slownews45 · 4 years ago
The folks pulling the late nights on projects and delivering great results - normally the issue is to get them to stop talking about work all the time (happy hour?!) - not to get them to start talking about a social justice issue around microaggressions or whatever!
sagichmal · 4 years ago
I’m not sure why you think people who care about justice draw that energy from the same pool that motivates their work, as if it’s a zero-sum calculus. It isn’t. People who think about things systemically tend to apply that perspective in all of their practices. And that’s the value.

Dead Comment

sagichmal commented on My Logging Best Practices (2020)   tuhrig.de/my-logging-best... · Posted by u/isaacfrond
raldi · 4 years ago
How does making these DEBUG logs into INFO logs make the volume manageable?

Or, to flip that around, if you take a program that produces a manageable amount of INFO logs, and change some of those INFOs to DEBUGs, how does that suddenly become unmanageable?

sagichmal · 4 years ago
My point is that DEBUG level logging is (hopefully!) not on by default, and that this is what it makes the production log volume manageable.

My experience has been that 1 customer-facing byte tends to generate something like ~10 DEBUG-level telemetry bytes. This level of request amplification can't be feasibly sustained at nontrivial request volumes, your logging infrastructure would dwarf your production infrastructure.

u/sagichmal

KarmaCake day2816April 16, 2014
About
e1b1ce94085da63902d7c51d8f1e0697
View Original