Readit News logoReadit News
hblanks commented on Cap'n Proto 1.0   capnproto.org/news/2023-0... · Posted by u/kentonv
maccam912 · 3 years ago
If any cloudflare employees end up here who helped decide on Capn Proto over other stuff (e.g. protobuf), what considerations went into that choice? I'm curious if the reasons will be things important to me, or things that you don't need to worry about unless you deal with huge scale.
hblanks · 3 years ago
To summarize something from a little over a year after I joined there: Cloudflare was building out a way to ship logs from its edge to a central point for customer analytics and serving logs to enterprise customers. As I understood it, the primary engineer who built all of that out, Albert Strasheim, benchmarked the most likely serialization options available and found Cap'n Proto to be appreciably faster than protobuf. It had a great C++ implementation (which we could use from nginx, IIRC with some lua involved) and while the Go implementation, which we used on the consuming side, had its warts, folks were able to fix the key parts that needed attention.

Anyway. Cloudflare's always been pretty cost efficient machine wise, so it was a natural choice given the performance needs we had. In my time in the data team there, Cap'n Proto was always pretty easy to work with, and sharing proto definitions from a central schema repo worked pretty well, too. Thanks for your work, Kenton!

hblanks commented on Remembering Benares   yalereview.org/article/pa... · Posted by u/Thevet
miles · 3 years ago
> I love it when Western authors write poverty porn about India.

Pankaj Mishra is not a Western author - he's from India:

https://en.wikipedia.org/wiki/Pankaj_Mishra

http://www.pankajmishra.com/about/

hblanks · 3 years ago
I also think his thesis isn't to celebrate poverty but to consider that development (or modernity, globalization, pick a term) comes with its own problems.

https://en.wikipedia.org/wiki/Age_of_Anger , his book from 2017, isn't perfect but it's a good read of what he's about.

hblanks commented on ØMQ – The Guide (2011)   zguide.zeromq.org... · Posted by u/allending
nurettin · 5 years ago
> we had to rewrite message sending and converted to basic http.

What are the delivery guarantees for basic http?

hblanks · 5 years ago
(Yes to the earlier post - had a similar experience with an early metrics system for Twilio in 2012-2013)

The 1st issue is that ZMQ implementations generally have an IO thread handling all socket IO. REQ/REP patterns tend to work out just fine, because the client is going to wait for a reply from the server. But things like PUSH/PULL become...harder to follow. You can push things in the client, but how do you know when they've flushed out of the IO thread and made it to the server? Those sorts of things matter when shutting down a process, running integration tests, etc. In contrast, with an HTTP request, you're basically always doing REQ/REP, and so you know when the data has been pushed.

The 2nd issue is that ZMQ implementations tend to be harder to observe / operate than a more common path like HTTP requests. (HTTP requests can go through a load balancer, have standard response codes, use headers for authorization, etc.) For these reasons, I've tended to avoid ZMQ ever after -- it seems like often, you're best off either using REST or GRPC if by HTTP, or raw TCP if it's purely a data push kind of operation (e.g. forwarding structured logs, with framing, to a remote TLS endpoint).

hblanks commented on Why is this idiot running my engineering org?   medium.com/@bellmar/why-i... · Posted by u/mbellotti
hblanks · 6 years ago
Cf. William Deresiewicz's address to the cadets of West Point in 2009 (https://theamericanscholar.org/solitude-and-leadership/).

I think the most surprising insight is his commentary on Heart of Darkness as a novel about bureaucracy -- it's worth a read.

hblanks commented on Ask HN: Invited by Facebook for privacy roundtable. What questions should I ask?    · Posted by u/AdriaanvRossum
hblanks · 7 years ago
You don't have to agree with her politics, but I think Peggy Noonan had the right answer on this one: it's a show and there's no good to be found in taking part.

Just say no and hit send.

> In February 2018 Nicholas Thompson and Fred Vogelstein of Wired wrote a deeply reported piece that mentioned the 2016 meeting. It was called so that the company could “make a show of apologizing for its sins.” A Facebook employee who helped plan it said part of its goal—they are clever at Facebook and knew their mark!—was to get the conservatives fighting with each other. “They made sure to have libertarians who wouldn’t want to regulate the platform and partisans who would.” Another goal was to leave attendees “bored to death” by a technical presentation after Mr. Zuckerberg spoke.

(http://peggynoonan.com/overthrow-the-prince-of-facebook/)

hblanks commented on Build a do-it-yourself home air purifier for about $25   uofmhealth.org/news/sinus... · Posted by u/io_io
endymi0n · 7 years ago
Safety advice: If you decide to try this at home, please keep in mind that mixing chloride based cleaning agents with an acid will release chlorine, which is toxic enough to have been used as a WW1 weapon.
hblanks · 7 years ago
Or similarly toxic chloramine gas, when combined with cleaning agents containing ammonia, such as Mr. Clean.
hblanks commented on Causal Models   plato.stanford.edu/entrie... · Posted by u/zerealshadowban
usgroup · 8 years ago
Anyone read Judea Pearls, Causality book? I’ve started, and Im hoping it’s going to be my next of those rare “oh f??k ... wow ...” moments. It’s a short-ish textbook that needs to be slowly read.

I read a SEM book , with a chapter on casual models ... which made me wonder why the hell I bothered with SEM. Any practitioners care to comment?

hblanks · 8 years ago
I've not spent enough time on Pearl, but Migual Hernan and Jamie Robins have a free textbook on causal inference at https://www.hsph.harvard.edu/miguel-hernan/causal-inference-... ; parts of it were pretty useful for a causal inference assignment I did earlier this year.
hblanks commented on Stick and Rudder: An Explanation of the Art of Flying (1944)   archive.org/details/Stick... · Posted by u/JasonFruit
chopin · 8 years ago
When that happened I saw a photo of his plane with doors open so that you could see the cockpit panel. From the glance it was equipped with everything you could wish for. Afair he was caught by darkness but otherwise reasonable visibility. I had a hard time to understand why he failed this (but I admittedly have only simulator experience).
hblanks · 8 years ago
It'd be hard to understand without feeling it for yourself, but in actual instrument conditions (IMC), it's easy for your sense of balance to mislead you into thinking you're level, when in fact you're turning.

There's some physiology to explain this, but one key point is that once you're in a coordinated turn, even a descending one, your weight is still going straight down the vertical axis of the seat. So, you'll think you're doing fine, and possibly even pull the turn tighter (the graveyard spiral), and fixate on things other than the attitude indicator and your plummeting altitude.

u/hblanks

KarmaCake day94February 11, 2011
About
https://lobste.rs/u/hblanks
View Original