nick0garvey (u/nick0garvey)

nick0garvey commented on How exchanges turn order books into distributed logs quant.engineering/exchang... · Posted by u/rundef

nick0garvey · 10 days ago

> Pipelined replication: the sequencer assigns a sequence number immediately and ships the event to replicas in parallel. Matching doesn't wait for the replicas to acknowledge.

How is this avoiding data loss if the lead sequencer goes down after acking but without the replica receiving the write?

nick0garvey commented on Where's Firefox going next? connect.mozilla.org/t5/di... · Posted by u/ReadCarlBarks

JumpCrisscross · 5 months ago

Are Mozilla’s donations still roughly equal to their CEO’s compensation [1][2]?

[1] https://www.mozilla.org/en-US/foundation/annualreport/2024/a... ”$7.8M in donations from the public, grants from foundations, and government funding” in 2023

[2] https://assets.mozilla.net/annualreport/2022/mozilla-fdn-990... $6.9mm in 2022, page 7

nick0garvey · 5 months ago

It says "PAID ONLY BY A RELATED FOR-PROFIT", which looks to be the Mozilla Corporation. Donations are not directly paying the CEO, although I agree more of the profits from the Corporation could flow into the non-profit.

nick0garvey commented on Ask HN: What's your go-to message queue in 2025? · Posted by u/enether

Spivak · 7 months ago

I've never found a satisfying way to not hold the lock for the full duration of the task that is resilient to workers potentially dying. And postgres isn't happy holding a bunch of locks like that. You end up having to register and track workers with health checks and a cleanup job to prune old workers so you can give jobs exclusivity for a time.

nick0garvey · 7 months ago

Hold the lock and write a row with timestamp at the time you read.

That row indicates you are the one processing the data and no one else should. When reading, abort the read if someone else wrote that row first.

When you are finished processing, hold the lock and update the row you added before to indicate processing is complete.

The timestamp can be used to timeout the request.

nick0garvey commented on Why is it so hard to buy things that work well? (2022) danluu.com/nothing-works/... · Posted by u/janandonly

georgewfraser · a year ago

I have some insight into this because this claim is about my company Fivetran:

“…relies on the data source being able to seek backwards on its changelog. But Postgres throws changelogs away once they're consumed, so the Postgres data source can't support this operation”

Dan’s understanding is incorrect, Postgres logical replication allows each consumer to maintain a bookmark in the WAL, and it will retain the WAL until you acknowledge receipt of a portion and advance the bookmark. Evidently, he tried our product briefly, had an issue or thought he had an issue, investigated the issue briefly and came to the conclusion that he understood the technology better than people who have spent years working on it.

Don’t get me wrong, it is absolutely possible for the experts to be wrong and one smart guy to be right. But at least part of what’s going on in this post is an arrogant guy who thinks he knows better than everyone, coming to snap conclusions that other people’s work is broken.

nick0garvey · a year ago

I'm not quite following. His argument appears to be: The replication system requires a backwards seek, Postgres does not support that operation, things break when that operation is attempted.

I don't understand why replication would need a backwards seek - are you saying it doesn't and he is mistaken on that?

nick0garvey commented on The Languages of English, Math, and Programming github.com/norvig/pytudes... · Posted by u/stereoabuse

nick0garvey · a year ago

I took a Udacity class by Norvig [1] and my abilities as a programmer clearly were improved afterward.

His code here demonstrates why. It is both shorter and much easier to understand than anything the LLMs generated. It is not always as efficient as the LLMs (who often skip the third loop by calculating the last factor), but it is definitely the code I would prefer to work with in most situations.

[1] https://www.udacity.com/course/design-of-computer-programs--...

nick0garvey commented on Amusing Ourselves to Death (2009) web.archive.org/web/20100... · Posted by u/rzk

badpun · a year ago

There was some chess prodigy who, in his teens, was already winning against most champions, and who in his early twenties abandoned chess altogether, citing it a "waste of life".

nick0garvey · a year ago

Morphy, one of the greatest players of all time, is famous for this.

"The ability to play chess is the sign of a gentleman. The ability to play chess well is the sign of a wasted life."

nick0garvey commented on Show HN: Kaskade – A text user interface for Kafka github.com/sauljabin/kask... · Posted by u/sauljp

bink · a year ago

Or just advance the offsets for that partition beyond the problematic data, or adjust retention, or both.

nick0garvey · a year ago

There is also the deleteRecords API specifically for this. It's easier than the retention shrink -> increase dance, as it is a single API call and retention does not kick in immediately. The log segment must roll for retention to apply, either due to size or time.

https://kafka.apache.org/11/javadoc/org/apache/kafka/clients...

nick0garvey commented on Special-use domain 'home.arpa.' (2018) datatracker.ietf.org/doc/... · Posted by u/mcp_

nick0garvey · 2 years ago

I use this for everything at my house. I haven't add any issues.

nick0garvey commented on NetworkX – Network Analysis in Python networkx.org/... · Posted by u/comradesmith

jonathaneunice · 2 years ago

Been a few years since I put NetworkX through its paces, but the several times I have tried it, found remarkably weak support for graph layout and display. NetworkX analytic routines may be strong, but attractively displaying graph-structured problems remarkably more interactive and attractive via d3.js, GraphViz, etc. At least for my problems, communicating graph structures, and having nodes and edges that represent different kinds of things…these are basic requirements, not optional frills.

nick0garvey · 2 years ago

I use NetworkX to build the graphs and Gephi to visualize them. No need to pick a single tool.