Readit News logoReadit News
jtregunna commented on Disks Lie: Building a WAL that actually survives   blog.canoozie.net/disks-l... · Posted by u/jtregunna
breakingcups · 4 days ago
> Conclusion

> A production-grade WAL isn't just code, it's a contract.

I hate that I'm now suspicious of this formulation.

jtregunna · 4 days ago
In what sense? The phrasing is just a generalization, production-grade anything needs consideration of the needs and goals of the project.
jtregunna commented on Disks Lie: Building a WAL that actually survives   blog.canoozie.net/disks-l... · Posted by u/jtregunna
compressedgas · 4 days ago
I thought an fsync on the containing directories of each of the logs was needed to ensure the that newly created files were durably present in the directories.
jtregunna · 4 days ago
Right, you do need to fsync when creating new files to ensure the directory entry is durable. However, WAL files are typically created once and then appended to for their lifetime, so the directory fsync is only needed at file creation time, not during normal operations.
jtregunna commented on Async I/O on Linux in databases   blog.canoozie.net/async-i... · Posted by u/jtregunna
jtregunna · 5 months ago
Update:

I updated the post based on the conversation below, I wholly missed an important callout about performance, and wasn't super clear that you do need to wait for the completion record to be written before responding to the client. That was implicitly mentioned by writing the completion record coming before responding, but I made it clearer to avoid confusion.

Also the dual WAL approach is worse for latency, unless you can amortize the double write over multiple async writes, so the cost paid amortizes across the batch, but when batch size is closer to 1, the cost is higher.

jtregunna commented on Async I/O on Linux in databases   blog.canoozie.net/async-i... · Posted by u/jtregunna
jtregunna · 5 months ago
Post talks about how to use io_uring, in the context of building a "database" (a demonstration key-value cache with a write-ahead log), to maintain durability.
jtregunna commented on US Lawmakers Urge Canada to Snub China's Huawei in Telecoms   reuters.com/article/us-us... · Posted by u/nopacience
claydavisss · 7 years ago
> Canada's best interests are different than those of the US.

Not really. Canada's economy can be described as trade with the US and some other stuff.

jtregunna · 7 years ago
Actually, this is exactly why Canada should be looking for other markets. The US has clearly indicated to us that we can no longer rely on them for trade. It's long overdue, but now is the time we need to act in reducing our dependence on the US, since clearly one dumbass can impact our economy in ways that one dumbass shouldn't be able to.
jtregunna commented on US Lawmakers Urge Canada to Snub China's Huawei in Telecoms   reuters.com/article/us-us... · Posted by u/nopacience
JumpCrisscross · 7 years ago
> Virtually the same trappings and illusions of controls exist in China as well

Secret courts are a shame. Secret directives, on the other hand, can be compatible with the rule of law and an independent judiciary, provided they're lawfully authorized and can be challenged in a court.

At the end of the day, a private citizen (or foreign government) can challenge the U.S. government on equal grounds in a fair court. That is not the case in China.

jtregunna · 7 years ago
> Secret courts are a shame. Secret directives, on the other hand, can be compatible with the rule of law and an independent judiciary, provided they're lawfully authorized and can be challenged in a court.

I presume you also forgot to add this before challenged in a court...

> ..., whistleblowers are protected, and can be ...

You see, because that's the thing with secret directives, they're redacted from the public eye. The only way we get visibility into them isn't with FOIA requests, it's with whistleblowers who feel the government is doing things wrong, and if they're not protected, they rarely come forward.

jtregunna commented on US Lawmakers Urge Canada to Snub China's Huawei in Telecoms   reuters.com/article/us-us... · Posted by u/nopacience
solotronics · 7 years ago
who's goals are more aligned with yours? neighbors to the south who you share a lot in common with or a totalitarian government on the other side of the planet.
jtregunna · 7 years ago
Textbook nonsequiter, well done.

u/jtregunna

KarmaCake day177January 1, 2011View Original