Readit News logoReadit News
otoolep commented on 100k TPS over a billion rows: the unreasonable effectiveness of SQLite   andersmurphy.com/2025/12/... · Posted by u/speckx
vhodges · 19 days ago
sqlite is just a library (in C)

A few projects:

  * https://github.com/rqlite/rqlite Distributed, fault tolerant cluster
  * https://litestream.io/ Replication to S3 (or compatible) - more disaster recovery than fail over
  * https://fly.io/docs/litefs/ Same Author as litestream).  Distributed replication.  Requires writes to be redirected to the primary.
I am debating Postgres vs sqlite (probably with litestream) for a project right now.

And other than HW redundancy, I can get pretty far by scaling vertically on a single box. And for my app, I could probably (and my users!) live with some occasional downtime (as long as the data is replicated/backed up).

If I get 20-50K users, it'll be a successful venture so I don't need much these days and it will be cheaper and easier to run as well.

otoolep · 19 days ago
rqlite creator here, happy to answer any questions.
otoolep commented on 100k TPS over a billion rows: the unreasonable effectiveness of SQLite   andersmurphy.com/2025/12/... · Posted by u/speckx
BugsJustFindMe · 19 days ago
Dqlite and Rqlite are primarily for buildling fault-tolerant clusters. But if you just take the network access part, then ok sure, but also so what?
otoolep · 19 days ago
rqlite[1] creator here.

Nit: dqlite is a library, it is not a network-exposed database like rqlite is. Sure, it requires connecting to other nodes over the network, but local access is via in-process. In contrast one connects with rqlite over the network - HTTP specifically.

[1] https://rqlite.io

otoolep commented on Making web testing pleasant in Scheme: Schematra 0.4   schematra.com/blog/whats-... · Posted by u/funkaster
otoolep · 2 months ago
rqlite[1] creator here. Thanks for the shout-out in your blog post.

https://rqlite.io

otoolep commented on Corrosion   fly.io/blog/corrosion/... · Posted by u/cgb_
nodesocket · 2 months ago
Anybody used rqlite[1] in production? I'm exploring how to make my application fault-tolerant using multiple app vm instances. The problem of course is the SQLite database on disk. Using a network file system like NFS is a no-go with SQLite (this includes Amazon Elastic File System (EFS)).

I was thinking I'll just have to bite the bullet and migrate to PostgreSQL, but perhaps rqlite can work.

[1] https://rqlite.io

otoolep · 2 months ago
rqlite creator here. Right there on the rqlite homepage[1] are listed two production users: replicated.com[2] and textgroove.com are both using it.

[1] https://rqlite.io/

[2] https://www.replicated.com/blog/app-manager-with-rqlite

otoolep commented on Why Is SQLite Coded In C   sqlite.org/whyc.html... · Posted by u/plainOldText
glandium · 2 months ago
And, in fact, these implementations exist. At least in Rust, there's rqlite and turso.
otoolep · 2 months ago
rqlite[1] author here. Just to be clear, rqlite is not SQLite but rewritten in Go. rqlite uses the vanilla C code, and calls it from Go[2]. I consider that an important advantage over other approaches -- rqlite gets all the benefits of rock-solid[3] SQLite. As result there are no questions about the quality of the database engine.

[1] https://rqlite.io

[2] https://rqlite.io/docs/design/

[3] https://www.sqlite.org/testing.html

u/otoolep

KarmaCake day4855April 3, 2014
About
Software Engineer based in Pittsburgh, PA. Engineering Manager at Google, building large-scale data systems. Creator of rqlite[1], the lightweight, distributed database built on SQLite.

https://www.philipotoole.com

[1] https://www.rqlite.io

View Original