Simple queries. As in typing the name of a person in a company list of 200. Keeps spinning forever.
Thanks for taking it for a spin! I'm working on why this is slow now.
Discussion from then https://news.ycombinator.com/item?id=36257523
And I'd be remiss if I didn't point out that their trade dress is MIT licensed. https://stackoverflow.design
Have fun.
(Don't have much to say, just didn't want "typo" to be my only feedback)
Typo?
Presumably they have a script that does something similar to that process, and then writes the resulting data into a predefined table structure.
Yep, my process is similar. It goes...
- decompress (users|posts)
- split into batches of 10,000
- xsltproc the batch into sql statements
- pipe the batches of statements into sqlite in parallel using flocks for coordination
On my M1 Max it takes about 40 minutes for the whole network. Then I compress each database with brotli which takes about 5 hours.Do you know if is there a place to host other of sqlite dumps? I mean from other websites? Recently I dumped the whole hackernews api and I got thinking about it.