Original is here (linked in the article):
https://epoch.ai/gradient-updates/can-ai-companies-become-pr...
Thanks, could the link for this post be replaced with the original?
Readit NewsIs scrolling broken or somehow messed with on that page?
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
So I can note this down on our roadmap, what's the root of your requirement here? Supporting local dev without internet (airplanes, coffee shops, etc.)? Unit test speed? Something else?
I listed some reasons in another comment: https://news.ycombinator.com/item?id=46757853
I appreciate your responsiveness and open mind
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
> although we get the very occasional complaint about wanting a dev environment that works offline
It's only occasional because the people who care about dev environments that work offline are most likely to just skip you and move on.
For actual developer experience, as well as a number of use cases like customers with security and privacy concerns, being able to host locally is essential.
Fair enough if you don't care about those segments of the market, but don't confuse a small number of people asking about it with a small number of people wanting it.
Can confirm. With a setup that works offline, one can
- start small on a laptop. Going through procurement at companies is a pain
- test things in CI reliably. Outages don’t break builds
- transition from laptop scale to web scale easily with the same API with just a different backend
Otherwise it’s really hard to justify not using S3 vectors here
The current dev experience is to start with faiss for PoCs, move to pgvector and then something heavy duty like one of the Lucene wrappers.
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
Qdrant is one of the few vendors I actively steer people away from. Look at the GitHub issues, look at what their CEO says, look at their fake “advancements” that they pay for publicity on…
The number of people I know who’ve had unrecoverable shard failures on Qdrant is too high to take it seriously.
I’m curious about this. Could you please point to some things the CEO has said, or reports of shard failures?
The bit about paying for publicity doesn’t bother me.
Edit: I haven’t found anything egregious that the CEO has said, or anything really sketchy. The shard failure warnings look serious, but the issues look closed
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
For local dev + testing, we recommend just hitting the production turbopuffer service directly, but with a separate test org/API key: https://turbopuffer.com/docs/testing
Works well for the vast majority of our customers (although we get the very occasional complaint about wanting a dev environment that works offline). The dataset sizes for local dev are usually so small that the cost rounds to free.
I should have clarified, by local dev and testing I did in fact mean offline usage.
Without that it’s unfortunately a non starter
sa-code commented on ANN v3: 200ms p99 query latency over 100B vectors turbopuffer.com/blog/ann-... · Posted by u/_peregrine_
This is legitimately pretty impressive. I think the rule of thumb is now, go with postgres(pgvector) for vector search until it breaks, then go with turbopuffer.
Qdrant is also a good default choice, since it can work in-memory for development, with a hard drive for small deployments and also for "web scale" workloads.
As a principal eng, side-stepping a migration and having a good local dev experience is too good of a deal to pass up.
That being said, turbopuffer looks interesting. I will check it out. Hopefully their local dev experience is good
sa-code commented on Microsoft Office renamed to “Microsoft 365 Copilot app” office.com... · Posted by u/LeoPanthera
@rayiner Do you understand that justifying his 5 month detention without due process means you are justifying your own 5 month detention without due process?