Deleted Comment
When it works right we have unlimited clean energy.
And when it goes wrong you have a 50,000 year nature preserve.
I don’t mean to be critical, but I’ve always faced pushback working on startups/side projects, and I’m wondering how that was for you?
My guess is you will be billed per gig or something but not nearly the cost of shipping your logs to DD
Want pricing to go down then we need to build more dense housing even an hour drive from the city. The days of wanting a big backyard are coming to an end for most home owners.
In django i had it create a backend, set admin user, create requirements.txt and then do a whole frontend in vue as a test. It even can do screen testing and tested what happens if it puts a wrong login in.
I'm really starting to get sick of companies that claim they operate at petabyte at scale and find you need to spend 400k a month to support that scale.
You need to know up front whether you need to be able to dynamically add entries to the filter or if your application can tolerate rebuilding the filter entirely whenever the underlying data changes. In the latter case you have more freedom to choose data structures; many of the modern "better than Bloom" filters are more compact but don't support dynamic updates.
[1] https://en.wikipedia.org/wiki/Cuckoo_filter
[2] https://engineering.fb.com/2021/07/09/core-infra/ribbon-filt...