Readit News logoReadit News
mfrye0 commented on Control LLM Spend and Access with any-LLM-gateway   blog.mozilla.ai/control-l... · Posted by u/aittalam
mfrye0 · 3 months ago
I was looking for a version of a proxy that could maximize throughput to each LLM based on its limits. Basically max requests and input/output tokens per second.

I couldn't find something, so I rolled a version together based on redis and job queues. It works decently well, but I'd prefer to use something better if it exists.

Does anyone know of something like this that isn't completely over engineered / abstracted?

mfrye0 commented on Absurd Workflows: Durable Execution with Just Postgres   lucumr.pocoo.org/2025/11/... · Posted by u/ingve
the_mitsuhiko · 3 months ago
> I took a brief look at your docs. What would you say is the main difference of yours vs some of the other options? Just the simplicity of it being a single sql file and a sdk wrapper? Sorry if the docs answer this already - trying to take a quick look between work.

It's really just trying to be as simple as possible. I was motivated by trying to just do the most simple thing I could come up with after I did not really find the other solutions to be something I wanted to build on.

I'm sure they are great, but I want to leave the window open to having people self host what we are building / enable us to deploy a cellular architecture later and thus I want to stick to a manageable number of services until until I can no longer. Postgres is a known quantity in my stack and the only postgres only solution was DBOS which unfortunately did not look ready for prime time yet when I tried it. That said, I noticed that DBOS is making quite some progress so I'm somewhat confident that it will eventually get there.

mfrye0 · 3 months ago
Thanks for this. That makes sense.
mfrye0 commented on Absurd Workflows: Durable Execution with Just Postgres   lucumr.pocoo.org/2025/11/... · Posted by u/ingve
mfrye0 · 3 months ago
I've been keeping an eye on this space for awhile as it matures a bit further. There's been a number of startups that have popped up around this - apart from Temporal and DBOS, Hatchet.run looked interesting.

I've been using BullMQ for awhile with distributed workers across K8 and have hacked together what I need, but a lightweight DAG of some sort on Postgres would be great.

I took a brief look at your docs. What would you say is the main difference of yours vs some of the other options? Just the simplicity of it being a single sql file and a sdk wrapper? Sorry if the docs answer this already - trying to take a quick look between work.

mfrye0 commented on The Case Against PGVector   alex-jacobs.com/posts/the... · Posted by u/tacoooooooo
xfalcox · 3 months ago
Also worth mentioning that we use quantization extensively:

- halfvec (16bit float) for storage - bit (binary vectors) for indexes

Which makes the storage cost and on-going performance good enough that we could enable this in all our hosting.

mfrye0 · 3 months ago
I was going to say the same. We're using binary vectors in prod as well. Makes a huge difference in the indexes. This wasn't mentioned once in the article.
mfrye0 commented on JetKVM – Control any computer remotely   jetkvm.com/... · Posted by u/elashri
jychang · 4 months ago
Login gated
mfrye0 · 4 months ago
Sorry, habit. I've been debating on exposing these publicly, but they're expensive to create. We have a public interactive demo here for now: https://savvyiq.ai/products/entity-hierarchy

Here's the live mermaid editor version for the Ikea example: https://mermaid.live/edit#pako:eNqNkV9PwjAUxb9KcxPfRrO17E_3Y...

mfrye0 commented on JetKVM – Control any computer remotely   jetkvm.com/... · Posted by u/elashri
keyle · 4 months ago
It's fairly easy to know how to poke around these businesses. Look up the people, the business, and the product. It's less fun when it involves linkedin. Every country has a database of business numbers to name and rough documentation. Dns look up can reveal some information. Social media typically finish the rest. These "founders" are often serial founders, with a ton of abandoned projects and a trail on product hunt, and other websites.

In this case, what really gets to me is the basic template website they're using; with image carousel but only one image... and the fact that they appeared to have paid influencers on youtube to shill their product.

It feels rushed, and not in a good way.

mfrye0 · 4 months ago
I noticed the template too. Someone mentioned recently that's actually a good risk signal - scammers often use the same site structure across domains.

On the research, you're absolutely right. It fits that sweet spot where it's just easy / boring / tedious enough to automate with the current generation of LLMs.

mfrye0 commented on Show HN: Corporate Hierarchy API – Map the corporate family tree   savvyiq.ai/products/entit... · Posted by u/mfrye0
promiseofbeans · 4 months ago
How does it handle companies with huge numbers of subsidiaries, like Volkswagen?
mfrye0 · 4 months ago
Hey, good question. Yeah, we're aware of many companies that can have thousands of subsidiaries.

We found that going both up the chain and down / sideways in the chain was too much for the agent to handle - they are two distinct operations. The #1 use case was customers trying to understand the ultimate parent, so we decided to focus on that first.

We have something roughly working on subsidiaries, but it's not ready for prime time yet. It would likely be a separate API.

mfrye0 commented on Show HN: Corporate Hierarchy API – Map the corporate family tree   savvyiq.ai/products/entit... · Posted by u/mfrye0
consumer451 · 4 months ago
> Thanks. I've been heads down on this for some time and don't have the huge network to share this with.

Your API, while using your MVP UI as teaching tool, is the #1 topic at my next meeting. The lesson about shipping early is so hard for me to execute, even though I know better. So, great job!

mfrye0 · 4 months ago
Thank you! Yeah, I know it's a fine balance between shipping too early and having a buggy product vs too late. I'm shipping as fast as I can now to keep that tight feedback loop going.
mfrye0 commented on Show HN: Corporate Hierarchy API – Map the corporate family tree   savvyiq.ai/products/entit... · Posted by u/mfrye0
windex · 4 months ago
Hey, this is very useful. I worked in a couple of large consulting firms and this type of entity search was a deal blocker in some cases because the research teams would be busy trying to find the ultimate identity of parent for conflict checks. As a result, sales teams were wasting times engaging customers they didn't need to, contracts were delayed as discovery took too long etc. Reputational/compliance risk is something we used to try to avoid.

Also commenting so I can come back.

mfrye0 · 4 months ago
Interesting. So in that case, who had the biggest pain point? The sales team from being held up, or the research time under pressure to deliver?

We actually haven't explored the big consulting firms yet. I know they are often contracted to do this sort of research for companies.

mfrye0 commented on Show HN: Corporate Hierarchy API – Map the corporate family tree   savvyiq.ai/products/entit... · Posted by u/mfrye0
consumer451 · 4 months ago
Thanks for mentioning this in a more recent comment. This might be very valuable for one of the projects that I am working on. Instant sign-up.

HN posts are such hit and miss. Do not be discouraged, this looks great.

As an example of HN hit and miss, I just posted a link to a reddit post regarding Claude Code, that could collectively save HN users many millions of dollars in the next week, and it has three upvotes at time of writing:

https://news.ycombinator.com/item?id=45723955

mfrye0 · 4 months ago
Thanks. I've been heads down on this for some time and don't have the huge network to share this with.

Regarding the product, I'm open to any and all feedback for your use case. Trying to follow the adage of "if you are not embarrassed by the first version of your product, you’ve launched too late".

And wow - just read your reddit post. I'm going to look into that for us too.

u/mfrye0

KarmaCake day461July 15, 2016
About
michael [at] savvyiq [dot] ai
View Original