llm garbage
The llm detector in my brain went off too
Readit Newsedunteman commented on Why Go Can't Try niketpatel.com/essays/why... · Posted by u/nexneo
I see that you did the NAPI bridging yourself - not that there's anything wrong with that but you might be interested in this tiny lib I wrote some time ago https://github.com/cztomsik/napigen
Your repo was actually a major point of reference! Thank you for open sourcing it. Ironically when I first got into zig I built a similar generator for python bridging which your project reminded me of https://github.com/erik-dunteman/zigpy
Ultimate decision for not using a bindings generator was primarily to deeply understand NAPI.
from a utilitarian perspective, can we swap this instead of a e2b or some other provider? since this doesnt require n number of micrvovm kernals and rootfs hanging round?
Exactly, that’d be the intention. For compute-heavy or long running jobs you’d still probably want a dedicated VM like on E2B but for quick stuff, bVisor
so user gets all of the dependencies and apps in userspace to run as well? but each of the command runs in its own more secure shell of some sorts?
Correct, your PATH resolves to your local tools as if it was unprotected bash, but syscalls are filtered/virtualized
Have been testing this in dev and really like the performance so far
Hell yeah, love to hear it! Happy to answer any questions or issues you run into
edunteman commented on After two years of vibecoding, I'm back to writing by hand atmoio.substack.com/p/aft... · Posted by u/mobitar
The part that most resonates with me is the lingering feeling of “oh but it must be my fault for underspecifying” which blocks the outright belief that models are just still sloppy at certain things
Dead Comment
edunteman commented on Show HN: Butter – A Behavior Cache for LLMs butter.dev/... · Posted by u/edunteman
What local models will it work with ? Also what will be the pricing for local llms?
Good question, I imagine you’d need to set up an ngrok endpoint to tunnel to local LLMs.
In those cases perhaps an open source (maybe even local) version would make more sense. For our hosted version we’d need to charge something, given storage requirements to run such a service, but especially for local models that feels wrong. I’ve been considering open source for this reason.