https://github.com/blue-monads/potatoverse
Platform for running web apps.
Single static binary and SQLite
lua for now (WASM future)
DEMO:
Readit Newsborn-jre commented on Show HN: Potatoverse, home for your vibecoded apps github.com/blue-monads/po... · Posted by u/born-jre
HN is not a marketing platform. You have been over submitting this link recently.
https://news.ycombinator.com/from?site=github.com/blue-monad...
Please review the Guidelines and FAQ at the bottom of most pages.
:( ok
born-jre commented on Speculative Speculative Decoding (SSD) arxiv.org/abs/2603.03251... · Posted by u/E-Reverance
This is interesting stuff. I wonder if these sorts of tricks are already in use at the big labs.
Incidentally, I would recommend trying implementing speculative decoding yourself if you really want to understand LLM inference internals (that, and KV caching of course). I tried it over the Christmas holidays and it was a wonderful learning experience. (And hard work, especially because I forced myself to do it by hand without coding agent assistance.)
i think this matters more for lower batch sizes (local llm and private enterprise deployment where there wont be big user at specific time for big batch size) going from mem Io bottleneck to compute.
Potatoverse is a great name :))
BTW do you remember Sandstorm.io?
Thanks cap'n-py. Yeah, I love Sandstorm. My goal is to be more portable, lighter, and a 'download binary and run' kind of tool. There are also other attempts around what I call the 'packaging with Docker' approach (Coolify, etc.), which are more attempts at packaging existing apps. But my approach—the platform—gives a bunch of stuff you can use to make apps faster, but you have to bend to its idiosyncrasies. In turn, you do not need a beefy home lab to run it (not everyone is a tinkerer). It's more focused, so it will be easier for the end user running it than for the developer.
I kind of resonate with a lot of things in the article. My own personal view is that we should make hosting stuff vastly simpler; that's one of the goals of my project, at least my attempt (self promo)
https://github.com/blue-monads/potato-apps/tree/master/cimpl...
i should finish but have not have time