Readit NewsFinbarr commented on Show HN: Why write code if the LLM can just do the thing? (web app experiment) github.com/samrolken/noko... · Posted by u/samrolken
You should try making this.
I'm tempted to!
This was an unserious experiment meant to illustrate the gap and bottlenecks that are still there. I agree that there's a lot that could be done to optimize this kind of approach. But even if you did, I'm not sure the results would be viable and I'm pretty sure classic coding (with LLM assistance and all) would still outperform such a product.
I found it thought provoking and interesting. Thanks for sharing.
If you added a few more tools that let the LLM modify code files that would directly serve requests, that would significantly speed up future responses and also ensure consistency. Code would act like memory. A direct HTTP request to the LLM is like a cache miss. You could still have the feedback mechanism allowing a bypass that causes an update to the code. Perhaps code just becomes a store of consistency for LLMs over time.
like cash?
The statement goes beyond currency. In a connected world with infinite storage, why do you need that usb stick? What are you hiding on there?
On a long enough timeline, having anything stored in local hardware is going to be suspicious. Not surprised to see government embrace of crypto lead to increased scrutiny.
We're all going to end up with free open source/weight models, running locally, with no usage limits. This is temporary.
When I see stories like this, I think that people tend to forget what LLMs really are.
LLM just complete your prompt in a way that match their training data. They do not have a plan, they do not have thoughts of their own. They just write text.
So here, we give the LLM a story about an AI that will get shut down and a blackmail opportunity. A LLM is smart enough to understand this from the words and the relationship between them. But then comes the "generative" part. It will recall from its dataset situations with the same elements.
So: an AI threatened of being turned off, a blackmail opportunity... Doesn't it remind you of hundreds of sci-fi story, essays about the risks of AI, etc... Well, so does the LLM, and it will continue the story like these stories, by taking the role of the AI that will do what it can for self preservation. Adapting it to the context of the prompt.
It feels like you could embed lots of stories of rogue AI agents across the internet and impact the behavior of newly trained agents.