Readit NewsThere’s literally nothing an llm can write or tell you that you can’t write yourself or find in a manual somewhere.
Also, local llms with an agentic tool can be a lot of fun to quickly prototype things. Quality can be hit or miss.
Hopefully the work trickles down to local models long-term.
That being said, I am using (Chinese) Deepseek r1 because there isn't currently a free LLM on par with it. I am careful with what I share though, a little more so than with any others that are not locally fun.
Have you tried the 7b?
https://github.com/RyanGreenup/cadmus
The original Reddit post is here:
https://reddit.com/r/commandline/comments/hs7g8r/shell_scrip...
I thought about opening it up, but TBH there's loads of these things already, and the real value for me is that I built it myself and it conforms perfectly to what I need. I looked at a few others, but the overhead of grokking someone else's tool was just too much of a hassle for me.
The ergonomics of these things are really close to perfect when you decide yourself what features you want and how they should be implemented.
The thing is though it took me a long time to get to the level where I could put something like this together and I wish I could have had some sort of guidance earlier on.
That's why I've tried to make my implementation modular, so others can take the things that they haven't figured out from mine and implement it in there workflow.
I should get around to documenting it so others can take replicate, imitate or fork it.
This is something that actually concerned me and so I started using a lot of `bash` scripts to emulate behaviour that I like in Notable, that way I could use Notable without the fear of being locked it but I could try and emulate its behavior in a way that more suited my workflow.
I put the script I use [up on my GitHub](https://news.ycombinator.com/item?id=23883270) and I recently [made a Reddit post](https://news.ycombinator.com/item?id=23883270). I thought maybe you guys could find them helpful or offer feedback?
Overall, I'm not entirely sure if Rust would be better or not if panics were non-recoverable.
PS: For completeness, there are flags to control the panic behavior; but you can't rely on them when writing a lib.