Readit News logoReadit News
knowaveragejoe commented on How I code with AI on a budget/free   wuu73.org/blog/aiguide1.h... · Posted by u/indigodaddy
dist-epoch · 21 days ago
Thanks for the article. I'm also doing a similar thing, here are my tips:

- https://chutes.ai - 200 requests per day if you deposit (one-time) $5 for top open weights models - GLM, Qwen, ...

- https://github.com/marketplace/models/ - around 10 requests per day to o3, ... if you have the $10 GitHub Copilot subsciption

- https://ferdium.org - I open all the LLM webapps here as separate "apps", my one place to go to talk with LLMs, without mixing it with regular browsing

- https://www.cherry-ai.com - chat API frontend, you can use it instead of the default webpages for services which give you free API access - Google, OpenRouter, Chutes, Github Models, Pollinations, ...

I really recommend trying a chat API frontend, it really simplifies talking with multiple models from various providers in a unified way and managing those conversations, exporting to markdown, ...

knowaveragejoe · 20 days ago
With chutes.ai, where do you see a one-time $5 for 200 requests/day?
knowaveragejoe commented on Food, housing, & health care costs are a source of major stress for many people   apnorc.org/projects/food-... · Posted by u/speckx
chvid · 23 days ago
It does not.
knowaveragejoe · 23 days ago
It's unintuitive how, but it probably would cause prices to go haywire.
knowaveragejoe commented on How AI conquered the US economy: A visual FAQ   derekthompson.org/p/how-a... · Posted by u/rbanffy
knowaveragejoe · 23 days ago
> METR also conducted an in-depth study that asked experienced developers to code with a popular AI assistant. After they finished their tasks, the developers claimed that using the AI had made them 20 percent more productive. But independent evaluators in the study actually concluded that using AI did the opposite: it increased task completion time by about 20 percent.

This somewhat reflects my experience... I can totally see the back-and-forth dance taking longer in some cases.

But I also think there is more than efficiency being unlocked here. Sure, a developer might have cranked out a rough MVP in less time, but with this they're also often continuously updating a README, tests and other infrastructure as they go.

One could argue about whether that's its own footgun - relying on tests that don't really test what they should, and let critical bugs through later.

knowaveragejoe commented on My 2.5 year old laptop can write Space Invaders in JavaScript now (GLM-4.5 Air)   simonwillison.net/2025/Ju... · Posted by u/simonw
pulkitsh1234 · a month ago
Is there any website to see the minimum/recommended hardware required for running local LLMs? Much like 'system requirements' mentioned for games.
knowaveragejoe · a month ago
If you have a HuggingFace account, you can specify the hardware you have and it will show on any given model's page what you can run.
knowaveragejoe commented on Fintech dystopia   fintechdystopia.com/... · Posted by u/LasEspuelas
willprice89 · a month ago
> people are either still too afraid of looking like they don’t understand, still too deferential to Silicon Valley’s supposed technological expertise, or still too busy doing other things, to voice any skepticism about blockchain-based solutions

I'm not afraid of looking like I don't understand - I simply don't understand. I've tried reading a few "yellow papers" for crypto projects and they are so abstract and full of jargon that I never come away knowing more than when I started reading.

If anyone has a good resource for getting into the technical details of crypto please let me know. I would like to gain a full enough understanding that I can finally decide for myself if it's revolutionary or overhyped.

knowaveragejoe · a month ago
To steelman the crypto side: I think the stuff that is most interesting is found _around_ crypto and not necessarily within most cryptocurrency projects.

For example, there have been a lot of novel or interesting projects centered around cryptography, consensus, decentralization, anonyimity. On a sociological level, there are a lot of interesting social/economic experiments unfolding in the DeFi world as we speak.

But I think that is where the truly interesting or valuable contributions to humanity as a whole end, and the vast, vast majority of it otherwise is just speculation or scams. It is hard to find that signal in the noise, but it is there, if you look.

knowaveragejoe commented on Agents built from alloys   xbow.com/blog/alloy-agent... · Posted by u/summarity
knowaveragejoe · a month ago
Small nitpick - the axes on the varying alloy proportions graph say "Sonnet 2.5" and "Gemini 4.0"
knowaveragejoe commented on Bill Atkinson's psychedelic user interface   patternproject.substack.c... · Posted by u/cainxinth
tiahura · 2 months ago
I can’t tell you the number of times I’ve thought that what this country needs is more druggies running around.
knowaveragejoe · 2 months ago
How can you look at this and think "druggies"?
knowaveragejoe commented on Smollm3: Smol, multilingual, long-context reasoner LLM   huggingface.co/blog/smoll... · Posted by u/kashifr
reach-vb · 2 months ago
Hey Simon, VB from Hugging Face here and the person who added the model to MLX and llama.cpp (with Son). The PR hasn't yet landed on llama.cpp, hence it doesn't work OTB on llama.cpp installed via brew (similarly doesn't work with ollama since they need to bump their llama.cpp runtime)

The easiest would be to install llama.cpp from source: https://github.com/ggml-org/llama.cpp

If you want to avoid it, I added SmolLM3 to MLX-LM as well:

You can run it via `mlx_lm.chat --model "mlx-community/SmolLM3-3B-bf16"`

(requires the latest mlx-lm to be installed)

here's the MLX-lm PR if you're interested: https://github.com/ml-explore/mlx-lm/pull/272

similarly, llama.cpp here: https://github.com/ggml-org/llama.cpp/pull/14581

Let me know if you face any issues!

knowaveragejoe · 2 months ago
> similarly doesn't work with ollama since they need to bump their llama.cpp runtime

Just curious, how frequently does that happen?

knowaveragejoe commented on Biomni: A General-Purpose Biomedical AI Agent   github.com/snap-stanford/... · Posted by u/GavCo
tedy1996 · 2 months ago
How is something that cant admit it doesnt know, and hallucinates a good innovation?
knowaveragejoe · 2 months ago
Modern LLMs frequently do state that they "don't know", for what it's worth. Like everything, it highly depends on the question.
knowaveragejoe commented on The $25k car is going extinct?   media.hubspot.com/why-the... · Posted by u/pseudolus
DyslexicAtheist · 2 months ago
build one from scratch (kit car)
knowaveragejoe · 2 months ago
I'd love a kit car that wasn't ridiculously expensive and/or designed to be raced. But I can understand that the kind of people who would invest the time in building a car would be okay with those propositions.

I wonder if there's a market for building something purely utilitarian, like a little hatchback or something, as a kit vehicle - with the express purpose of learning a lot of automotive principles along the way.

u/knowaveragejoe

KarmaCake day2974August 9, 2010View Original