Readit News logoReadit News
DrAwdeOccarim commented on Can I run AI locally?   canirun.ai/... · Posted by u/ricardbejarano
azmenak · a day ago
From my personal testing, running various agentic tasks with a bunch of tool calls on an M4 Max 128GB, I've found that running quantized versions of larger models to produce the best results which this site completely ignores.

Currently, Nemotron 3 Super using Unsloth's UD Q4_K_XL quant is running nearly everything I do locally (replacing Qwen3.5 122b)

DrAwdeOccarim · 13 hours ago
Totally doing this today! Have you tried OpenJarvis or NemoClaw (is it out yet?). I want to use my computer “through” the LLM.
DrAwdeOccarim commented on Personal Computer by Perplexity   perplexity.ai/personal-co... · Posted by u/josephwegner
DrAwdeOccarim · 3 days ago
I want this, but using Nemotron Super 3 running local (128gb M5 Max macbook pro) that I use the computer “through”. Does Goose AI aspire/do this? I just started working on this yesterday.
DrAwdeOccarim commented on Ask HN: Local models to support home network infrastructure?    · Posted by u/DrAwdeOccarim
actionfromafar · 2 months ago
There was something on HN recently about how to "trick" the open ones to help.
DrAwdeOccarim · 2 months ago
OK, I'll look around. Thanks!
DrAwdeOccarim commented on Floppy disks turn out to be the greatest TV remote for kids   blog.smartere.dk/2026/01/... · Posted by u/mchro
DrAwdeOccarim · 2 months ago
I love this! I really wanted to go down this road when my kids were younger, but the paucity of floppys and the low storage space made me go down the Avery business card print outs with RFID stickers on the back and a raspberry pi with an RFID reader inside. Of course, the author is using the floppys as hooks instead of as storage media...what a great idea. The tactile response and the art you can stick to them makes them ideal for this purpose.
DrAwdeOccarim commented on A guide to local coding models   aiforswes.com/p/you-dont-... · Posted by u/mpweiher
jwr · 3 months ago
I am still hoping, but for the moment… I have been trying every 30-80B model that came out in the last several months, with crush and opencode, and it's just useless. They do produce some output, but it's nowhere near the level that claude code gets me out of the box. It's not even the same league.

With LLMs, I feel like price isn't the main factor: my time is valuable, and a tool that doesn't improve the way I work is just a toy.

That said, I do have hope, as the small models are getting better.

DrAwdeOccarim · 3 months ago
I use Opus 4.5 and GPT 5.2-Codex through VS Code all day long, and the closest I've come is Devstral-Small-2-24B-Instruct-2512 inferring on a DGX Spark hosting with vLLM as an "Open AI Compatible" API endpoint I use to power the Cline VS Code extension.

It works, but it's slow. Much more like set it up and come back in an hour and it's done. I am incredibly impressed by it. There are quantized GGUFs and MLXs of the 123B, which can fit on my M3 36GB Macbook that I haven't tried yet.

But overall, it feels about about 50% too slow, which blows my mind because we are probably 9 months away from a local model that is fast and good enough for my script kiddie work.

DrAwdeOccarim commented on Qwen3-VL can scan two-hour videos and pinpoint nearly every detail   the-decoder.com/qwen3-vl-... · Posted by u/thm
DrAwdeOccarim · 3 months ago
Does anyone know how this actually was done? Like, did they export every frame as a PNG and then run them each one by one through the model? Or did they somehow "load" the video into the model directly (which then internally somehow steps through each frame?)
DrAwdeOccarim commented on Radios, how do they work? (2024)   lcamtuf.substack.com/p/ra... · Posted by u/aqrashik
tiniuclx · 5 months ago
I've been studying for my amateur radio license recently, and this article is a great introduction to the basics.

But really, if you want to get your hands dirty with some practical electronics, and also want to be able to communicate without relying much on nearby infrastructure, amateur radio is a great hobby.

DrAwdeOccarim · 5 months ago
Do yourself a favor and study for both your technician and general at the same time (I’m assuming you live in the US). HF is exponentially more fun than just VHF/UHF.

u/DrAwdeOccarim

KarmaCake day1033June 7, 2017View Original