Readit News logoReadit News

Deleted Comment

swq115 commented on Show HN: Run 500B+ Parameter LLMs Locally on a Mac Mini   github.com/opengraviton/g... · Posted by u/fatihturker
swq115 · 6 days ago
Interesting approach. The mmap streaming idea is clever, but I'd love to see real-world benchmarks beyond TinyLlama — especially for the 140B claim. Running that on a Mac Mini with 16GB would be the real proof point.

For context, I run a Mac Mini M4 as a homelab server and the memory pressure from even 7B models is noticeable. Curious how this handles sustained inference without thermal throttling.

swq115 commented on Show HN: I replaced Portainer and btop with a single Go binary for my homelab   github.com/Higangssh/home... · Posted by u/swq115
Kenny_007 · 11 days ago
Looks interesting. My homelab slowly turned into a mix of Portainer, btop and a couple of scripts as well. Some stuff runs on a small box at home, but I keep a few services on a tiny VPS cube-host) so they stay reachable if my home internet goes down. Curious how heavy this gets if you monitor several docker hosts.
swq115 · 11 days ago
Pretty lightweight — it SSHes into each box and runs homebutler locally there, so the overhead is basically one SSH connection + a quick read of /proc and the Docker socket per check. No background daemon sitting there polling, it only runs when you ask or when alerts --watch fires.

I run it across 3 machines (Mac Mini, Pi 5, and another box) and haven't noticed any impact. The binary itself is ~15MB and idles at zero CPU since it's not a long-running service.

swq115 commented on Show HN: Gitcredits – movie-style end credits for any Git repo in your terminal   github.com/Higangssh/gitc... · Posted by u/swq115
swq115 · 14 days ago
Added --theme matrix since posting — digital rain with text resolve animation. https://github.com/Higangssh/gitcredits

u/swq115

KarmaCake day12February 28, 2026View Original