I use it on a 24gb gpu Tesla P40. Very happy with the result.
Out of interest, roughly how many tokens per second do you get on that?
Readit Newshkt commented on 29 years later, Settlers II gets Amiga release gamingretro.co.uk/29-year... · Posted by u/doener
Ah, you clearly haven’t worked with the self hosting teams that I have.
I hope I never again have to explain to someone that you can’t just “restore the code from the weekly database backup” because the code is in the file system they just osmosed.
That's not the fault of a hosting team though.. that's the fault of a hiring manager, ultimately
hkt commented on Token growth indicates future AI spend per dev blog.kilocode.ai/p/future... · Posted by u/twapi
Hetzner and Scaleway already do instances with GPUs so this kinda already exists
In fact, does anybody want to hire a server with me? I suspect it'll work out cheaper than Claude max etc: a server from hetzner starts at £220ish: https://www.hetzner.com/dedicated-rootserver/matrix-gpu/
It might be fun to work out how to share, too. A whole new breed of shell hosting.
hkt commented on Token growth indicates future AI spend per dev blog.kilocode.ai/p/future... · Posted by u/twapi
hkt commented on Ch.at – A lightweight LLM chat service accessible through HTTP, SSH, DNS and API ch.at/... · Posted by u/ownlife
hkt commented on Tor: How a military project became a lifeline for privacy thereader.mitpress.mit.ed... · Posted by u/anarbadalov
Tho trying to solve a social issue with technological solutions is just going to force the other side's hand more. Tor/vpn might work today, but there's no telling what new laws tomorrow will be enacted to ban vpns. And having such laws (that everyone breaks) is just a way for the gov't to selectively punish those they deem troublesome - a great chilling effect.
The way to fight these draconian laws is via democratic means - even if it takes long and arduous. For example, enshrining privacy into constitutional guarantees etc.
It depends on the motivations of the people behind the ban, though. VPNs aren't terribly interesting to the government over a porn age verification plan, largely because subscribing to a VPN costs money and requires a debit card. Some might manage that, but most probably won't. If the motivation was to ban porn entirely and they valued that more than they valued giving business a break (banning VPNs being rather bad news for some companies) then it'd be another story.
https://www.statista.com/statistics/717004/general-elections...
It is hard to call minority rule democratic, really. I've no issue with your point on the OSA and think it is widely supported, but let's be realistic, representation in the UK is virtual on matters like this: widely supported, but mostly by coincidence.