Readit News logoReadit News
neko_ranger commented on Ask HN: How can ChatGPT serve 700M users when I can't run one GPT-4 locally?    · Posted by u/superasn
airhangerf15 · 24 days ago
An H100 is a $20k USD card and has 80GB of vRAM. Imagine a 2U rack server with $100k of these cards in it. Now imagine an entire rack of these things, plus all the other components (CPUs, RAM, passive cooling or water cooling) and you're talking $1 million per rack, not including the costs to run them or the engineers needed to maintain them. Even the "cheaper"

I don't think people realize the size of these compute units.

When the AI bubble pops is when you're likely to be able to realistically run good local models. I imagine some of these $100k servers going for $3k on eBay in 10 years, and a lot of electricians being asked to install new 240v connectors in makeshift server rooms or garages.

neko_ranger · 24 days ago
Four H100 in a 2U rack didn't sound impressive, but that is accurate:

>A typical 1U or 2U server can accommodate 2-4 H100 PCIe GPUs, depending on the chassis design.

>In a 42U rack with 20x 2U servers (allowing space for switches and PDU), you could fit approximately 40-80 H100 PCIe GPUs.

neko_ranger commented on The internet wants to check your ID   newyorker.com/culture/inf... · Posted by u/jbegley
neko_ranger · a month ago
Lots of discussion on this and not much comparison to another democratic country (South Korea) that already implement this type of control. Account creation for non-critical services (games, etc) requires a SSN type equivalent during signup, so they very clearly know who is associated with the account.

They also implement child specific locks, such as limiting the duration kids can play a game, and for only specific hours (not during night time).

neko_ranger commented on The 'Contrarian Friend' Is Real, and They're Driving Everyone Crazy   self.com/story/contrarian... · Posted by u/tbrake
neko_ranger · a month ago
My contrarian friend is my mother. Doesn't matter what I do, I should have done it the other way. Don't eat so much, eat more; work harder, relax guy!
neko_ranger commented on Google has dropped more than 50 DEI-related orgs from one of its funding lists   cnbc.com/2025/08/01/googl... · Posted by u/gslin
neko_ranger · a month ago
The new South Park episode offers further insights into this very topic
neko_ranger commented on Fast (2019)   patrickcollison.com/fast... · Posted by u/samuel246
davidw · a month ago
Part of the reason we have 'not fast' is that along with some good things, we also did some bad things 'fast', like lots of paving over disproportionately minority parts of cities for freeways.

It'd be interesting to try and quantify both columns - the good and the bad.

Ideally, we would go back to being able to do some things 'fast' and hopefully do a bit better at avoiding the bad things.

neko_ranger · a month ago
It would be interested to see a list of American tofu dregs projects. We only see what is still standing.

The difference now I guess is that we eventually learned and (mostly) everything is built without issue, sometimes at the tradeoff of time. But some countries are going through their own growing pains right now (with the tradeoff of money/people/shortcuts)

Dead Comment

neko_ranger commented on Happy 20th Birthday, Django   djangoproject.com/weblog/... · Posted by u/davepeck
hedgehog0 · 2 months ago
Out of curiosity, for people who have do projects in both Django and Ruby on Rails, which one would you prefer and why?

I learned Python more than 10 years ago, but later chose Rails to be my first web framework to learn, as I also wanted to learn more about Ruby, hence the question.

neko_ranger · 2 months ago
Depends on the project. I feel like Rails has better JS integration if your project really needs it. The out of the box JS experience with rails (import maps) is similar to django (static link from cdns), but the ability to set up esbuild from project generation makes it really easy Literally just my opinion though, but I haven't been pleased with an extremely nice method to set up django with javascript that doesn't feel hacky for local dev and deployment

u/neko_ranger

KarmaCake day1014May 29, 2017View Original