Readit Newsmauricio commented on Codestral: Mistral's Code Model mistral.ai/news/codestral... · Posted by u/alexmolas
This is an open weights 22B model. The download on Huggingface is 44GB.
Is there a rule-of-thumb estimate for how much RAM this would need to be used locally?
Is the RAM requirement the same for a GPU and "unified" RAM like Apple silicon?
22B params * 2 bytes (FP16) = 44GB just for the weights. Doesn't include KV cache and other things.
When the model gets quantized to say 4bit ints, it'll be 22B params * 0.5 bytes = 11GB for example.
mauricio commented on Zapier: A $5B Unbundling Opportunity georgesequeira.com/writin... · Posted by u/georgesequeira
What do you use Zapier for?
I feel like I live in a cave. Over the past 10+ years, I’ve yet to understand what use cases people use for things like IFTTT/Zapier/etc. I clearly must for alone I’m not understanding.
Can someone please help me understand their specific use case. I’m genuinely curious.
A popular use case for SaaS companies isn't even in utilizing Zapier themselves, but rather adding their API to the list of integrations. This can really speed up onboarding for customers -- especially if they already use Zapier.
mauricio commented on Three Electric-Jaguar Years tbray.org/ongoing/When/20... · Posted by u/CapitalistCartr
> Slow charge infrastructure is much cheaper to build out.
At a highway rest stop, why would a fast charger that can charge 1 car in 6 minutes be any more expensive than a bank of slow chargers that can charge 10 cars in 60 minutes?
In order to charge 10x faster, you need to deliver 10x the current. That means all the wiring and electronics need to be upgraded to handle the huge increase without melting.
Also, the rest stop won't just be installing a single fast charger, it would install more than one. So you can't really compare 10 slow chargers against a single fast one. That means the wiring service for the entire rest stop would likely need to be upgraded as well.
mauricio commented on Ask HN: What is your favourite gaming hardware/device? · Posted by u/recvonline
The Nintendo Switch.
For all the reasons you mention. I have a career, I have a family, and I have side projects. I just don’t have time to dedicate to games. But sometimes you just need to blow off steam for 15 minutes before bed and the Switch is perfect for this.
Every game can be paused/stopped by hitting one button. The controls are great, software is great, and I’ve been using the the dock to play games together with family like Mario Kart. I have a bunch of maxed out characters in Diablo 3 just by playing 15 minutes here and there. :)
If the issue is cost, slightly older Epyc hardware is quite affordable, and colo deals can be found for extremely reasonable costs. If it's expertise, then all they have to do is ask.