Readit News logoReadit News
mrajcok commented on Llama 4 Now Live on Groq   groq.com/llama-4-now-live... · Posted by u/gok
growdark · 8 months ago
Would it be realistic to buy and self-host the hardware to run, for example, the latest Llama 4 models, assuming a budget of less than $500,000?
mrajcok · 8 months ago
Yes - I'm able to run Llama 3.1 405B on 3x A6000 + 3x 4090.

Will have Llama 4 Maverick running in 4bit quantization (typically results in only minor quality degradation) once llama.cpp support is merged.

Total hardware cost well under $50,000.

The 2T Behemoth model is tougher, but enough Blackwell 6000 Pro cards (16) should be able to run it for under $200k.

mrajcok commented on Beeper Mini is back   blog.beeper.com/p/beeper-... · Posted by u/erohead
seanp2k2 · 2 years ago
All Apple needs to do is send a few scary C&D letters from their army of lawyers and this will be done. If they run the infrastructure for imessage, I'm sure there's something in a ToS somewhere that talks about spoofing device IDs and unauthorized use of their services blah blah Apple's sole discretion.

In theory I love it but in reality it'll be dead soon as Apple has too much to gain from the walled garden they've spent decades and billions building and defending.

mrajcok · 2 years ago
I've been on the receiving end of this - as an individual maybe, but as a committed startup not necessarily. Rooting for them!
mrajcok commented on Ask HN: Best Bank for Startups?    · Posted by u/cbisnett
immad · 5 years ago
(I am the CEO of Mercury.com.)

Lots of people switch over from SVB to us. Happy to answer any questions you have.

We go out of our way to be transparent in pricing, have great customers service and "just work". We dont currently do LoCs though.

Also feel free to email me (my username AT mercury.com)

mrajcok · 5 years ago
Mercury has been great! Used SVB at my last company and it's a big improvement.
mrajcok commented on YC, not Lambda School, is unbundling education   medium.com/swlh/y-combina... · Posted by u/asciimike
philwelch · 6 years ago
The problem is that the "party aspect" only works because it's bundled. "I'm going to spend the next four years of my life partying" is not the kind of decision that parents and society are likely to subsidize.
mrajcok · 6 years ago
Agreed. But perhaps it could be bundled with something else, like working remotely as a junior engineer at a startup for min wage < x < SF CS grad comp.
mrajcok commented on How to Read a Legal Opinion: A Guide for New Law Students (2007) [pdf]   papers.ssrn.com/sol3/pape... · Posted by u/walterbell
mlevental · 7 years ago
Can anyone suggest a book a lay person can read to be better educated about how to understand/engage with rigorous law? like save for reading a civ pro, con law, and torts book i don't know what i should do.
mrajcok commented on Massachusetts gives workers new protections against noncompete clauses   arstechnica.com/tech-poli... · Posted by u/Bender
dunpeal · 7 years ago
Exactly. It's a nightmare scenario: you're a well-performing, well-paid (but still underpaid) Amazon employee. You change jobs for much better pay... But then Amazon sues.

Typically, you'll lose your new job, and probably become untouchable by most other employers. You'll be forced to pay a small fortune for lawyers, and spend numerous days in court, with the outcome uncertain, possibly for years, all while you're likely unemployed.

Not a chance most people would like to take.

mrajcok · 7 years ago
This small risk of something very bad sounds like a case where insurance against this could be a win-win. "Pay a % of your increased earnings, and we cover any litigation related to your non-compete." If someone were able to analyze agreements and state laws to develop a good underwriting model there could be potential for an insurance tech startup here.

u/mrajcok

KarmaCake day63February 23, 2014
About
matthewrajcok [ AT ] gmail [ DOT ] com
View Original