Readit News logoReadit News
_diq5 commented on Groq runs Mixtral 8x7B-32k with 500 T/s   groq.com/... · Posted by u/tin7in
NorwegianDude · 2 years ago
Technically, I guess you can use speculative execution to speed it up, and in that way take a guess at what the 100th token will be and start on the 101st token at the same time? Though it probably has it's own unforeseen challenges.

Everything is predictable with enough guesses.

_diq5 · 2 years ago
People are pretty cagey about what they use in production, but yes, speculative sampling can offer massive speedups in inference
_diq5 commented on Groq runs Mixtral 8x7B-32k with 500 T/s   groq.com/... · Posted by u/tin7in
ionwake · 2 years ago
Sorry if this is dumb but how is this different to Elons Grok? Was Groq chosen as a joke or homage ?
_diq5 · 2 years ago
This company is older than Elon's
_diq5 commented on I accidentally saved my company half a million dollars   ludic.mataroa.blog/blog/i... · Posted by u/softskunk
throwawaaarrgh · 2 years ago
At the wrong gig, with the wrong bosses. I have the misfortune of being at one of those bad places now. I was at a much better place before, where if I went out of my way and saved a couple million, I'd actually be congratulated; boss would even let have the credit.

Never stay at a job where the culture is toxic. Even if the money is better. Nothing eats at the soul like being held down by feckless, petty careerists and control freaks.

_diq5 · 2 years ago
I've been trying to leave my current gig for the last 9+ months. It's tough to find the right roles these days
_diq5 commented on I accidentally saved my company half a million dollars   ludic.mataroa.blog/blog/i... · Posted by u/softskunk
_diq5 · 2 years ago
Tried to save my company 100k per month by cutting down idle compute, clearing out petabytes of unused buckets, and using on-demand compute in testing envs. This resuted in me getting pummelled by directors asking questions, staff engineers saying random what-ifs, until I eventually gave up.

I used to think startups would be one of the few places that actually gave a shit about being lean and efficient - but turns out that's only true if they're bootstrapped.

_diq5 commented on About Google's approach to research publication – Jeff Dean   docs.google.com/document/... · Posted by u/yigitdemirag
throawaydmg · 5 years ago
> Timnit responded with an email requiring that a number of conditions be met in order for her to continue working at Google, including revealing the identities of every person who Megan and I had spoken to and consulted as part of the review of the paper and the exact feedback

It always amazes how blatantly authoritarian these "woke" types are. I would not be surprised if the sole reason she wanted the identities of every consultant was to engage in some sort of witch-hunting and bigoteering[0]

[0] https://www.urbandictionary.com/define.php?term=Bigoteering

_diq5 · 5 years ago
I would caution you by saying that no quote, paraphrase, or evidence of exactly what Timnit said.

Since this is Google's side of the story its in their interest to use words that would imply she's overbearing, or otherwise unaccommodating

(for all I know she could be all of those things, but this narration isn't sufficient evidence to prove that)

_diq5 commented on Appearances vs. Experiences: What Makes Us Happy   fs.blog/2020/07/appearanc... · Posted by u/lxm
hyko · 6 years ago
This article–and the many like it-assume that there is some universal truth that experiences will make you happier than mere things, when this is not true.

I derive a great deal of happiness from nice things. I suspect I’m not alone, and that people like me are the reason that the whole human environment isn’t just a pile of half-arsed crap designed to facilitate only certain types of approved experiences. We notice the qualities of the things around us every single moment of the day, and they can bring us great joy (or the opposite).

Materialism is clearly not in vogue (and I suspect there is a moral dimension to this), but for some people it will make them far happier than trying to chase experiences. I suspect there are many natural materialists out there struggling to conform to the new societal norm that only the ephemeral can lead to psychological salvation, and that all desire for material riches is a sin.

_diq5 · 6 years ago
You seem to imply that people are being persecuted en-mass for seeking material wealth.

While there might be a vocal minority here (and elsewhere) that scoff at material wealth, its pretty clear that society at large still measures status by your possessions.

People still seek out more luxurious cars, more gadgets, new fashions year after year without fail; evidenced by the unstoppable growth in those industries.

Even if people might say that material riches are a 'sin', they certainly are not behaving as such.

_diq5 commented on All of us test in production all the time (2019)   increment.com/testing/i-t... · Posted by u/jrvarela56
ratww · 6 years ago
I'm always happy to help some poor SRE in the middle of the night, and I once even drove to the office in a rainy Sunday, in the middle of my vacation, to access IP-restricted stuff because a support intern messaged me on Instagram.

...but with that said: I'm glad I only worked in countries where work is properly regulated and "on call" means "I'm getting fucking paid every cent for each hour I _must_ answer that goddamn phone". Which in practice means there's no PagerDuty.

The unpaid on-call culture is bullshit. The company can either pay me or go fuck itself.

_diq5 · 6 years ago
I unfortunately work in a place where on-call is unpaid. I'm an SRE stuck in the 90s.

The policy states that only the Operations team gets paid on-call, because I guess in the old days they would be the expected to deal with production.

Fast forward to today, and the Operations folks are a small team managing 2 datacentres, and all on-call rotations between SREs and developers are considered unofficial and therefore not eligible to be paid.

One of our Sr. Managers tried to take this up the chain, but then got reprimanded for putting developers on-call.

_diq5 commented on All of us test in production all the time (2019)   increment.com/testing/i-t... · Posted by u/jrvarela56
danpozmanter · 6 years ago
"Engineers should be on call for their own code." - Would you rather work someplace you are expected to be on call 24/7, or a company that doesn't require that?

It isn't the norm, and it isn't competitive. It's just more "always on" culture in the workplace - and that's not healthy. A company should understand workers need real breaks - and being on call is not a real break.

_diq5 · 6 years ago
Want to jump in here - I have worked at a company where engineers are not on call for their code, and it was a living nightmare.

_You_ might not be on call for your code, but _somebody_ will be. Often some poor SRE/ops person that has absolutely no idea what the app is doing/or why it's failing in production.

Not being on-call makes engineers complicit. I've seen it all, known memory leaks shipped into production, apps where half the endpoints couldn't even be compiled, code dumping the production redis at 1AM ... and every time the pain just felt on deaf ears.

If your code is what wakes you up in the middle of the night, you have: - Incentive to fix/mitigate as soon as possible. - No blame game to play. Either the error was made by you, or someone on your team. It doesn't have to go up 3 rungs on the ladder then back down again.

I don't think the author was suggesting that everyone should always be on call, just that you _must_ be responsible for your own code in production

u/_diq5

KarmaCake day1March 10, 2024View Original