There are new things being tested and yielding results monthly in modelling. We've deviated quite a bit from the original multi head attention.
Readit Newssakex commented on There are no new ideas in AI, only new datasets blog.jxmo.io/p/there-are-... · Posted by u/bilsbie
Deleted Comment
Deleted Comment
sakex commented on Link Time Optimizations: New Way to Do Compiler Optimizations johnnysswlab.com/link-tim... · Posted by u/signa11
Maybe add the date to the title, because it's hardly new at this point
What about MRI? Just had one. Sorry if it's a stupid question, I don't know much about this
sakex commented on Knowing where your engineer salary comes from seangoedecke.com/where-th... · Posted by u/mooreds
The anomaly here are AI researchers
sakex commented on Users don't care about your tech stack empathetic.dev/users-dont... · Posted by u/merkmoi
> They won’t notice those extra 10 milliseconds you saved
Depends what you're doing. In my case I'm saving microseconds on the step time of an LLM used by hundreds of millions of people.
The point you're missing is that people were making the same kind of comments about Amazon and Uber not too long ago
sakex commented on A layoff fundamentally changed how I perceive work mertbulan.com/2025/01/26/... · Posted by u/mertbio
I was laid off from Google in January last year alongside 150 people in my extended team. I managed to find a different team in Gemini, so now I'm part of Deepmind. I have very conflicting feelings because on one hand I really enjoy the work, the team, and the absolute genius of people I get to talk to; but on the other hand, I have some resentment for being so inhumanely laid off, I am sad for the people in my team who were not as lucky as me, and I know it can happen again any time.
sakex commented on Startup Winter: Hacker News Lost Its Faith vincentschmalbach.com/sta... · Posted by u/vincent_s
Obvious addition:
5. 1 != 6
I have doubts about #2. Weren't Big Tech companies paying senior engineers $300K+ - in 2025-adjusted dollars - back in 2013?
If you know any history, #4 is how many new areas of technology go. A couple ordinary guys built the first working airplane in their bicycle shop. Intel was founded with less than $1M, and fabbed its own chips. Vs. what would be the ante, today, to get into either of those industries?
> I have some doubt about #2. Weren't Big Tech companies paying senior engineers $300K+ - in 2025-adjusted dollars - back in 2013?
Yes but big tech got bigger. Google had a 4th of its current workforce for instance, Meta a 10th, etc. It got much easier to get into those companies.