"Alan: Sure, yep, so one of the things that we felt like on MI350 in this timeframe, that it's going into the market and the current state of AI... we felt like that FP6 is a format that has potential to not only be used for inferencing, but potentially for training. And so we wanted to make sure that the capabilities for FP6 were class-leading relative to... what others maybe would have been implementing, or have implemented. And so, as you know, it's a long lead time to design hardware, so we were thinking about this years ago and wanted to make sure that MI350 had leadership in FP6 performance. So we made a decision to implement the FP6 data path at the same throughput as the FP4 data path. Of course, we had to take on a little bit more hardware in order to do that. FP6 has a few more bits, obviously, that's why it's called FP6. But we were able to do that within the area of constraints that we had in the matrix engine, and do that in a very power- and area-efficient way.I will doubt that they will be able to reach %60-70 of the FLOPs in majority of the workloads (unless they hand craft and tune a specific GEMM kernel for their benchmark shape). But would be happy to be proven wrong, and go buy a bunch of them
Help us scale generative‑media infra: hack demos in the AM, pitch partners over coffee.
You’ll build quick client libs & microsites, run data A/Bs, write content that drives sign‑ups, and hand‑hold new devs.
Need: Python, JS/React/Next.js, SQL; speed, ownership, love for gen‑AI. Get: strong salary + equity, platinum health, unlimited “build‑something” stipend and most importantly a seat at a rocketship.
Shoot a link to something you’ve built to careers@fal.ai
Is OP the blog’s author? Because in the post the author said that the purpose of the project is to show why NN are truly special and I wanted a more articulate view of why he/she thinks that? Good work anyway!
The author of the press release is under the mistaken belief that unchanged broadband pricing is a good thing.
From the linked price page:
1gig: $70/mo
2gig: $100/mo
5gig: $125/mo
8 gig: $150/mo
There was a time I would have been insanely jealous of any fiber option at all here in the Bay Area, and I know how hard it is to find fiber anywhere in the US, even still here in many parts of the Bay.
But when the fiber actually arrives, it becomes clear how cheap it is to provide.
When AT&T finally rolled fiber to my house in ~2019 it was $80/mo for 1gig symmetrical.
And you know AT&T's shareholders are still making money hand over fist at that price, because today, I pay Sonic $50 per month for 10gig symmetrical.