I just buy single player offline games with no IAP, and Steam is amazing. It's a million miles ahead of the competitors, and it's really surprising that EA/Ubi etc.. try to compete but don't get the reason they're losing. They screw customers and then act surprised that customers hate them.
The difficulty for dithering on an interactive 3d scene is in making the dithering stable on camera rotation, otherwise you get a twinkling stars effect, not dissimilar to the "fireflies" in reflections in ray-traced games.
https://www.youtube.com/watch?v=HPqGaIMVuLs (explanation)
- completion based methods, where you take a big model, give it some queries, and use the answers to post-train a smaller model. This is what deepseek did with qwen models, where they took ~800k traces made by R1 and used sft on smaller qwen2.5 models. What the sky team found in their experiments is that you can use as few as 1-2k traces to reach similar results. Much cheaper.
- logit/internal representations based methods, where you need access to the raw model, and for each pair q -> response you train the small model on the entire distribution of the logits at the same time. This is a method suited for model creators, where they can take a pair of big + small model of the same architecture, and "distill" it in the smaller one. This is likely how they train their -flash -mini -pico and so on.
The first method can be used via API access. The second one can't. You need access to things that API providers won't give you.
"Considering that the distillation requires access to the innards of the teacher model, it’s not possible for a third party to sneakily distill data from a closed-source model like OpenAI’s o1, as DeepSeek was thought to have done. That said, a student model could still learn quite a bit from a teacher model just through prompting the teacher with certain questions and using the answers to train its own models — an almost Socratic approach to distillation."
Which means the job offer still includes stock options, but during the job offer call we don’t talk up the future value of the stock options. We don’t create any expectation that the options will be worth anything.
Upside from a founder perspective is we end up giving away less equity than we otherwise might. Downside from a founder perspective is you need up increase cash compensation to close the gap in some cases, where you might otherwise talk up the value of options.
Main upside for the employee is they don’t need to worry too much about stock options intricacies because they don’t view them as a primary aspect of their compensation.
In my experience, almost everyone prefers cash over startup stock options. And from an employee perspective, it’s almost always the right decision to place very little value ($0) on the stock option component of your offer. The vast majority of cases stock options end up worthless.
Also, even if the company ends up worth a lot of money, there's no guarantee that a way to liquidate, such as an IPO, exit or secondary market, will become available in any reasonable time frame. And as a regular employee you have exceedingly little to say in bringing about such events. There's not much fun in having a winning lottery ticket that can't be cashed in, in fact it's highly stressful.
Off the top of my head, obesity seems like the obvious culprit to investigate. If so, I wonder if semaglutide will close this gap again?