Wow! The title suggests introductory material, but in my opinion this has strong potential to win test of time awards for research.
Readit Newsmxwsn commented on How does gradient descent work? centralflows.github.io/pa... · Posted by u/jxmorris12
This Sora 2 generation of Cyberpunk 2077 gameplay managed to reproduce it extremely closely, which is baffling: https://x.com/elder_plinius/status/1973124528680345871
> How the FUCK does Sora 2 have such a perfect memory of this Cyberpunk side mission that it knows the map location, biome/terrain, vehicle design, voices, and even the name of the gang you're fighting for, all without being prompted for any of those specifics??
> Sora basically got two details wrong, which is that the Basilisk tank doesn't have wheels (it hovers) and Panam is inside the tank rather than on the turret. I suppose there's a fair amount of video tutorials for this mission scattered around the internet, but still––it's a SIDE mission!
Everyone already assumed that Sora was trained on YouTube, but "generate gameplay of Cyberpunk 2077 with the Basilisk Tank and Panam" would have generated incoherent slop in most other image/video models, not verbatim gameplay footage that is consistent.
For reference, this is what you get when you give the same prompt to Veo 3 Fast (trained by the company that owns YouTube): https://x.com/minimaxir/status/1973192357559542169
That's really interesting. What if they RAG search related videos from the prompt, and condition on that to generate? That might explain fidelity like this
mxwsn commented on Diffusion Beats Autoregressive in Data-Constrained Settings blog.ml.cmu.edu/2025/09/2... · Posted by u/djoldman
At that point it is not following a diffusion training objective. I am aware of papers that do this, but I have not seen one that shows it as a better pretraining objective than something like v-prediction or flow matching.
Why is not the diffusion training objective? The technique is known as self-conditioning right? Is it an issue with conditional Tweedie's?
AI with ability but without responsibility is not enough for dramatic socioeconomic change, I think. For now, the critical unique power of human workers is that you can hold them responsible for things.
edit: ability without accountability is the catchier motto :)
mxwsn commented on Unlike ChatGPT, Anthropic has doubled down on Artifacts ben-mini.com/2025/claude-... · Posted by u/bewal416
Has anyone come across any really cool artifacts? I'd be curious to see
mxwsn commented on Web3 Onboarding Was a Flop – and Thank Goodness tomhadley.link/blog/web3-... · Posted by u/solumos
Am I the only one struggling to decipher this?
I thought web3 was supposed to be some kind of decentralized compute, where rather than run on your own hardware or IaaS/PaaS you could make use of compute resources that vary wildly day-to-day in availability, performance, and cost, because they were somehow also mining rigs or something? But it's "decentralized" because there's not one entity running the thing.
There is not a mention of that in the article.
Is it actually supposed to just be microtranscations paid with cryptocurrency? Where's the "decentralized" part of that?
Anyway, instead the best I can see this article seems to be talking about how it turns out people aren't using blockchain for buying things, and makes the (apparently) shocking conclusion "the one thing people always wanted: money that just works."
Stablecoins transferred $27 trillion in 2024 - more than Visa and Mastercard combined. This is right in the article.
Stablecoins operate using decentralized ledgers on e.g. Ethereum which use decentralized compute. This isn't mentioned explicitly because the target audience knows this already.
Gemini can beat the game?
Gemini has beat it already, but using a different and notably more helpful harness. The creator has said they think harness design is the most important factor right now, and that the results don't mean much for comparing Claude to Gemini.
mxwsn commented on The booming, high-stakes arms race of airline safety videos thehustle.co/originals/th... · Posted by u/gmays
Huh, I imagined this was because of relaxing regulation.
mxwsn commented on Deep Learning Is Not So Mysterious or Different arxiv.org/abs/2503.02113... · Posted by u/wuubuu
Also if you have happen to have any suggestions for linear algebra for someone who uses it without really understanding it (I can write a measurement function for an EKF from scratch OK, but I don't really understand why the maths does what it does) I would really appreciate it.
The gradient is a special case of the Jacobian for functions mapping N to 1 dimension, such as loss functions. The gradient is an N x 1 vector.