No RSS? I want to subscribe :'(
Readit Newsrhaps0dy commented on Think twice before translating all C to Rust agarriga.substack.com/p/t... · Posted by u/rhaps0dy
"Another downside is that Fil-C is not compatible with libraries in binary form, it requires a re-compile."
My gut tells me this is only going to work for a relatively small part of the existing C code in production. Recompiling old C with new compiler is fraught with risks.
Possible! But fixing this seems easier than re-writing in Rust with reasonable expectation that the software behaves the same?
rhaps0dy commented on Is memory-safe Linux within reach? agarriga.substack.com/p/i... · Posted by u/rhaps0dy
Most Linux CVEs are memory corruption bugs. Previously I argued that we should compile C to be memory-safe rather than translating all C to Rust, to avoid introducing logic bugs.
Here, I argue that several parts of the kernel can also be compiled in a memory-safe way.
rhaps0dy commented on Voyager 1 is about to reach one light-day from Earth scienceclock.com/voyager-... · Posted by u/ashishgupta2209
No, that sounds wrong. I am sure future objects will go further.
Unless we go extinct. But I concur.
rhaps0dy commented on Brexit reduced UK GDP by 6-8%, investments by 12-18% [pdf] nber.org/system/files/wor... · Posted by u/jnord
Enjoy your chlorinated chickens guv!
I'm vegan, I don't eat tortured animals. Thanks though.
rhaps0dy commented on Brexit reduced UK GDP by 6-8%, investments by 12-18% [pdf] nber.org/system/files/wor... · Posted by u/jnord
Ok but the current vibe in the UK is Parliament wants to watch you while you sleep so they can judge your worthiness. Not exactly an "efficient regulations" regime.
Yeah, that's fair. There's hope though!
rhaps0dy commented on Brexit reduced UK GDP by 6-8%, investments by 12-18% [pdf] nber.org/system/files/wor... · Posted by u/jnord
Yeah, but long term it will increase GDP due to the UK being able to have better (fewer) regulations than those allowed by the EU. It does require Parliament getting it together.
The ResNet results hold from scratch because strict local constraints (e.g., 3x3 convolutions) force the emergence of fundamental signal-processing features (Gabor/Laplacian filters) regardless of the dataset. The architecture itself enforces the subspace.
The Transformer/ViT results rely on fine-tunes because of permutation symmetry. If you trained two ViTs from scratch, "Attention Head 4" in Model A might be functionally identical to "Head 7" in Model B, but mathematically orthogonal.
Because the authors' method (SVD) lacks a neuron-alignment step, scratch-trained ViTs would not look aligned. They had to use pre-trained models to ensure the weights shared a coordinate system. Effectively, I think that they proved that CNNs converge due to it's arch, but for Transformers, they mostly just confirmed that fine-tuning doesn't drift far from the parent model.