If you have a ROM, it's not "no memory".
Needlessly pedantic!
I thought this was pretty cool but the first video didn't play. All this write up and I really just want to see the damn demo in action first! (Edit: reloaded the page and it worked. I still would like to see it on rela hardware!)
It's been fifteen years and we're still waiting. Thanks.
part 3 is to find the secp256k1 private key for satoshi's bitcoins
So the <|beginning of text|> token, with no context before it, learns to predict the first-token-in-a-document distribution. That's not quite the same as predicting nothing at all.
Fun little tool, get ~900M/s after a couple minutes on a 5950X. As the article says though the GPU should clobber that, anyone know of a similar tool that uses the GPU?
Amusingly the tool was archived by the author years ago, and just last year a stupid bug in the random initialization code was found (32 bytes of state initialized with ~31 bits of entropy), leading to ~millions of $ in stolen ETH by exploiters.
I'm guessing because a counter would have ripple carry (i.e. five extra gate delays when rolling over from 111111 to 000000) or need extra gates for carry lookahead and an LFSR is constant-delay.
* https://www.a1k0n.net/2011/07/20/donut-math.html * https://www.iquilezles.org/www/articles/distfunctions/distfu...