Readit News logoReadit News
onename commented on Understanding Transformers Using a Minimal Example   rti.github.io/gptvis/... · Posted by u/rttti
CGMthrowaway · 3 months ago
Honest feedback - I was really excited when I read the opening. However, I did not come away from this without a greater understanding than I already had.

For reference, my initial understanding was somewhat low: basically I know a) what embedding is basically b) transformers work by matrix multiplication, and c) it's something like a multi-threaded Markov chain generator with the benefit of prior-trained embeddings

onename · 3 months ago
Have you checked out this video from 3Blue1Brown that talks bit about transformers?

https://youtu.be/wjZofJX0v4M

onename commented on Anthropic's CEO says in 3-6 months, AI will write 90% of the code (March 2025)   businessinsider.com/anthr... · Posted by u/amarcheschi
onename · 4 months ago
Meanwhile: Nearly half of all code generated by AI found to contain security flaws - even big LLMs affected

https://www.techradar.com/pro/nearly-half-of-all-code-genera...

u/onename

KarmaCake day201August 23, 2024
About
Sudo make me a sandwich
View Original