Readit NewsIn the entire time we worked together over a few years, he refused to adapt to the rest of the team.
1. The standard terminology is "meh" at most. The word "attention" itself is just barely intuitive, "self-attention" is worse, and don't get me started about "key" and "value".
2. The key papers (Attention is All You Need, the BERT paper, etc.) are badly written. This is probably an unpopular opinion. But note that I'm not diminishing their merits. It's perfectly compatible to write a hugely impactful, transformative paper describing an amazing breakthrough, but just don't explain it very well. And that's exactly what happened, IMO.
3. The way in which these architectures were discovered was largely by throwing things at the wall and seeing what sticked. There is no reflection process that ended on a prediction that such an architecture would work well, which was then empirically verified. It's empirical all the way through. This means that we don't have a full understanding of why it works so well, all explanations are post hoc rationalizations (in fact, lately there is some work implying that other architectures may work equally well if tweaked enough). It's hard to explain something that you don't even fully understand.
Everyone who is trying to explain transformers has to overcome these three disadvantages... so most explanations are confusing.
I wouldn't say so. Historically it's quite common. Maxwell's EM papers used such convoluted notation it it quite difficult to read. It wasn't until they were reformulated in vector calculus that they became infinitely more digestible.
I think though your third point is the most important; right now people are focused on results.
Re HN becoming like Reddit..
Perhaps there is a generic 'cynical feeling' in the air with technology, with feelings of distrust about the intentions of governments and corporations over their use of the profound technology that is appearing, and how this is being constructed with the intention to constrain and manage the individual, rather than enabling greater freedom.
When can I move to Germany ?
In the UK if your train gets cancelled its either:
1. "Tough shit. Suck it up buttercup"
2. The infamous Rail Replacement Bus Service
So yeah, you would not find me complaining if the train company offered me a taxi voucher if my train was cancelled !
After that experience, I purchased a car and motorbike and I will never be convinced to give up my independence in exchange for that abysmal service. It was completely morale breaking. What's worse is I then worked in Japan during 2019 and experienced some of the best service I could possibly think would be reasonable. It's hard to defend in any form the absolute depressing state of the UK rail service.
I have an AMD GPU on my desktop PC and I also have a Steam Deck which uses an AMD APU. Never had a driver crash on me on either system.
Side note: can we get a better tag on this to show it's a PDF file? I think the source is reputable but I always freak out when a url goes to a pdf.
Gives off malcador holding the golden throne for a short time energy