You could of course argue that the "unfair advantage" is the lack of shareholders who expect the studio to squeeze every last bit of profit out of the player base, but that's neither here nor there.
Readit Newsgrafzhl commented on Larian's Unfair Advantage credistick.com/larians-un... · Posted by u/hahahacorn
Been making electronic music for well over a decade, but always in the classic DAW arrangement view, at most using MIDI keyboards in terms of haptic input devices but relying on mouse and keyboard 95% of the time. I look at devices like Push or Maschine and my immediate thought is how tedious it seems to get anything done with them. I find the different approaches to manifesting musical ideas endlessly fascinating.
grafzhl commented on RWKV: Reinventing RNNs for the Transformer Era arxiv.org/abs/2305.13048... · Posted by u/ianbutler
> every token embedding interacts with every other token embedding before it
> it takes a fraction of every other token embedding and adds it to itself.
> every token embedding mixing information from other embeddings into itself
Noting the use of the word every. Phrased this way, calling it "attention" hardly makes sense, as attention is typically focused on something specific at any given time - not always on the entire thing.
While all other tokens are considered, the attention mechanism is putting an individual weight on each one, in a way "paying more attention" to some than others.