It runs a model with 260K params, so hardly a "Large" LM. Nevertheless, a cool project.
Readit Newsoac commented on Someone got an LLM running on a Commodore 64 from 1982, and it runs as well xda-developers.com/llm-ru... · Posted by u/ghuntley
IIUC, we need gibbs sampling(to compute the weight updates) instead of using the gradient based forward and backward passes with today's NNetworks that we are used to. Any one understand why that is so?
I might be mistaken, but I think this is partly because of the undirected structure of RBMs, so you can't build a computational graph in the same way as with feed-forward networks.
Nice and clean explanation!
It brings up a lot of memories! Shameless plug: I made a visualization of an RBM being trained years ago: https://www.youtube.com/watch?v=lKAy_NONg3g
oac commented on RunwayML releases Act One: obsoleting traditional motion capture runwayml.com/research/int... · Posted by u/handfuloflight
This doesn't make motion capture obsolete: 1) Mocap can be applied to rigged characters and 2) mocap can animate full-body rigs not just facial expressions.
oac commented on A cartoon intro to WebAssembly hacks.mozilla.org/2017/02... · Posted by u/happy-go-lucky