Readit News logoReadit News
randomgermanguy commented on Monodraw   monodraw.helftone.com/... · Posted by u/mafro
makeitdouble · a day ago
Sounds super interesting, where do you put these diagrams ?

It's an issue I'm seeing even for comments touching too much on algorithmic stuff. To take a somewhat common example, if you were dealing with a credit card payment flow, where would the explanation of how a transaction goes through a few states asynchronously, which all trigger a webhook callback ?

Obviously the people working on the code need to be aware of that, so documentation is somewhere needed. I've seen people put whole blocks in class headers, other sprinkle it all inside the code, personally I ended up moving it outside of the code. Where would you put it?

randomgermanguy · a day ago
I personally just throw them at the top of my files as long block-comments, or sometimes inside/around very heavy functions. For example i often add little diagrams for when dealing with some bit-fiddly logic parts to easier visualize the bit-layouts. But for architecture, either a whole text-file for it or at the top of the module
randomgermanguy commented on Monodraw   monodraw.helftone.com/... · Posted by u/mafro
Etheryte · a day ago
On one hand, this could provide a lot of value as some things are just plain hard to explain using only words. On the other hand, aren't you worried about when someone else comes along and needs to update one of those comments? If they're not aware of this tool, it's either going to be incredibly tedious or simply not going to happen.
randomgermanguy · a day ago
As the other commenters put it, i dont think this is a huge issue. I usually use this for architecture level diagrams, and that shouldn't change often/at-all. In-case it does change, doing a new diagram is perfectly in-scope of whoevers working on that.
randomgermanguy commented on Monodraw   monodraw.helftone.com/... · Posted by u/mafro
randomgermanguy · a day ago
Bought this couple months ago, and am now always looking for more ways to include this for inline-documentation.

the fact i can export to clipboard and re-import it and reconstruct all the shapes etc. almost flawlessly is such a big win.

randomgermanguy commented on Analyzing Modern Nvidia GPU Cores   arxiv.org/abs/2503.20481... · Posted by u/mfiguiere
YetAnotherNick · 4 months ago
In a sense, GPUs are only great at matrix-matrix multiplication. For anything else you would only get 7% of the FLOPs/s compared to it(989 vs 67 TFLOP/s for H100)[1].

[1]: https://www.nvidia.com/en-in/data-center/h100/

randomgermanguy · 4 months ago
Funnily, they're far from being optimal for GEMM ops (especially in terms of power consumption).

For GEMM you need to visit each row/vec n-times so theres a bunch of data-reuse going on, which isn't optimal for GPUs since you can't keep that all so close to your processing-units. And while the tensor-cores kinda implement this i think they don't quite scale up to a full sized systolic array, which is you would want for larger matrix multiplications.

Also just a simpler view: with GPUs most of their silicon is spent NOT tensor-core, so just from that you know its not optimal i guess.

Just referring to that FLOP/s number doesn't really mean much nowadays with tensor-cores and sparsity.

In my eyes the big win of GPUs are that not only are they pretty good at GEMMs but also really good at a lot of other easily parallelizable tasks PLUS they're comparatively easy to program ^^

randomgermanguy commented on Getting Started with Torch-Harmonics   github.com/NVIDIA/torch-h... · Posted by u/ArtWomb
zengid · 2 years ago
I'm guessing it's for global temperature modeling
randomgermanguy · 2 years ago
Spherical harmonics are used all over the place in climate science. But two big examples are Global oscillations like NAO&ENSO (so ocean currents and atmospheric pressure mostly), and analyzing wind-patterns on the globe/sphere.

u/randomgermanguy

KarmaCake day41October 12, 2021View Original