Readit News logoReadit News
grokblah commented on DeepWiki: Understand Any Codebase   aitidbits.ai/p/deepwiki... · Posted by u/childishnemo
jcranmer · 6 months ago
So I decided to look at some open source repos I know decently well. The only one that seems to have a wiki is LLVM (https://deepwiki.com/llvm/llvm-project).

Thoughts on the overview page: Okay, weird subset of the top-level directories. The high-level compilation pipeline diagram is... wrong? Like, Clang-AST is definitely part of clang frontend, and you get to the optimization pipeline, which clearly fucks up the flow through vectorization and instruction selection (completely omitting GlobalISel as well too, for that matter). The choice of backends to highlight is weird, and at the end of the day, it manages to completely omit some of the most important passes in LLVM (like InstCombine).

Drilling down into the other pages... I mean at no point does it even discuss or give an idea of what LLVM IR. There's nothing about the pass manager, nothing about expected canonicalization of passes. It's got a weird fixation about some things (like the role of TargetLowering), but manages to elide pretty much any detail that is actually useful. The role of TableGen in several components is completely missing--and FWIW, understanding TableGen and its error messages is probably the single hardest part of putting together an LLVM backend, precisely the thing you'd want it to focus on.

If I had to guess, it's overly fixated on things that happen to be very large files--I think everything it decided to focus on in a single page happens to be a 30kloc file or something. But that means it also misses the things that are so gargantuan they're split into multiple files--Clang codegen is ~100kloc and InstCombine is ~40kloc but since they're in several 4-5kloc files instead of a large 26kloc file (SLPVectorizer) or 62kloc file (X86ISelLowering), they're simply not considered important and ignored.

grokblah · 6 months ago
That’s a very intriguing observation.

(I haven’t read how it works but…) I wonder if removing file sizes, commit counts, and other numerical metadata would have a significant impact on the output. Or if all of the files were glommed into one large input with path+filename markers?

grokblah commented on Ask HN: Which laptop can run the largest LLM model?    · Posted by u/grokblah
incomingpain · 6 months ago
https://rog.asus.com/us/laptops/rog-flow/rog-flow-z13-2025/s...

The out of stock one has 128gb of unified system ram. AMD 395 ai chip.

So easily run 70B models on that much vram; but slower, probably in that 30-40tokens/s which is very usable.

Qwen 3 30b will be in that 60 tokens/s range.

llama 4 scout will be around 20-30tokens/s

grokblah · 6 months ago
Interesting, I found it on Amazon for $5k: https://a.co/d/h085rvP

That’s the same price as an M4 Max MBP with the same ram and storage. Any idea how they compare in performance?

grokblah commented on Ask HN: Which laptop can run the largest LLM model?    · Posted by u/grokblah
PaulHoule · 6 months ago
Don’t the M-series processors for Mac book pro’s have a huge amount of HBM which is good for models? I see you can get a pro with 48MB of unified memory whereas Alienware will sell you a machine with 32GB of regular ram and 24GB of graphics RAM on a 5090 discrete GPU. So the pro has twice the RAM accessible to the GPU.
grokblah · 6 months ago
Looks like the MacBook Pro might be more cost effective? I like the support for larger models. Thanks!
grokblah commented on DoubleClickjacking: A New type of web hacking technique   paulosyibelo.com/2024/12/... · Posted by u/shinzub
grokblah · a year ago
This could be mitigated by solving a longstanding UX issue: UI elements changing just before you click or tap.

Why not, by default, prevent interactions with newly visible (or newly at that location) UI elements? I find it incredibly annoying when a page is loading and things appear or move as I’m clicking/tapping. A nice improvement would be to give feedback that your action was ineffective/blocked.

grokblah commented on Leaked OpenAI Docs Show Sam Altman Clearly Aware of Silencing Former Employees   futurism.com/sam-altman-s... · Posted by u/Paul-Craft
grokblah · 2 years ago
OpenAI sounds like a wolf in sheep's clothing
grokblah commented on Ways to teach kids to code (2016)   medium.com/vehikl-news/10... · Posted by u/osbre
grokblah · 3 years ago
They forgot Scratch!

https://scratch.mit.edu

grokblah commented on We don't show typing status   withcardinal.com/blog/202... · Posted by u/commondream
kazinator · 4 years ago
Have you ever used the BSD ntalk program? You can see every keystroke of the other party, in the opposite split of the screen.

It's awesome: people complete each other's sentences, or stop typing when the other person is saying the same obvious thing.

You can say " , ... what's that word again ...?" and the other person will help, then you can backspace over that and continue your sentence.

I've not ntalked in probably over 25 years. Sheesh!

grokblah · 4 years ago
I miss chatting with that! It was so interactive. I wonder if it could be translated to communication between more than two parties. It sure would be interesting to see a prototype of something like that.

Deleted Comment

u/grokblah

KarmaCake day22May 13, 2014View Original