Readit News logoReadit News
sgillen commented on Nvidia DGX Spark: When benchmark numbers meet production reality   publish.obsidian.md/aixpl... · Posted by u/RyeCatcher
RyeCatcher · 2 months ago
Author here. I've updated the article based on your feedback. Thank you.

Key corrections:

Ollama GPU usage - I was wrong. It IS using GPU (verified 96% utilization). My "CPU-optimized backend" claim was incorrect.

FP16 vs BF16 - enum caught the critical gap: I trained with BF16, tested inference with FP16 (broken), but never tested BF16 inference. "GPU inference fundamentally broken" was overclaimed. Should be "FP16 has issues, BF16 untested (likely works)."

llama.cpp - veber-alex's official benchmark link proves it works. My issues were likely version-specific, not representative.

ARM64+CUDA maturity - bradfa was right about Jetson history. ARM64+CUDA is mature. The new combination is Blackwell+ARM64, not ARM64+CUDA itself.

The HN community caught my incomplete testing, overclaimed conclusions, and factual errors.

Ship early, iterate publicly, accept criticism gracefully.

Thanks especially to enum, veber-alex, bradfa, furyofantares, stuckinhell, jasonjmcghee, eadwu, and renaudr. The article is significantly better now.

sgillen · 2 months ago
Late to the party here, but you should definitely be using pytorch 25.09 (or whatever is latest when you go to check) rather than 24.10. That's a year old pytorch on new hardware, I suspect a lot of these bugs have been fixed.
sgillen commented on Nvidia's new 'robot brain' goes on sale for $3,499   cnbc.com/2025/08/25/nvidi... · Posted by u/tiahura
probablydan · 4 months ago
Can these be used for local inference on large models? I'm assuming the 128G of memory is like system memory, not like GPU VRAM.
sgillen · 4 months ago
It has a unified memory architecture, so the 128G is shared directly between CPU and GPU. Though it's slower than dGPU VRAM.
sgillen commented on IQ tests results for AI   trackingai.org/home... · Posted by u/stared
epa · 4 months ago
So Grok 4 scores 130 but they put Grok midway in the pack at 110. Bias much?
sgillen · 4 months ago
There are two tests and by default it ranks by the score in the "offline test"
sgillen commented on ChatGPT advises women to ask for lower salaries, study finds   thenextweb.com/news/chatg... · Posted by u/ohjeez
sgillen · 5 months ago
Also interesting in the example shared that 03 thought for 5 seconds for the female case and 46 seconds for the male case. Wish we had access to the chain of thought.
sgillen commented on Ask HN: How to transition into Robotics    · Posted by u/hdks
sgillen · 8 months ago
Robotics is sorely lacking front end devs and UI/UX guys. Most companies won’t hire any until they are already pretty established, but they might hire some. You can check out companies like foxglove who make GUI tools that robotics companies then pay to use.
sgillen commented on Diagrams AI can, and cannot, generate   ilograph.com/blog/posts/d... · Posted by u/billyp-rva
yuvalr1 · 9 months ago
This means the leading UI for LLMs - the chat - is the wrong UI, at least for some of the tasks. We should instead have a single query text field, like in search engines, that you continue to edit and refine, just like in complex search queries.
sgillen · 9 months ago
I still think there is value in chats and retaining context. But there is also value in starting clean when necessary. Giving users control and teaching people how to use it is the way IMO.
sgillen commented on OpenAI's o1-pro now available via API   platform.openai.com/docs/... · Posted by u/davidbarker
SJC_Hacker · 9 months ago
If it was possible:

1) Why wasn't OpenAI doing it themselves?

2) This means we've reached technological singularity if AI models can improve themselves (as in getting a smarter model, not just compressing existing ones like Deepseek)

sgillen · 9 months ago
Compressing existing models is exactly what we are talking about here.
sgillen commented on Gemini Robotics   deepmind.google/discover/... · Posted by u/meetpateltech
sgerenser · 9 months ago
So has the labels like "Autonomous 1x" actually been a thing that Google has used before, or is it actually meant to be an "inside joke" jab at Tesla's previous videos that had small labels indicating the video was sped up and/or being human controlled?
sgillen · 9 months ago
Videos like these are so often sped up or Teleop, I don't think it's really a jab at anyone specifically, just making it clear this video is showing an Autonomous agent without any speedup.
sgillen commented on Gemini Robotics   deepmind.google/discover/... · Posted by u/meetpateltech
acyou · 9 months ago
One of my previous coworkers put it best: the cool looking proof of concept or prototype is 10% of the effort, and getting something that works in the real world and that people actually want is the other 100%.

If we see a real world application that a business actually uses, or that people want to use, that's great. But why announce the prototype with the lab demos? It's premature. Better to wait until you have a good real life working use case to brag about.

sgillen · 9 months ago
> why announce the prototype with the lab demos?

Lol, you need to drive up hype and convince investors you are not falling behind. Not even being cynical here, I think it's a good idea from a business perspective.

sgillen commented on George R.R. Martin has co-authored a physics paper   arstechnica.com/science/2... · Posted by u/rntn
Hasu · a year ago
> Guess Brandon Sanderson will have to finish their series after they die.

People say this often, and I don't get it. Sanderson is a terrible writer and his works and themes are nothing like ASOIAF. His only merit he has is "finishes books quickly". He's not even a fan of the books, he says they're "too dark" for him. He's the worst possible choice!

But I don't want anyone to finish ASOIAF if George dies before it's over. It's his story and no one else can do it right. We did this already and everyone hated it!

sgillen · a year ago
It's just a joke, because Sanderson finished Wheel of Time after Robert Jordan died.

u/sgillen

KarmaCake day1727February 16, 2016
About
PhD student working on controls engineering and reinforcement learning.

https://github.com/sgillen

View Original