Readit Newsgtirloni commented on Anyone melding GPT-level intelligence with physical world? · Posted by u/iamnnk
That's an interesting question but the "AI wrappers" aren't going away because the LLMs 1) aren't totally deterministic and 2) feeding them the correct prompts and context is still very valuable. In other words, one-shotting doesn't work for every use case (which is essentially what your saying when you say they are "self-contained", right? Unfortunately, they aren't/can't be).
Regarding the physical world, that's a deeper question. You have people that say LLM's "understand", that they are "intelligent" and that this is an "emergent behavior" of all their weights. You also have people that say they are nothing more than a stochastic parrot or auto-complete on steroids.
I'm in neither camp but let's do a thought exercise. Multi-modal LLM's are training on text, video, and sound. They can know what a chair looks like, what sound it make if you drag it over a wooden floor, and what it would look like when you do that (from this mysterious PoV somewhere). Now take that "knowledge" and ask it to give you 3D coordinates to move a chair right now in the room you're standing in: it simply can't. It's lacking a lot of information about the actual measurements of the room, its own movement capabilities (or those of the human to carry out the task), etc.
There are AI that can do this, but they aren't good for text. We have self-driving cars and factory robots doing things constrained to those domains.
If you say "meld" as in "let's combine a bunch of different AI technologies together with each one doing what it does best", I'm sure people are working on this already. But LLM's are but a small part of solving that problem.
EDIT: if you still can, please add "Ask HN: " to your title here.
gtirloni commented on OpenIndiana: Community-Driven Illumos Distribution openindiana.org/... · Posted by u/doener
> illumos-closed package, containing binary blobs still necessary to build illumos-gate, was added
https://docs.openindiana.org/release-notes/2016.10-release-n...
> There are a small handful of illumos components for which source code is not available. Over time, we have replaced most of the closed source components from the Sun era with new open source versions. This work is ongoing
https://illumos.org/docs/developers/build/#getting-the-close...
> From this, however, project founder Garrett D'Amore took the last drop of the gate and announced illumos in mid-2010.
It blows my mind how many computing professionals truly think this is the case. It doesn't take a tech blogger to draw a trend line through the advancements of the past 2.5 years and see where we're headed. The fact that grifters abound on the edges of the industry is a sign of the radical importance of this unexpected breakthrough, not an indication that it's all a grift.
To engage in some armchair psychology, I think this is in large part due to a natural human tendency for stability (which is all the stronger for those in relatively powerful positions like us SWEs). Knowing that believing A would imply that your mortgage is in jeopardy, your retirement plan up-ended, and your entire career completely obscured beyond a figurative singularity point makes believing ~A a very appealing option...
Where's your evidence though? Extraordinary claims require extraordinary evidence.
They realized they can't compete on processors, so they're moving on to greener pastures. Like kodak back then.
Intel has traditionally been behind in software quality and discrete GPUs, I wonder if they are making this move out of desperation because nobody thinks "yay, Intel!" when both topics are mentioned.
gtirloni commented on GPT-OSS-120B runs on just 8GB VRAM & 64GB+ system RAM old.reddit.com/r/LocalLLa... · Posted by u/zigzag312
People can read at a rate around 10 token/sec. So faster than that is pretty good, but it depends how wordy the response is (including chain of thought) and whether you'll be reading it all verbatim or just skimming.
Reading while words are flying by is really distracting. I believe it was mentioned at some point that 50t/s feels comfortable and ChatGPT aims for that (no source, sorry).
Joke aside, it's been pretty obvious since the beginning that security was an afterthought for most "AI" companies, with even MCP adding secure features after the initial release.