snet0 (u/snet0) - Readit News

snet0 commented on Comet AI browser can get prompt injected from any site, drain your bank account twitter.com/zack_overflow... · Posted by u/helloplanets

ec109685 · 10 days ago

It’s obviously fundamentally unsafe when Google, OpenAI and Anthropic haven’t released the same feature and instead use a locked down VM with no cookies to browse the web.

LLM within a browser that can view data across tabs is the ultimate “lethal trifecta”.

Earlier discussion: https://news.ycombinator.com/item?id=44847933

It’s interesting that in Brave’s post describing this exploit, they didn’t reach the fundamental conclusion this is a bad idea: https://brave.com/blog/comet-prompt-injection/

Instead they believe model alignment, trying to understand when a user is doing a dangerous task, etc. will be enough. The only good mitigation they mention is that the agent should drop privileges, but it’s just as easy to hit an attacker controlled image url to leak data as it is to send an email.

snet0 · 10 days ago

> Instead they believe model alignment, trying to understand when a user is doing a dangerous task, etc. will be enough.

Maybe I have a fundamental misunderstanding, but I feel like hoping that model alignment and in-model guardrails are statistical preventions, ie you'll reduce the odds to some number of zeroes preceeding the 1. These things should literally never be able to happen, though. It's a fools errand to hope that you'll get to a model where there is no value in the input space that maps to <bad thing you really don't want>. Even if you "stack" models, having a safety-check model act on the output of your larger model, you're still just multiplying odds.

snet0 commented on Shader Academy: Learn computer graphics by solving challenges shaderacademy.com/... · Posted by u/pykello

raincole · 11 days ago

I've found it ridiculous that people can see this insanely useful, free resource and their first reactions are "meh the buttons are default AI style."

snet0 · 11 days ago

In cases like this, where it's used to "automate the boring stuff", I just see it as outsourcing. You don't want to spend time building the frustrating CSS/HTML or whatever that isn't your skill set, and the LLM is quite great at doing it.

snet0 commented on Show HN: Real-time AI Voice Chat at ~500ms Latency github.com/KoljaB/Realtim... · Posted by u/koljab

koljab · 4 months ago

That's a great question! My first implementation was interruption on voice activity after echo cancellation. It still had way too many false positives. I changed it to incoming realtime transcription as a trigger. That adds a bit of latency but that gets compensated by way better accuracy.

Edit: just realized the irony but it's really a good question lol

snet0 · 4 months ago

> That's a great question!

Never forget what AI stole from us. This used to be a compliment, a genuine appreciation of a good question well-asked. Now it's tainted with the slimy, servile, sycophantic stink of AI chat models.

snet0 commented on Grok3 Launch [video] x.com/xai/status/18916997... · Posted by u/travelhead

infecto · 7 months ago

Hmmmm it is hard to really place the issue. I am very much in the bullish on AI camp but I don't like writing for the sake of writing and some of the models (4o in this case) have very obvious tells and write in such a way that it takes away from what substance may exist.

snet0 · 7 months ago

One thing that concerns me is when you can't tell whether the comment was authored or just edited by AI. I'm uncomfortable with the idea that HN threads and reddit comments gradually tend towards the grey generic writing style of LLMs, but I don't really mind (save for the prospect of people not learning things they might otherwise!) when comments are edited (i.e. minor changes) for the sake of cleanliness or fixing issues.

snet0 commented on Grok3 Launch [video] x.com/xai/status/18916997... · Posted by u/travelhead

nomadpenguin · 7 months ago

You're using two en dashes to approximate it -- few people have the en dash character on hand.

snet0 · 7 months ago

:*:\em::—

snet0 commented on Many of the Pokemon playtest cards were likely printed in 2024 elitefourum.com/t/many-of... · Posted by u/grep_it

jsheard · 7 months ago

Maybe they are, but some of these fakes were authenticated by a third party whose entire job is to serve as a trusted authority for collectors, so they're even bigger idiots for not noticing such a well known tell. This throws everything they've ever graded into doubt.

snet0 · 7 months ago

Precisely this! This seems like a hard thing to spot from a layperson's perspective, but this is literally the purpose of their company, and these printer identification dots seem to be quite well-known in art and printing circles! This should never happen and the fact it did definitely should bring some reputational harm to CGC.

snet0 commented on Reverse engineering Call of Duty anti-cheat ssno.cc/posts/reversing-t... · Posted by u/deverton

Hikikomori · 7 months ago

Apex had plenty of cheaters when I played it, if there's a cheater and they're not detecting it there's not much I can do, just 20-30 minutes wasted.

If its a server with admins I can contact them on discord and get them banned pretty quickly. As a system it worked pretty well, had some badmins but there was plenty of servers so could just join another. Though its not really compatible with the matchmaking style games we have today.

snet0 · 7 months ago

I don't think you appreciate:

1. How many active Apex/whatever games there are at any one time 2. How many users will just report anyone they die to as a cheater

snet0 commented on Why is Git Autocorrect too fast for Formula One drivers? blog.gitbutler.com/why-is... · Posted by u/birdculture

iab · 7 months ago

“Design” to me intimates an intentional broad-context plan. This is no design, but an organic offshoot

snet0 · 7 months ago

Someone thought of a feature (i.e. configurable autocorrect confirmation delay) and decided the interface should be identical to an existing feature (i.e. whether autocorrect is enabled). In my thinking, that second part is "design" of the interface.

snet0 commented on Why is Git Autocorrect too fast for Formula One drivers? blog.gitbutler.com/why-is... · Posted by u/birdculture

kittikitti · 7 months ago

I sometimes have this realization as I'm pressing enter and reflexively press ctrl+c. As someone whose typing speeds range from 100 to 160 WPM, this makes sense. Pressing keys is much different from Formula One pit stops.

snet0 · 7 months ago

That reflexivity felt a bit weird the first time I thought about it. I type the incorrect character, but reflexively notice and backspace it without even becoming aware of it until a moment later. I thought it'd be related to seeing an unexpected character appearing on the display, but I do it just as quickly and reflexively with my eyes closed.

That being said, there are obviously cases where you mistype (usually a fat-finger or something, where you don't physically recognise that you've pressed multiple keys) and don't appreciate it until you visually notice it or the application doesn't do what you expected. 100ms to react to an unexpected stimulus like that is obviously not useful.

snet0 commented on Why is Git Autocorrect too fast for Formula One drivers? blog.gitbutler.com/why-is... · Posted by u/birdculture

snet0 · 7 months ago

This seems like really quite bad design.

EDIT: 1) is the result of my misreading of the article, the "previous value" never existed in git.

1) Pushing a change that silently break by reinterpreting a previous configuration value (1=true) as a different value (1=0.100ms confirmation delay) should pretty much always be avoided. Obviously you'd want to clear old values if they existed (maybe this did happen? it's unclear to me), but you also probably want to rename the configuration label..

2) Having `help.autocorrect`'s configuration argument be a time, measured in a non-standard (for most users) unit, is just plainly bad. Give me a boolean to enable, and a decimal to control the confirmation time.