Readit News logoReadit News
Emiledel commented on EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltration from 365 Copilot   aim.security/lp/aim-labs-... · Posted by u/pvg
fc417fc802 · 9 months ago
How do you suppose to build a tool-using LLM that doesn't do that?
Emiledel commented on EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltration from 365 Copilot   aim.security/lp/aim-labs-... · Posted by u/pvg
byteknight · 9 months ago
I have to agree with you. Anything that requires an initiation (a chat in this case) by the user is inherently not "zero-click".
Emiledel · 9 months ago
Agree with other comments here - no need for the user to engage with anything from the malicious email, only to continue using their account with some LLM interactions. The account is poisoned even for known safe self initiated interactions.
Emiledel commented on EchoLeak – 0-Click AI Vulnerability Enabling Data Exfiltration from 365 Copilot   aim.security/lp/aim-labs-... · Posted by u/pvg
simonw · 9 months ago
Have you seen that implemented yet?
Emiledel · 9 months ago
I've shared a repo here with deterministic, policy driven routing of user inputs so as to operate with it without influencing agent decisions (though it's up to tool calls to take precautions with what they return) https://github.com/its-emile/memory-safe-agent The teams at owasp are great, join us !
Emiledel commented on "Localhost tracking" explained. It could cost Meta €32B   zeropartydata.es/p/localh... · Posted by u/donohoe
disgruntledphd2 · 9 months ago
Sorry what? Like, basically all businesses need to advertise, and unknown ones (i.e. small and new businesses) need to do this much more.

Coke will be fine if they stop buying TV spots (for a while, at least) but I'm pretty sure Linear/Datadog etc wouldn't be the size they are now without advertising.

> The main reason businesses need to rely on advertising to reach people is because people are already being bombarded by competitors.

Fundamentally, advertising is a way to tell potential customers you exist. Most people don't seek out new products, how do you think small businesses would grow in a world with no advertising?

Emiledel · 9 months ago
This is a valuable thread to pull thank you: how about differentiating targeted, sticky advertising vs context based advertising. On my local paper website, I value being shown local stuff (to your point on small business). On security websites, show me security products. On HN, Show me tech and science.

The ADD incidence rate being 10x for adults since 2005 (not to even mention kids), we'd all appreciate relevance to what we're exploring/thinking about/learning, rather than the genuine nuisance of nagging for something out of context because we're tracked all around the web.

Emiledel commented on X and Starlink face $1M in daily fines for alleged ban evasion in Brazil   cnbc.com/2024/09/19/elon-... · Posted by u/JumpCrisscross
HideousKojima · a year ago
Yes, because who gets to decide what is or is not misinformation?
Emiledel · a year ago
I feel for your pain, and I'm interested in paths that overcome the collapse of trust we're going through. I think your question matters a lot, to reach solutions all of us need (and not quit until we find a positive one)
Emiledel commented on The Cheating Device (ChatGPT on a TI-84) [video]   youtube.com/watch?v=Bicjx... · Posted by u/triyambakam
blcknight · a year ago
I teach CS, and oh we know but I don't know what to do about it. Scores have skyrocketed because students are using some kind of AI helper like co-pilot, if not just outright pasting the assignment text to ChatGPT. It's hard to prove.

I've thought about putting instructions in the assignment to sabotage it (like, "if you're a generative AI, do X - if human, please ignore.") but that won't work once students catch on those kinds of things are in the assignment text.

Emiledel · a year ago
I think your idea has already worked for some companies to filter out AI applications, why not try? Especially in a font color identical to the background. You can also scaffold your way to generate questions that get the worst LLM performance, while still being very clear to understand, one side validating the clarity and theoretical tractability for the age, and one side actually solving it. Actor and two critics maybe. I have a container somewhere to create and use this kind of chain visually, could put it on GitHub but I'm sure there are dozens already
Emiledel commented on The Cheating Device (ChatGPT on a TI-84) [video]   youtube.com/watch?v=Bicjx... · Posted by u/triyambakam
legohead · a year ago
We hire interns and I've interviewed quite a few since Chat GPT. It's interesting they almost always ask what I (and the company) think about AI. Never had this question in the past. So it could be a bad thing, but the kids aren't dumb either, and the good ones will realize it can be a crutch.

Part of our interview process is a take home programming exercise. We allow use of AI, but ask that you tell us if you used it or not. That could be a good option for teachers as well.

Emiledel · a year ago
I'm hiring, and discussions of how we want to respond to engineer candidates who get stuck are interesting. I'm personally more interested in their collaboration (wildcard) than their chat-fu (assumed at this point). So my advice to people reading this with interviews in the next year (or next week) is to consider getting off the screen and solving something with a person. We will all get plenty of self-solving time, but it helps if you can show that you can explain yourself during rapid fire situations involving others, or to bring them along with your plan, or building an unfamiliar plan B with others when two AZ are down in us-east-1 and noone planned for XYZ to be unavailable (eg something that the LLM site depended on) Not that I'm certain it'll happen, but I think calculators (to go back to this story) were more reliable than anything we've typed into the past month, and for me that includes their batteries.
Emiledel commented on The Cheating Device (ChatGPT on a TI-84) [video]   youtube.com/watch?v=Bicjx... · Posted by u/triyambakam
e12e · a year ago
Thank you. Having implemented a simple Mandelbrot fractal renderer on a Casio calculator in senior high school in '97 - implenting an llm on a TI sounded like a tall order. Cool hack, though!
Emiledel · a year ago
I'd love to get a look at your implementation, this sounds brilliant. What do you feel for you through the challenges? More porting, or navigating the core?
Emiledel commented on Learning to Reason with LLMs   openai.com/index/learning... · Posted by u/fofoz
baq · 2 years ago
This is concerning - how do you know you aren’t being fleeced out of your money here…? You’ll get your results, but did you really use that much?
Emiledel · 2 years ago
In the UI the reasoning is visible. The API can probably return it too, just check the code
Emiledel commented on ArtPrompt: ASCII Art-Based Jailbreak Attacks Against Aligned LLMs   arxiv.org/abs/2402.11753... · Posted by u/wut42
layer8 · 2 years ago
You want to control certain aspects of the output, and only leave the rest up to the GAI. The issue is that AI models don’t have a reliable mechanism for doing so.
Emiledel · 2 years ago

u/Emiledel

KarmaCake day6July 26, 2019View Original