Readit News logoReadit News
veonik commented on Structured outputs on the Claude Developer Platform   claude.com/blog/structure... · Posted by u/adocomplete
jascha_eng · a month ago
I feel like this is so core to any LLM automation it was crazy that anthropic is only adding it now.

I built a customized deep research internally earlier this year that is made up of multiple "agentic" steps, each focusing on specific information to find. And the outputs of those steps are always in json and then the input for the next step. Sure you can work you way around failures by doing retries but its just one less thing to think about if you can guarantee that the random LLM output adheres at least to some sort of structure.

veonik · a month ago
I have had fairly bad luck specifying the JSONSchema for my structured outputs with Gemini. It seems like describing the schema with natural language descriptions works much better, though I do admit to needing that retry hack at times. Do you have any tips on getting the most out of a schema definition?
veonik commented on Jules, our asynchronous coding agent   blog.google/technology/go... · Posted by u/meetpateltech
ygouzerh · 4 months ago
It looks like there are two different entities inside Google who provides AI products.

From a professional context for example, we are using in my company both Google Workspaces and GCP.

With Google Workspaces, we have including in our subscription Gemini, Veo 3, Jules, etc. Everything is included in a subscription models, rate-limited but unlimited. The main entrypoint is gemini.google.com

However, everytime we need to use the API, then we need to use GCP. It gives us access to some more advances models like Veo3 instead of Veo3-fast, and more features. It's unlimited usage, but pay-as-you-go. The main entrypoint is GCP Vertex AI

And both teams, Google Workspaces and GCP are quite separate. They often don't know really well what the others teams provides.

veonik · 4 months ago
To add to the confusion, you can also just use Gemini via API (without Vertex AI). It shows up as a separate item in billing.

In the (latest, of three different) Go SDK, you can use either Vertex AI or Gemini. But not all features exist in either. Gemini can use uploaded files as attachments, and Vertex AI can use RAG stores, for example. Gemini uses API key based authentication, while Vertex AI uses the traditional credentials. All in the same SDK.

It's a mess.

veonik commented on The double standard of webhook security and API security   speakeasy.com/blog/webhoo... · Posted by u/mfbx9da4
klabb3 · 7 months ago
Both are http requests from client to server. Servers are already authenticated through TLS. The difference is who takes the role of the client.

With API requests the customer takes the client role. The endpoint is the same, eg api.stripe.com. This means, an API key (shared secret) is the minimal config needed to avoid impersonation. You could sign with a private key too but it would also require configuration (uploading the public key to stripe) so there’s not much security gained.

With webhooks, the vendor is the client and needs to authenticate itself. But since it’s always the same vendor, no shared secret is needed. They can sign it with the same private key for all customers. You can bake the public key into client libraries and avoid the extra config. Thus, it’s reasonable to believe the use of public key cryptography is not because it’s more secure, but simply more convenient. Signing is kind of beautiful for these types of problems.

Signing alone creates a potential security issue (confused deputy? Not sure if it has a name): if Eve creates a stripe account and tells stripe that her webhook lives on alice.example.com, ie Alice’s server, stripe could send real verified webhook events to Alice, and if she doesn’t check which account it belongs to, she might provision resources (eg product purchases) if Eve is able to replicate the product ids etc that Alice uses.

Edit: now that I think of it, eve doesn’t even need to point stripe to Alice’s server. She can just store and replay the same signed messages from stripe and directly attack Alice’s server, since the HTTPS connections are not authenticated (only the contents are). To mitigate, the client library should contain some account id in the configuration, in order to correctly discard messages intended for someone else.

veonik · 7 months ago
It’s worth pointing out that Stripe, specifically, generates a per-endpoint secret for webhooks that is used for validating the signature.
veonik commented on AniSora: Open-source anime video generation model   komiko.app/video/AniSora... · Posted by u/PaulineGar
internet2000 · 7 months ago
We’re so close to finally being able to generate our own Haruhi season 3… what a time to be alive.
veonik · 7 months ago
Dude… are you telling me it isnt actually finished? I am watching season 1 for the first time…
veonik commented on Someone at YouTube needs glasses   jayd.ml/2025/04/30/someon... · Posted by u/jaydenmilne
adolph · 8 months ago
Also you can preview the video without taking an ad hit. Clearly the stable genius behind previews has left some revenue on the table.
veonik · 8 months ago
Shh
veonik commented on I tasted Honda’s spicy rodent-repelling tape and I will do it again (2021)   haterade.substack.com/p/i... · Posted by u/voxadam
somenameforme · 10 months ago
Well.... how did it taste?
veonik · 10 months ago
Well, I can say that you definitely won't want to taste it twice.
veonik commented on The Origins of Wokeness   paulgraham.com/woke.html... · Posted by u/crbelaus
veonik · a year ago
I don't think the "be nice to everyone" is the thing people are annoyed with, rather it's the "you will be canceled if you step out of line even once" that comes along with it.
veonik commented on     · Posted by u/virpo
KerryJones · a year ago
Wow, strong start with an introduction to bolt.new, I'm impressed and might use this in my day-to-day
veonik · a year ago
Can you get a working game generated? All I ever see is at least "Script error." with no clear way to debug. Having bolt try to fix it seems to just regenerate bits of the app but has failed to actually fix any problems so far.
veonik commented on Show HN: Container Desktop – Podman Desktop Companion   container-desktop.com/... · Posted by u/istoica
cjauvin · a year ago
Could this be the answer I needed to run an SQL Server image that refused to run on my M3 MBP? I was about to, sadly, try Docker Desktop, because of that.
veonik · a year ago
That is exactly why I needed it, too! :D

Be sure to increase RAM over the default 2GB as well, that SQL Server container is hungry and will crash without enough resources dedicated to it.

veonik commented on Show HN: Container Desktop – Podman Desktop Companion   container-desktop.com/... · Posted by u/istoica
bradleyy · a year ago
While I'm basically fine with Colima on Mac, this seems like a nice alternative to Docker Desktop.
veonik · a year ago
After some initial pains with colima, I tend to agree. Mostly, just needing to specify some VZ args[0] so I could run x86_64 docker images on my M-series.

Is there something in these desktop UIs that colima is completely missing?

[0] `colima start --vm-type=vz --vz-rosetta`

u/veonik

KarmaCake day192January 10, 2013
About
words.
View Original