Readit News logoReadit News
palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
ramoz · 7 months ago
Nice retrospective but I guess this process is no longer needed as model's get better; esp as they start enabling features like consistent subjects. Seems like a lot of overhead to correct text for inspirational images, but I can imagine you need to always present some form of _quality_ to your clients.

Feel like control nets and some minimal photoshop work would've been better.

palashshah · 7 months ago
totally. it got to a point where most of the text generated in our images was incorrect, and so it wasn't a great look showing that to our clients.

we're actually working on some form of what you described where we take images generated from LLMs + add consistent logos discretely rather than generatively.

palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
zahlman · 7 months ago
It's frankly amazing to me that "ask another LLM to evaluate the image" actually produces useful feedback that results in actual improvement from the first LLM.

But then, I guess it's not much different of an idea from the earlier use of GANs, or of telling LLMs to "stop hallucinating", etc.

palashshah · 7 months ago
totally. the way i think about it (purely based on intuition) is that asking an LLM to do understanding + image generation is too complex for it to be effective. if we separate out the tasks into discrete steps, the evaluation becomes better, and the generation simply becomes instruction following.
palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
abshkbh · 7 months ago
Palash this is a great post, I learnt a lot as an image gen noob! Keep writing more :)
palashshah · 7 months ago
this is incredible to hear! i plan to keep writing on a weekly basis, and will be posting them on twitter.
palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
average_r_user · 7 months ago
Quite interesting, do you have some documentation of your platform and capabilities? Your landing page is quite synthetic
palashshah · 7 months ago
hey! we're working with an initial set of customers, and plan to launch full capabilities soon. stay tuned :)
palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
omneity · 7 months ago
Have you tried open weights vision models such as Qwen VL, MiniCPM, PaliGemma...?

I'm also curious how usable are simpler vision models such as Florence in case you explored this direction.

palashshah · 7 months ago
we're currently in the process of doing this. i think something that could potentially work is to iterate upon the initial image composition / structure using cheaper models, and then upscale at the end. this way you're saving on that iteration cost, but eventually land on a higher-scale image.
palashshah commented on Building an agentic image generator that improves itself   simulate.trybezel.com/res... · Posted by u/palashshah
ramesh31 · 7 months ago
This is a wonderful writeup of building a simple agentic system in general. What OP describes is more or less the bare minimum you should be doing at this point to get good (consistent) results from an LLM; single-shot prompting is a thing of the past.
palashshah · 7 months ago
appreciate the compliment! yep, it's definitely necessary and is the bare minimum for building image generation systems in production.

u/palashshah

KarmaCake day77July 26, 2020View Original