Right? Came to the comments specifically for this, but am confused by people's responses. With prompt adherence this bad, is it worth the 2 cents you spent on it? I don't see how it's even useful for deciding if you want to use the ultra version, or for anything else really.... Maybe if you want to redo it in Photoshop? But at that point, breaking out the old Wacom tablet and making a composite image would probably be just as time intensive, but with much higher image quality (and none of the tale tell signs of AIgen)
> Imagen 4 Ultra: When your creative vision demands the highest level of detail and strict adherence to your prompts, Imagen 4 Ultra delivers highly-aligned results.
It seems that you may need the "Ultra" version if you want strict prompt adherence.
It's an interesting strategy. Personally, I notice that most of the times I actually don't need strict prompt adherence for image generation. If it looks nice, I'll accept it. If it doesn't, I'll click generate again. For creativity task, following the prompt too strictly might not be the outcome the users want.
I've found this is an interesting balance with Copilot specifically. Like, on the one hand I'm glad it aims for the bare minimum and doesn't try to refactor my whole codebase on every shot... at the same time, there's certain obvious things where I wish it was able to think a bit bigger picture, or even engage me interactively, like "hey, I can do a self-contained implementation here, but it's a bit gross; it looks like adding dependency X to the project keeps this a one liner— which way should it go?"
I’ve had good experience with iterative prompting when generating images with Gemini (idk which model — it’s whatever we get with our enterprise subscription at work, presumably the latest.) It’s noticeably better than ChatGPT at incorporating its previous image attempt into my instructions to generate the next iteration.
To the left of the "detailed spaceship" I think I see a distortion pattern reminiscent of a cloaked Klingon bird of prey moving to the right. Or I'm just hallucinating patterns in nebular noise.
Midjourney scores the absolute lowest in terms of prompt adherence against any of the other SOTA models (Kontext, Imagen, gpt-image-1, etc). At this point, its biggest feature is probably as an "exploratory tool" for visualizations by cranking up the chaos and weirdness parameters.
In the little experimentation I did with AI image generation, it seems more a game of trying multiple times until you get something that actually looks right, so I wonder how many attempts they did.
Clicking on "Read the documentation" leads to a page that documents nothing about the latest Imagen models and only provides examples using Gemini 2.0 Flash.
I have found Imagein to be a good general purpose editor and we use it to clean up bitmaps, and adjust black points and white points and curves on greyscale, so it is good for preparing B&W greyscale photographs for print to compensate for dot gain in halftone screens on laser printers. Its 'color separation' capability is rudimentary/first draft though and is ridiculously close to inverse RGB rather than CMYK. For good color seps we use Photoshop so I can control undercolor removal.
They're probably talking about the original Imagen printing product line from the 1980's. I thought I might be the only one to remember them in this thread, so I did a search for printer and found the GP comment.
I guess it's kinda nicely genuine that the "four panel comic strip" has some errors in it (misunderstanding caption + cat high-fiving itself in the bonus fifth panel)
1. The text ”Imagen 4 is now generally available!” is still spoken, not a caption.
2. ”low latency” -> ”low-laten”
(3. Has that ugly gpt-image-1 trademark yellow filter requiring work in post to avoid.)
I didn’t bring up the ”retro comic look” thing. I certainly think it’s an issue with Imagen 4’s version. It doesn’t look very old school at all. But I can’t judge the OpenAI one either on that, I’m no comic book expert, so I just skipped that one.
> I didn’t bring up the ”retro comic look” thing. (…) I’m no comic book expert, so I just skipped that one.
I’m no Scott McCloud, but the OpenAI version definitely does a better job with the retro style. The yellow filter you criticised actually helps to sell the illusion. The Imagen version utterly fails in the retro area, that style is very much modern.
But there are other important flaws in the OpenAI version. The fourth panel has a different cat (the head shape and stripes are wrong) and it bleeds into the previous panel. Technically that could be a stylistic choice, except that the floor/table is inconsistent, making it clear it was a mistake.
I've updated my GenAI Comparison site to include Imagen4 Ultra, so now we have four Google related generative models (Gemini Flash, Imagen3, Imagen4, and Imagen4 Ultra).
Despite claims that Ultra supports improved strict prompt adherence, we saw no evidence that it scored any better than Imagen 4 and in some cases seemed to ignore the prompt altogether (see the "Not the Bees" comic). In many cases, it also seemed much less steerable than Imagen3 requiring many of the prompts to be rewritten.
There's some speculation it's Gemini 3's multi-modal output, and other speculation that it's an OpenAI model. Hard to definitively since these models tend to hallucinate when interrogated.
Readit News
An image has to be much worse than that to fail to save you 6 seconds.
That said, this is their own chosen example of what it can do, so I'd have to assume it is much worse than that on average.
It seems that you may need the "Ultra" version if you want strict prompt adherence.
It's an interesting strategy. Personally, I notice that most of the times I actually don't need strict prompt adherence for image generation. If it looks nice, I'll accept it. If it doesn't, I'll click generate again. For creativity task, following the prompt too strictly might not be the outcome the users want.
Deleted Comment
https://i.imgur.com/kSuqCYg.jpeg
https://tug.org/TUGboat/tb02-2/tb03imagen.pdf
1. Not seen browsing ”ai.dev”.
2. The text ”Imagen 4 is now generally available!” is spoken, not a comic caption.
3. Invalid second panel.
4. Hallucinates ”Meet Imagen 4 fast!”
5. Hallucinates ”It offers low..” etc. (this is the second part of a single sentence said by the cat)
6. Hallucinates ”You can export images in 2K!” (this sentence is not asked for)
7. Doesn’t have the cat and the dog in the fourth panel.
—
Here’s the gpt-image-1 counterpart with the issues I could find:
https://chatgpt.com/share/689f7e4b-01e4-8011-8997-0f37edf8c2...
1. The text ”Imagen 4 is now generally available!” is still spoken, not a caption.
2. ”low latency” -> ”low-laten”
(3. Has that ugly gpt-image-1 trademark yellow filter requiring work in post to avoid.)
I didn’t bring up the ”retro comic look” thing. I certainly think it’s an issue with Imagen 4’s version. It doesn’t look very old school at all. But I can’t judge the OpenAI one either on that, I’m no comic book expert, so I just skipped that one.
https://i.imgur.com/kSuqCYg.jpeg
I’m no Scott McCloud, but the OpenAI version definitely does a better job with the retro style. The yellow filter you criticised actually helps to sell the illusion. The Imagen version utterly fails in the retro area, that style is very much modern.
But there are other important flaws in the OpenAI version. The fourth panel has a different cat (the head shape and stripes are wrong) and it bleeds into the previous panel. Technically that could be a stylistic choice, except that the floor/table is inconsistent, making it clear it was a mistake.
Muphry's Law strikes again.
Indeed.
It's and its are backwards. The latter breaks the possessive s rule.
Speaking of, the possessive s should _always_ be added, no reason to sometimes omit it if the name ends in an s.
Ass backwards, all of it.
Despite claims that Ultra supports improved strict prompt adherence, we saw no evidence that it scored any better than Imagen 4 and in some cases seemed to ignore the prompt altogether (see the "Not the Bees" comic). In many cases, it also seemed much less steerable than Imagen3 requiring many of the prompts to be rewritten.
https://genai-showdown.specr.net?models=IMAGEN_3,IMAGEN_4,IM...
There's some speculation it's Gemini 3's multi-modal output, and other speculation that it's an OpenAI model. Hard to definitively since these models tend to hallucinate when interrogated.