Readit News logoReadit News
oppositeinvct commented on Gemma 3 270M: Compact model for hyper-efficient AI   developers.googleblog.com... · Posted by u/meetpateltech
jcuenod · 11 days ago
So I had a similar experience with your prompt (on the f16 model). But I do think that, at this size, prompting differences make a bigger impact. I had this experience trying to get it to list entities. It kept trying to give me a bulleted list and I was trying to coerce it into some sort of structured output. When I finally just said "give me a bulleted list and nothing else" the success rate went from around 0-0.1 to 0.8+.

In this case, I changed the prompt to:

---

Tallest mountains (in order):

```

- Mount Everest

- Mount K2

- Mount Sahel

- Mount Fuji

- Mount McKinley

```

What is the second tallest mountain?

---

Suddenly, it got the answer right 95+% of the time

oppositeinvct · 10 days ago
Still pretty sad that its only 95% instead of 99%
oppositeinvct commented on GPT-5 leaked system prompt?   gist.github.com/maoxiaoke... · Posted by u/maoxiaoke
pupppet · 17 days ago
Every time I have to repeat instruction I feel like I've failed in some way, but hell if they have to do it too..
oppositeinvct · 17 days ago
haha I feel the same way too. reading this makes me feel better

u/oppositeinvct

KarmaCake day2March 28, 2021View Original