Two ways to lose a small model. Tell it too little and it guesses. Tell it too much and it never reaches the part that mattered.
Your prompt is small. What the model reads before it almost never is. And the smaller the model, the more it matters.
leushchenko.com/writing/smal...
leushchenko.com
Smaller model, smaller room — Oleksandr Leushchenko
The same model scored 8.3% and 37.2% on the same benchmark. The only thing that changed was the harness around it.
