We evaluated a number of different models (OpenAI models, Anthropic Claude Sonnet versions, and 2 versions of Google Gemini) and saw some initial front running by the Gemini models.
(Note, this is very much an illustrative starting eval, not comprehensive!)
(3/n)