Ai2 @ai2.bsky.social · 01/07/2025Introducing SciArena, a platform for benchmarking models across scientific literature tasks. Inspired by Chatbot Arena, SciArena applies a crowdsourced LLM evaluation approach to the scientific domain. 🧵 1155
Ai2 @ai2.bsky.social · 01/07/2025On the SciArena platform, users can submit questions, compare models, and vote on which outputs they prefer. There are already 23 frontier models live on the platform, with more than 13,000 votes from 102 expert reviewers across different scientific disciplines. 110
