Ai2 @ai2.bsky.social · 01/07/2025Today we released SciArena, an open evaluation platform where researchers can compare and vote on foundation models for scientific literature tasks. 👇 172 0
Ai2 @ai2.bsky.social · 01/07/2025SciArena has three key components: 1️⃣ SciArena platform: Where anyone can submit questions, vote on their preferred output, and see how models rank. 2️⃣ Leaderboard: A ranking system based on community votes. 3️⃣ SciArena-Eval: A meta-evaluation benchmark from human preference data. 110 0
