New AI coding benchmark: SWE-PolyBench 📊
The popular SWE-Bench evaluates on Python coding ability, only one of the most-used programming languages in the real world (StackOverflow survey chart below). SWE-PolyBench evaluates on Typescript, Javascript, Java, and Python
arxiv.org/abs/2504.08703