We built CopilotArena this fall in order to evaluate coding models in realistic, interactive environments.
Check out our recent writeup describing the results, as well as details of the system itself.
Work led by @waynechi.bsky.social and Valerie Chen.
.