Reposted by Rossa O'Keeffe-O'Donovan
What are the largest software engineering tasks AI can perform?
In our new benchmark, MirrorCode, Claude Opus 4.6 reimplemented a 16,000-line bioinformatics toolkit — a task we believe would take a human engineer weeks.
Co-developed with @METR_Evals. Details in thread.