I wrote a quick script to calculate how many times the AI architect/reviewer rejected an implementation per implementor model. Basically an AI change failure rate.
@simonwillison.net do you know of anything else like this? Could be an interesting aggregate metric.