Sign in

Transluce

@transluce.bsky.social
43 followers 2 following 7 posts

Open and scalable technology for understanding AI systems. transluce.org

PostsRepliesMedia
Transluce @transluce.bsky.social · 19/02/2026
Docent is our tool for debugging agents by analyzing traces at scale. Docent (1) compared each failed run to a successful run on the same task by a different model, (2) synthesized the failures by model, (3) quantified the timeout rates.
100
Transluce @transluce.bsky.social · 19/02/2026
Why does GPT-5.1 Codex score 6.5% worse than GPT-5 Codex on Terminal-Bench, with the same scaffold? 🧵 GPT-5.1 times out at ~2x the rate of GPT-5. Excluding timeouts, GPT-5.1 wins by 7.2%. We analyzed 256M+ tokens of traces and found this in under an hour. Here’s how 👇
161