Reposted by Stefano Palminteri
New preprint! Can LLMs really know when they know? We trained 10 open models to predict their own accuracy and found a striking limit: out of distribution, confidence tracks consistency more than correctness. Led by @nicolasyax.bsky.social with @pyoudeyer.bsky.social arxiv.org/pdf/2609.33886