Excited to release AbstentionBench -- our paper and benchmark on evaluating LLMs’ *abstention*: the skill of knowing when NOT to answer!
Key finding: reasoning LLMs struggle with unanswerable questions and hallucinate!
Paper: arxiv.org/abs/2506.09038
Code: github.com/facebookrese...
🧵1/9
