Prakhar Maurya @mphysicus.bsky.social · 12/01/2026I found this surprisingly counter-intuitive: so-called “attention sinks” in #LLMs are actually a feature, not a bug. Found this amazing paper on the topic: arxiv.org/pdf/2504.02732 #ML #deeplearningarxiv.org 000
