Sign in

Lee Sharkey

@leesharkey.bsky.social
676 followers 108 following 12 posts

Scruting matrices @ Apollo Research

PostsRepliesMedia
Lee Sharkey @leesharkey.bsky.social · 27/01/2025
New interpretability paper from Apollo Research! 🟢Attribution-based Parameter Decomposition 🟢 It's a new way to decompose neural network parameters directly into mechanistic components. It overcomes many of the issues with SAEs! 🧵
1173
Reposted by Lee Sharkey
Laura @lauraruis.bsky.social · 20/11/2024
To my surprise, we find the opposite of what I thought when we started this project: The approach to reasoning LLMs use looks unlike retrieval, and more like a generalisable strategy synthesising procedural knowledge from many documents doing a similar form of reasoning.
310613