[Hot take] Your Causal Variables Are Irreducibly Subjective
Mech interp keeps "finding the bug" in earlier interventions, but the real problem is upstream: your variable definitions are subjective choices no formalism can validate.
open.substack.com/pub/cichicag...
open.substack.com
Your Causal Variables Are Irreducibly Subjective
Mechanistic interpretability needs its own shoe leather era. Reproducing the labeling process will matter more than reproducing the Github.