Have anyone written any interesting thoughts about mechinterp and the RL CoT models like o3?
I havent really grokked it yet. Seem's like those models in some sense do "less" in a single forward pass. So maybe mechinterp is easier? But also, maybe its less useful, because less is in the activations