Is an LM that acts Bayesian also Bayesian inside?
☝️ Only as far as its beliefs allow!
Fine-tuned on an optimal Bayesian model, LMs hold and use better beliefs than usual fine-tuning on golden answers.
Details 👇 or bayeslm.github.io
#interpretability #nlproc (1/🧵)
