oh so we're teaching instruction following without the horrible assistant persona baked into every IF dataset? that's really good, it'll help for a couple of thought experiments i wanna eventually try out (speaking of, tangentially related to said thought experiments: eriskii.net/research/ins...)
eriskii.net
Instruct Vectors · eriskii.net
Instruct Vectors — demonstrating that a trained vector can cause a base model to behave like an instruct-tuned model without modifying weights.
