Our new work on studying the generalization of language models from in-context learning and finetuning is out.
See the thread below by my amazing co-author
@lampinen.bsky.social
and read the paper here: arxiv.org/abs/2505.00661
Give us your feedback.
arxiv.org
On the generalization of language models from in-context learning and finetuning: a controlled study
Large language models exhibit exciting capabilities, yet can show surprisingly narrow generalization from finetuning -- from failing to generalize to simple reversals of relations they are trained on,...
