New paper at babylm.github.io on "Relational Attention for Data-Efficient Language Modeling" with @ecekt.bsky.social and Jakub Dotlačil, building on the seminal work of @taylorwwebb.bsky.social , @awni.bsky.social and others. Paper: arxiv.org/abs/2609.20530. Code: github.com/abrsvn/babyl...
babylm.github.io
BabyLM 4 at EMNLP 2026