iiinova — where your digital self keeps evolving

Stella Biderman @stellaathena.bsky.social · 14/06/2025

A bunch of papers suggest that if X and Y are independent tasks, we might expect to see "emergent" behavior on "X and Y" or some task that requires first X and then Y. I'm really surprised I can't find any papers that dig into this; it's usually a side comment. Do you know any?

152

Jim @jimfhahn.bsky.social · 14/06/2025

arxiv.org/abs/2210.13382 a schema of a board game (x) found to emerge with only legal moves provided (y) - not sure if that was what you were after

arxiv.org

Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task

Language models show a surprising range of capabilities, but the source of their apparent competence is unclear. Do these networks just memorize a collection of surface statistics, or do they rely on ...

000