Reposted by Mor Geva
🧠 To reason over text and track entities, we find that language models use three types of 'pointers'!
They were thought to rely only on a positional one—but when many entities appear, that system breaks down.
Our new paper shows what these pointers are and how they interact 👇
