Sign in

Ian Berlot-Attwell

@ianberlot.bsky.social
8 followers 2 following 10 posts

ML/NLP PhD Student. Interested in compositional generalization! www.cs.toronto.edu/~ianberlot

PostsRepliesMedia
Ian Berlot-Attwell @ianberlot.bsky.social · 11/12/2024
LLM powered library learning systems achieve SoTA performance on several tasks, but is this driven by the reuse of learned tools? We study two library learning systems for mathematics and find that the reuse of learned tools is extremely infrequent and can harm performance 🧵
Library Learning Doesn't: The Curious Case of the Single-Use Library.
Ian Berlot-Attwell, Frank Rudzicz, Xujie Si
111
Ian Berlot-Attwell @ianberlot.bsky.social · 15/11/2023
Will multimodal models systematically generalize if trained on enough data? In a controlled VQA setting, we find it’s not data quantity, but data DIVERSITY that matters! 🧵 Joint w/ @ab-carrell.bsky.social @kumarkagrawal.bsky.social Yash Sharma @nsaphra.bsky.social www.cs.toronto.edu/~ianberlot/d...
Authors of the paper "Attribute Diversity Determines the Systematicity Gap in VQA"
151