Sign in

Muru Zhang

@muruzhang.bsky.social
645 followers 64 following 2 posts

First-year NLP PhD @ USC | Intern @ TogetherAI | Prev. UW, AWS nanami18.github.io

PostsRepliesMedia
Muru Zhang @muruzhang.bsky.social · 04/03/2025
Great to be part of this project led by the amazing @hamishivi.bsky.social. The most fun (in retrospect) thing is to observe how the results start to shift as we scale up the candidate pool, evaluation suite, and selection size :) And eventually we find a simple method does the best!
021
Reposted by Muru Zhang
Hamish Ivison @hamishivi.bsky.social · 04/03/2025
How well do data-selection methods work for instruction-tuning at scale? Turns out, when you look at large, varied data pools, lots of recent methods lag behind simple baselines, and a simple embedding-based method (RDS) does best! More below ⬇️ (1/8)
1134