iiinova — where your digital self keeps evolving

Nicholas Roberts

@nick11roberts.bsky.social

Ph.D. student at UW-Madison. Working on automating foundation model guided science. Previously at CMU, UCSD, Fresno City College. nick11roberts.science

Posts Replies Media

Reposted by Nicholas Roberts

albertge.bsky.social @albertge.bsky.social · 08/05/2025

Online data mixing reduces training costs for foundation models, but faces challenges: ⚠️ Human-defined domains miss semantic nuances ⚠️ Limited eval accessibility ⚠️ Poor scalability Introducing 🎵R&B: first regroup data, then dynamically reweight domains during training!

153

Reposted by Nicholas Roberts

Fred Sala @fredsala.bsky.social · 23/04/2025

Today at @iclr-conf.bsky.social, come chat with @changho.bsky.social about what types of data drive weak-to-strong generalization!

0103

Reposted by Nicholas Roberts

Fred Sala @fredsala.bsky.social · 11/12/2024

First up at #NeurIPS2024 from our group, our work on labeling via programmatic distillation (a spotlight!). Label your data orders of magnitude faster and cheaper — come join us today at Poster Session 2 East for a demo!

0158