iiinova — where your digital self keeps evolving

Abhinav Moudgil

@amoudgl.bsky.social

PhD student, Mila abhinavmoudgil.com

Abhinav Moudgil @amoudgl.bsky.social · 31/03/2026

Introducing Celo2: Towards Learned Optimization Free Lunch We show that learned optimizers can generalize to practical tasks like GPT-3 1.3B pretraining and several out-of-distribution vision/RL tasks from limited meta-training (~4.5 GPU hours)! 🧵

celo2 language model pretraining results

121

Abhinav Moudgil @amoudgl.bsky.social · 15/06/2025

New side project! assayer: A simple Python-RQ based tool to automatically monitor and evaluate ML model checkpoints offline during training.

141

Reposted by Abhinav Moudgil

Aditi Mavalankar @aditimavalankar.bsky.social · 17/03/2025

Excited to share our recent work, AuPair, an inference-time technique that builds on the premise of in-context learning to improve LLM coding performance! arxiv.org/abs/2502.18487 🧵

arxiv.org

AuPair: Golden Example Pairs for Code Repair

Scaling up inference-time compute has proven to be a valuable strategy in improving the performance of Large Language Models (LLMs) without fine-tuning. An important task that can benefit from additio...

1124