iiinova — where your digital self keeps evolving

Reposted by Pradeep Dasigi

Ai2 @ai2.bsky.social · 22/10/2025

We’re updating olmOCR, our model for turning PDFs & scans into clean text with support for tables, equations, handwriting, & more. olmOCR 2 uses synthetic data + unit tests as verifiable rewards to reach state-of-the-art performance on challenging documents. 🧵

1386

Reposted by Pradeep Dasigi

Costa Huang @vwxyzjn.bsky.social · 13/03/2025

Introducing OLMo-2-0325-32B-Instruct! It's the spring RL curve time. This time, we used GRPO for RLVR and trained a pretty nice fully open source model!

1121

Reposted by Pradeep Dasigi

Ai2 @ai2.bsky.social · 13/03/2025

Announcing OLMo 2 32B: the first fully open model to beat GPT 3.5 & GPT-4o mini on a suite of popular, multi-skill benchmarks. Comparable to best open-weight models, but a fraction of training compute. When you have a good recipe, ✨ magical things happen when you scale it up!

35814

Pradeep Dasigi @pdasigi.bsky.social · 04/03/2025

How to curate instruction tuning datasets while targeting specific skills? This is a common question developers face while post-training LMs. In this work led by @hamishivi.bsky.social we found that simple embedding based methods scale much better than fancier computationally intensive ones.

010

Reposted by Pradeep Dasigi

Jacob Morrison @jacobcares.bsky.social · 30/01/2025

also some other tülu contributors are on the market: @ljvmiranda.bsky.social (ljvmiranda921.github.io) and Xinxi Lyu (alrope123.github.io) are also applying to phd programs, and @valentinapy.bsky.social (valentinapy.github.io) is on the faculty market, hire them all!!

011

Pradeep Dasigi @pdasigi.bsky.social · 30/01/2025

Here's a significant update to Tülu 3: we scaled up the post-training recipe to Llama 3.1 405B. Tülu 3 405B beats Llama's 405B instruct model and also Deepseek V3. Huge shoutout to @hamishivi.bsky.social and @vwxyzjn.bsky.social who led the scale up, and to the rest of the team!

070

Reposted by Pradeep Dasigi

Nathan Lambert @natolambert.bsky.social · 08/01/2025

Very pleased to see Tulu 3 70B more or less tied with Llama 3.1 70B Instruct on style controlled ChatBotArena. The only model anywhere close to that with open code and data for post-training! Lots of stuff people can build on. Next looking for OLMo 2 numbers.

0243

Reposted by Pradeep Dasigi

Hamish Ivison @hamishivi.bsky.social · 08/01/2025

Excited to see Tulu 3 sits in between Llama 3.1 and 3.3 instruct on the chatbot arena leaderboard right now! Particularly happy it is top 20 for Math and Multi-turn prompts :) All the details and data on how to train a model this good are right here: arxiv.org/abs/2411.15124

0153

Reposted by Pradeep Dasigi

Hamish Ivison @hamishivi.bsky.social · 06/12/2024

New OpenAI RL finetuning API reminds me a lot of RLVR, which we used for Tülu 3 (arxiv.org/abs/2411.15124). Using RL to train against labels is a simple idea, but very effective (>10pt gains just using GSM8k train set). It's implemented for you to use in Open-Instruct 😉: github.com/allenai/open...

Test accuracy, train rewards, kl divergence, and response lenght training curves when training Tulu 3 SFT and Tulu 3 DPO on the MATH or GSM8k train sets, and evaluating on MATH/GSM8k using RLVR. Performance significantly improves in both cases.

171

Pradeep Dasigi @pdasigi.bsky.social · 04/12/2024

Our team at Ai2 (OLMo) is looking for a predoctoral researcher. You get to work on exciting research in building open LMs while preparing for a PhD. Apply here: job-boards.greenhouse.io/thealleninst...

job-boards.greenhouse.io

Job Application for Predoctoral Young Investigator, OLMo at The Allen Institute for AI

020

Reposted by Pradeep Dasigi

Mechanical Dirk @mechanicaldirk.bsky.social · 02/12/2024

We just updated the OLMo repo at github.com/allenai/OLMo! There are now several training configs that together reproduce the training runs that lead to the final OLMo 2 models. In particular, all the training data is available, tokenized and shuffled exactly as we trained on it!

github.com

GitHub - allenai/OLMo: Modeling, training, eval, and inference code for OLMo

Modeling, training, eval, and inference code for OLMo - allenai/OLMo

05411

Pradeep Dasigi @pdasigi.bsky.social · 26/11/2024

OLMo 2 is out! We released 7B and 13B models that are *fully open*, and compete with the best open-weight models out there. Importantly, we use the same post-training recipe as our recently released Tülu 3, and it works remarkably well, more so at the 13B size.

020

Reposted by Pradeep Dasigi

fizz ☭ @fizz.allura.moe · 24/11/2024

open source tulu 3 model recreation! rivals the original sft and other models in its size range huggingface.co/allura-org/T...

huggingface.co

allura-org/Teleut-7b · Hugging Face

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

1346

Pradeep Dasigi @pdasigi.bsky.social · 23/11/2024

A common approach for improving LM performance at specific skills is to *synthesize* training data that is similar to corresponding evals. But how do we ensure that we are not simply overfitting to those benchmarks? It is worth highlighting our approach to evaluation for Tülu 3 in this regard.

180

Pradeep Dasigi @pdasigi.bsky.social · 23/11/2024

Super excited to release Tülu 3, a suite of open SoTA post-trained models, data, code, evaluation framework, and most importantly post-training recipes. I learned A LOT about LM post-training working on this project. We wrote it all up so now you can too. Paper: allenai.org/papers/tulu-...

allenai.org

180

Reposted by Pradeep Dasigi

Hamish Ivison @hamishivi.bsky.social · 21/11/2024

Excited to release Tulu 3! We worked hard to try and make the best open post-training recipe we could, and the results are good! I was lucky enough to work on almost every stage of the pipeline in one way or another. Some comments + highlights ⬇️

195

Reposted by Pradeep Dasigi

Ai2 @ai2.bsky.social · 21/11/2024

Meet Tülu 3, a set of state-of-the-art instruct models with fully open data, eval code, and training algorithms. We invented new methods for fine-tuning language models with RL and built upon best practices to scale synthetic instruction and preference data. Demo, GitHub, paper, and models 👇

211131

Reposted by Pradeep Dasigi

Valentina Pyatkin @valentinapy.bsky.social · 21/11/2024

Open Post-Training recipes! Some of my personal highlights: 💡 We significantly scaled up our preference data! 💡 RL with Verifiable Rewards to improve targeted skills like math and precise instruction following 💡 evaluation toolkit for post-training (including new unseen evals!)

0221