iiinova — where your digital self keeps evolving

Luca Soldaini 🎀 @soldaini.net · 22/10/2025

it’s OCR week! learn how we use verifiable rewards against unit tests to improve olmOCR’s PDF understanding state of the art OCR, fully open model:

1232

Luca Soldaini 🎀 @soldaini.net · 21/10/2025

yea i was gonna link 🤣 rough guidelines I’ve heard for multilingual are around 600B+, which high level matches yuval’s findings.

040

Luca Soldaini 🎀 @soldaini.net · 12/09/2025

which one of you im gonna have the pleasure to see at COLM???

5130

Luca Soldaini 🎀 @soldaini.net · 20/08/2025

my keystrokes go though light-up starry cable OF COURSE my code is better than yours

0150

Luca Soldaini 🎀 @soldaini.net · 05/08/2025

12+ years in this country, first time I get to wear this sticker 🗳️

0160

Luca Soldaini 🎀 @soldaini.net · 18/07/2025

wearing italian camo* at ICML *ordering an ice lattes rather than espressos at coffee shops

140

Luca Soldaini 🎀 @soldaini.net · 23/06/2025

new @ai2.bsky.social office has something for everyone: stunning views for the outdoorsy kind, 2.5 Gbps connection at every desk for the indoor nerds

0130

Luca Soldaini 🎀 @soldaini.net · 18/06/2025

Waymo is cool but BART from SFO to downtown SF is cooler 101 can be as dark red as you want on google maps!

080

Luca Soldaini 🎀 @soldaini.net · 09/06/2025

text classification at scale, works great on 70TB of text

020

Luca Soldaini 🎀 @soldaini.net · 09/06/2025

scales just fine to 70TB of text, supports subword embedding, someone made rust bindings 😌

010

Luca Soldaini 🎀 @soldaini.net · 09/06/2025

no reason to switch just because the software is no longer updated. compile from scratch, works great!

010

Luca Soldaini 🎀 @soldaini.net · 06/06/2025

2025 AI hot take: everyone should use FastText more. Word embeddings are awesome.

3253

Luca Soldaini 🎀 @soldaini.net · 06/06/2025

Reddit also has deals with OpenAI and GDM. Maybe negotiation stalled with Anthropic.

010

Luca Soldaini 🎀 @soldaini.net · 03/06/2025

they are a joy to type with our loud mechanical keyboards

010

Luca Soldaini 🎀 @soldaini.net · 01/06/2025

today might be rainy, but PNW summer is already here

0120

Luca Soldaini 🎀 @soldaini.net · 17/05/2025

if soldering skills become critical i’m gonna be soon out of a job 😅

000

Luca Soldaini 🎀 @soldaini.net · 15/05/2025

I've silenced all notifications on all my devices and it's truly the best thing ever ...I am considering allowing calendar notifications tho cuz I almost missed 3 meetings already 😅

2240

Luca Soldaini 🎀 @soldaini.net · 27/04/2025

two weeks traveling and I miss my mechanical keyboard so much

140

Luca Soldaini 🎀 @soldaini.net · 23/04/2025

MANGO SMOOTHIE don’t forget da smoothie 🤤

120

Luca Soldaini 🎀 @soldaini.net · 22/04/2025

when someone says they wanna bring me to their favorite italian restaurant

0150

Luca Soldaini 🎀 @soldaini.net · 02/04/2025

I am still perpetually in awe that skill emergence exists in language models million of caveats but we have models that pick up capabilities from plain text??? it's so magical, I can't believe we got such treat

0222

Luca Soldaini 🎀 @soldaini.net · 27/03/2025

congrats!!! amazing news 🥰

030

Luca Soldaini 🎀 @soldaini.net · 26/03/2025

bluesky deserves to know we’ve adopted a cat and he’s the most handsome boy

2620

Luca Soldaini 🎀 @soldaini.net · 20/03/2025

Summary of our recommendation we submitted to White House to ensure success of open & transparent AI As a meta point, I’m very grateful to be in a position where I can put my technical expertise in the service of policy needs 🥰

070

Luca Soldaini 🎀 @soldaini.net · 14/03/2025

with so many good vision models out there, choosing a starting model with a friendlier license is better ☺️ Gemma is a great generalist model, but any competent VLM model is a good starting point for olmOCR

120

Luca Soldaini 🎀 @soldaini.net · 10/03/2025

"excuse me sir do you have a moment to talk about olmOCR"

2292

Luca Soldaini 🎀 @soldaini.net · 06/03/2025

if i ever find a genie lamp im gonna save a wish for “uninvent pydantic and click” 😤

360

Luca Soldaini 🎀 @soldaini.net · 06/03/2025

weird software artifacts 😁 no one is gonna give me back the hour I spent reading sentencepiece code…

150

Luca Soldaini 🎀 @soldaini.net · 20/02/2025

in the upcoming LLMs war, i choose a neutral team

1360

Luca Soldaini 🎀 @soldaini.net · 18/02/2025

This was such a fun project to work on! We release efficient classifiers 🌐 to partition large corpora, and use them to improve sampling for LLM pretraining great work lead by @awettig.bsky.social 👇

0182

Luca Soldaini 🎀 @soldaini.net · 16/02/2025

gonna frame this so I can tap the sign when collaborators complain

010

Luca Soldaini 🎀 @soldaini.net · 16/02/2025

my toxic trait is enjoying the AWS cost optimization dashboard a little too much

1210

Luca Soldaini 🎀 @soldaini.net · 11/02/2025

www.nordstrom.com/s/stitch-str... wasn’t expecting to be so popular lol

nordstrom.com

010

Luca Soldaini 🎀 @soldaini.net · 11/02/2025

fun! gave ‘em my $5 to support more on device goodness

130

Luca Soldaini 🎀 @soldaini.net · 11/02/2025

yeah, and development requires a mac 😅 have to make compromises for v1 the underlying model can be run on a lot more devices using Llama.cpp (huggingface.co/allenai/OLMo...) and we have it hosted on our playground too (playground.allenai.org?model=olmoe-...) working hard to quickly expand support!

050

Reposted by Luca Soldaini 🎀

Kyle Lo @ ICML2026 🇰🇷 @kylelo.bsky.social · 11/02/2025

one benefit of open models is privacy 🔐you can run them locally & keep all your data on your local device instead of sending it to a company elsewhere congrats @soldaini.net for heavy lifting, showing our OLMoE model can run on iPhones📱

0173

Reposted by Luca Soldaini 🎀

Nathan Lambert @natolambert.bsky.social · 11/02/2025

Best part of this that Luca isn’t highlighting to start is that we trained a way better OLMoE for this too. All from better annealing and post train. Didn’t need to redo pre training. Goes to show how much potential these models have! new instruct model: huggingface.co/allenai/OLMo...

1174

Reposted by Luca Soldaini 🎀

Costa Huang @vwxyzjn.bsky.social · 11/02/2025

🤯 Check out our new iOS OLMoE app that runs the model on-device! We also trained new OLMoE-1B-7B-0125 this time using the Tulu 3 recipe. Very exciting that RLVR improved gsm8k by almost 10 points for OLMoE 🔥 A quick 🧵

151

Luca Soldaini 🎀 @soldaini.net · 11/02/2025

They made me do video 😬 but for a good reason! We are launching an iOS app–it runs OLMoE locally 📱 We're gonna see more on-device AI in 2025, and wanted to offer a simple way to prototype with it App: apps.apple.com/us/app/ai2-o... Code: github.com/allenai/OLMo... Blog: allenai.org/blog/olmoe-app

54913

Luca Soldaini 🎀 @soldaini.net · 10/02/2025

dreading "how was your weekend" questions don't want to tell people I spent my sunday recompiling vLLM from scratch

1110

Luca Soldaini 🎀 @soldaini.net · 10/02/2025

three things are certain in life: death, taxes, and Claude switching to concise mode during US business hours

2372

Luca Soldaini 🎀 @soldaini.net · 07/02/2025

ok but how many LLMs you know are available on BluRay

3414

Reposted by Luca Soldaini 🎀

Ai2 @ai2.bsky.social · 30/01/2025

Here is Tülu 3 405B 🐫 our open-source post-training model that surpasses the performance of DeepSeek-V3! It demonstrates that our recipe, which includes RVLR scales to 405B - with performance on par with GPT-4o, & surpassing prior open-weight post-trained models of the same size including Llama 3.1.

29221