Sign in

Alexander Doria

@dorialexander.bsky.social
8K followers 721 following 2.1K posts

LLM for the commons.

PostsRepliesMedia
Alexander Doria @dorialexander.bsky.social · 27/09/2026
Something I hardly see addressed in the goncourt/ai discourse: it's still pretty hard to generate a workable novel (let alone good), especially considering he seems to have used a previous generation model (gpt-4o style + natural time lag before publishing).
3101
Alexander Doria @dorialexander.bsky.social · 25/09/2026
As a teasing for full paper, a podcast I did a few weeks ago on all things synth with Ravid Shwartz Ziv and Allen Roush. www.youtube.com/watch?v=vgoO...
youtube.com
Pierre-Carl Langlais on Building Models from Data You Can Account For
YouTube video by The Information Bottleneck
1100
Alexander Doria @dorialexander.bsky.social · 24/09/2026
SYNTH is going to Neurips
2522
Alexander Doria @dorialexander.bsky.social · 20/09/2026
current read, immediately joining my list of retroactive llm literature.
1130
Alexander Doria @dorialexander.bsky.social · 16/09/2026
yeah we’re cooked (von der leyen state of union)
6584
Alexander Doria @dorialexander.bsky.social · 11/09/2026
so basically i took a turn from humanities to ai, all for math to be finally humanities-pilled.
4476
Alexander Doria @dorialexander.bsky.social · 10/09/2026
now in nyt. www.nytimes.com/2026/09/10/s...
191
Alexander Doria @dorialexander.bsky.social · 10/09/2026
i was just thinking my older blogs must read pretty blah now. just the word we live in.
180
Alexander Doria @dorialexander.bsky.social · 10/09/2026
This week should be fun (relatively serious anon/insider).
1262
Alexander Doria @dorialexander.bsky.social · 09/09/2026
thanks to synthetic environments we can run matrix in reverse. www.anthropic.com/research/ali...
2205
Reposted by Alexander Doria
SE Gyges @segyges.bsky.social · 20/05/2026
how bout them millenium problems tho
98410
Alexander Doria @dorialexander.bsky.social · 08/09/2026
Very on brand for the stochastic parrot metaphor to be finally killed by stochastic flows.
1201
Alexander Doria @dorialexander.bsky.social · 08/09/2026
EU singular vision of AI: without compute, money, research.
4242
Alexander Doria @dorialexander.bsky.social · 07/09/2026
won’t age well
6223
Alexander Doria @dorialexander.bsky.social · 06/09/2026
So confirms Astra is current SOTA on private multimodal tasks (segmentation/hard manuscript), and that’s not close.
1342
Alexander Doria @dorialexander.bsky.social · 22/08/2026
Very fittingly, one of the smallest model Anthropic ever trained is on Common Corpus and Pleias 1.2B tokenizer: 2.9M model artificially expanded to 331M to study weights interference for the new Transformer Circuits. transformer-circuits.pub/2026/interfe...
3383
Alexander Doria @dorialexander.bsky.social · 27/07/2026
Probably the best model report this year: multiple infrastructure pieces cohering to fix computation and network to hold 3T parameters.
37010
Alexander Doria @dorialexander.bsky.social · 25/07/2026
My one issue with Nolan’s version so far: it cuts everything that makes Odyssey a self-aware proto-philosophical text, especially Scheria which has already all features of a Plato’s myth. One of the major pre-Socratic work, Parmenides’ poem, is literally an Odyssey rewrite.
3274
Alexander Doria @dorialexander.bsky.social · 08/07/2026
And new technical blogpost by Pleias application team on deploying small reasoning models for edge devices : featuring cache context management on Rasperry, designing system orchestration under constraints (reranker, chunking) and model specialization. pleias.ai/blog/local-a...
4396
Alexander Doria @dorialexander.bsky.social · 27/06/2026
Alors deux minutes d’explications : 1. Les modèles à poids ouverts sont protégés par la norme safetensors : par définition ils n’embarquent pas de code. Jamais vu un cas de backdoor.
1191
Alexander Doria @dorialexander.bsky.social · 18/06/2026
Announcing the first industrial application of SYNTH: we trained a 600m reasoning model for one of the largest infrastructure in the world, the subway of Paris. pleias.ai/blog/sillon-...
56715
Alexander Doria @dorialexander.bsky.social · 15/06/2026
Doing the most responsible thing an European AI labs can do after this weekend: shipping a blogpost. Why the EU can't into AI, how it's not about compute, but actual skill issue and failing for years to build an actual training ecosystem. pleias.ai/blog/fable-eu
67314
Alexander Doria @dorialexander.bsky.social · 13/06/2026
Ok if the only answer to all this is billions of Mistral subsidies, I’m out.
5471
Alexander Doria @dorialexander.bsky.social · 13/06/2026
Not having any EU competitive labs (plural intended) is about to get very painful.
513415
Alexander Doria @dorialexander.bsky.social · 25/05/2026
After months of delay, here comes the successor post to "The model is the product": the AI decoupling. All about MoE high margin economics, synthetic pretraining weakening commoditization and the new push toward Model IP. vintagedata.org/blog/posts/t...
2567
Alexander Doria @dorialexander.bsky.social · 20/05/2026
some pretty strong stochastic parrots
37910
Alexander Doria @dorialexander.bsky.social · 05/05/2026
So more corporate news: we're launching an early beta access to the synth pipelines that originally created SYNTH and have been further refined and enhanced through the last few months.
1292
Alexander Doria @dorialexander.bsky.social · 28/04/2026
And new Pleias release in partnership with GSMA: CommonLingua, a 2.35M parameters model for language detection, currently performing best on the CommonLID benchmark by a wide margin. huggingface.co/PleIAs/Commo...
5364
Alexander Doria @dorialexander.bsky.social · 24/04/2026
Currently presenting the Common Corpus poster at #ICLR2026 Pavilion 3 (spot 1614) with Pavel Chizhov, if you want to come and say hi.
0393
Alexander Doria @dorialexander.bsky.social · 23/04/2026
First day of #ICLR2026 posters: graph is one of the most interesting area right now. Original methods involving bold architecture choices (beyond classic GNN) and I do see an immediate use for it in synthetic/agentic pipelines as we need to perform search at increasing depth levels.
1121
Alexander Doria @dorialexander.bsky.social · 21/04/2026
At least for now Brazil is 10/10 on things that matter (breakfast)
060
Alexander Doria @dorialexander.bsky.social · 20/04/2026
More formal announcement: I'll be at ICLR this week to present the oral on Common Corpus with Pavel Chizhov. Happy to discuss anything data research, synth pretraining, models and products.
0331
Alexander Doria @dorialexander.bsky.social · 11/04/2026
Parameter ceiling seems ridiculously low now that we can generate data at will. For a complex token classification task (editorial structure detection) i'm maxing out at 4M.
3190
Alexander Doria @dorialexander.bsky.social · 11/04/2026
I doubt anyone ever did that, but there is a philosophical thesis to write on the ties between Homotopy Type Theory and ancient logic.
140
Alexander Doria @dorialexander.bsky.social · 10/04/2026
Don't know how to say to Mistral that some of it already exists…
6170
Alexander Doria @dorialexander.bsky.social · 08/04/2026
Just realized Common Corpus is (again!) in Anthropic's Transformers Circuit — new chapter on emotions transformer-circuits.pub/2026/emotion...
2221
Alexander Doria @dorialexander.bsky.social · 08/04/2026
Hum. I have a slight Chinese doubt over Meta’s new model…
230
Alexander Doria @dorialexander.bsky.social · 08/04/2026
Meanwhile, just occurred to me that the "AI con" is still on a book tour.
4604
Alexander Doria @dorialexander.bsky.social · 07/04/2026
circuit transformers once more confirmed confirmed to be the one oblique access to anthropic core research: most interesting parts of the 240 pages mythos report.
2381
Alexander Doria @dorialexander.bsky.social · 06/04/2026
Maybe it’s too soon to talk about a vibe shift toward data research in AI, but definitely easier to get paper accepted.
4291
Alexander Doria @dorialexander.bsky.social · 06/04/2026
One of the weirdest part of my job right now is being naturally led to read philosophical works for practical data pipeline design.
3404
Alexander Doria @dorialexander.bsky.social · 05/04/2026
hmm. seems sota.
2341
Alexander Doria @dorialexander.bsky.social · 04/04/2026
Looks like I’m bound to reinvent all pretraining tooling around sub-4M bytes model. Classification done, language detection next.
1300
Alexander Doria @dorialexander.bsky.social · 02/04/2026
I like how Anthropic is just obliquely releasing their work on recursive self-improvement.
815316
Alexander Doria @dorialexander.bsky.social · 02/04/2026
on a different note: happily featured in the main french ranking for young economic leaders
2210
Alexander Doria @dorialexander.bsky.social · 01/04/2026
math synth pipeline taking shape
2251
Alexander Doria @dorialexander.bsky.social · 30/03/2026
Starting to suspect most synthetic pipelines will be about topology long term (first with math, but not only).
050
Alexander Doria @dorialexander.bsky.social · 30/03/2026
weirdly enough, i feel we might have another ml/deep learning boom as this is all so easy to train now.
5605
Alexander Doria @dorialexander.bsky.social · 29/03/2026
Currently reading and surprisingly relevant to AI ethics. Brentano core point is that ethics and epistemic are almost naturally aligned, as converging on the right judgement about the world will also lead you to make more moral claims (hence the double play on the meaning of correctness).
2164
Alexander Doria @dorialexander.bsky.social · 29/03/2026
Discussing with Opus about science/math concept genealogy makes it clear there are still surprising holes in model internal knowledge. And I know exactly why (PDF crawl problem).
2310