iiinova — where your digital self keeps evolving

Hadi Sotoudeh

@mhsotoudeh.bsky.social

AI4Science PhD @ Cambridge | PolymathicAI @polymathicai.bsky.social | ✨🌌💫

Hadi Sotoudeh @mhsotoudeh.bsky.social · 23/04/2026

Physics foundation models are usually trained end-to-end from scratch. But is that the best way? In new work from @polymathicai.bsky.social, we study tokeniser pretraining. Presenting at @iclr-conf.bsky.social AI & PDE. 📄 arxiv.org/abs/2603.05598 #ICLR2026 #AIforScience #FoundationModels 1/6

Title slide asking whether physics foundation models should pretrain their tokeniser. Diagram compares two approaches: joint training from scratch versus two-stage training with tokeniser pretraining followed by foundation model training.

110

Hadi Sotoudeh @mhsotoudeh.bsky.social · 22/07/2025

It was a huge honor to give a keynote at the ML4Astro workshop in Vancouver, sharing our journey at @polymathicai.bsky.social toward building generalist AI models for science. Even more special to share the stage with my friend @astronolan.bsky.social – grateful for the chance to do this together!

Hadi Sotoudeh and Nolan Koblischke stand at the front of a lecture hall delivering a keynote at the ML4Astro workshop in Vancouver. The slide projected behind them reads, "How do we build a generalist AI model for science?" and outlines challenges along a spectrum from structured data to language-like data. Several attendees are seated, some with laptops open.

010

Hadi Sotoudeh @mhsotoudeh.bsky.social · 03/12/2024

What an era to be a scientist! By preparing "teaching material" for some of the most intelligent mathematical models, @polymathicai.bsky.social is taking one step closer to unlocking entirely new frontiers in scientific discovery. Very proud of our team and excited about the adventures ahead!! 👀

120