Reposted by Alberto BiettiSamuel Sledzieski @samsl.io · 28/04/2026Introducing MIMIC: a new foundation model trained natively across DNA, RNA and proteins. MIMIC is multimodal and generative: it can use structure, regulation, evolution, and experimental context to infer missing biology or design new sequences. 🧵⬇️ 1209
Reposted by Alberto BiettiShauli Ravfogel @shauli.bsky.social · 24/10/2025New NeurIPS paper! Why do LMs represent concepts linearly? We focus on LMs's tendency to linearly separate true and false assertions, and provide an analysis of the truth circuit in a toy model. A joint work with Gilad Yehudai, @tallinzen.bsky.social, Joan Bruna and @albertobietti.bsky.social. 1265
Reposted by Alberto BiettiCharles Margossian @charlesm993.bsky.social · 05/05/2025✨ Thank you #AISTATS for the best paper award!! 📜 arxiv.org/abs/2410.11067 💡What does VI learn and under what conditions? The answer lies in symmetry. 🤝 Honored to share this award with my co-author Lawrence Saul from @flatironinstitute.org 2345
Reposted by Alberto BiettiAnirvan Sengupta @anirvansengupta.bsky.social · 27/04/2025Come hear Matt Smart's talk about in-context denoising with transformers at the Associative memory workshop #ICLR25, 2:15pm! This task refines the connection between transformers and associative memories. w/ M Smart and @albertobietti.bsky.social at @flatironinstitute.org 031
Reposted by Alberto BiettiDylan Foster 🐢 @djfoster.bsky.social · 14/12/2024Given a high-quality verifier, language model accuracy can be improved by scaling inference-time compute (e.g., w/ repeated sampling). When can we expect similar gains without an external verifier? New paper: Self-Improvement in Language Models: The Sharpening Mechanism arxiv.org/abs/2412.01951 3416
Reposted by Alberto BiettiMiro Dudik @mdudik.bsky.social · 05/12/2024📣I'm hiring PhD interns for combined theory+empirical projects in: exploration in post-training, multi-task learning in autoregressive models, distillation, reasoning beyond CoT. Apply on the link below. If you're at #NeurIPS2024, message me to chat. jobs.careers.microsoft.com/global/en/jo... 1287
Alberto Bietti @albertobietti.bsky.social · 04/12/2024Applications to our Research Fellow position at @flatironinstitute.org CCM are closing soon on Dec 15! It's a great place for doing fundamental ML research with a lot of freedom, in the heart of NYC. Apply here: apply.interfolio.com/155357apply.interfolio.com Apply - Interfolio {{$ctrl.$state.data.pageTitle}} - Apply - Interfolio 041
Reposted by Alberto BiettiRuben Ohana @rubenohana.bsky.social · 02/12/2024Generating cat videos is nice, but what if you could tackle real scientific problems with the same methods? 🧪🌌 Introducing The Well: 16 datasets (15TB) for Machine Learning, from astrophysics to fluid dynamics and biology. 🐙: github.com/PolymathicAI... 📜: openreview.net/pdf?id=00Sx5... 36419