iiinova — where your digital self keeps evolving

Reposted by Bruce (Zhi) Wen

Ai2 @ai2.bsky.social · 09/10/2026

We’re sharing the engineering work behind Ai2’s GPU scheduler—our new approach to allocating compute across research teams. On our largest H100 cluster, median queue wait fell from 5 minutes to 24 seconds. 🧵 buff.ly/4UsJEYe

2415 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 07/10/2026

The coolest paper I’ve seen in a while. “Reasoning” is not so mystical after all. www.sophielwang.com/cues arxiv.org/abs/2610.06851

sophielwang.com

Sophie Wang

Explore how the first tokens steer a base model's response.

000 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 07/10/2026

In case you missed my hot take yesterday. www.interconnects.ai/p/the-cyber-...

817027 0

Reposted by Bruce (Zhi) Wen

Maria Antoniak @mariaa.bsky.social · 24/09/2026

uhhhh wow

0101 0

Reposted by Bruce (Zhi) Wen

Terence Tao @teorth.bsky.social · 11/09/2026

A group of 25 Fields Medalists, including myself, have made a joint declaration on Math and AI: mathandai.org . We welcome additional signatories. See also this article in the Economist announcing the declaration: www.economist.com/science-and-...

mathandai.org

Declaration — Math and AI

Read the declaration and add your name.

422087937 0

Reposted by Bruce (Zhi) Wen

Zach Weinersmith @zachweinersmith.bsky.social · 08/09/2026

For anyone not following the drama, there's been apparently a big development in ai math, along with some accusations of very bad behavior by OpenAI. But we don't have details yet. If I understand it, Buckmaster and Levent Alpoge made a big discovery on Navier-Stokes. Events go something like this:

17416157 0

Reposted by Bruce (Zhi) Wen

Alexia Jolicoeur-Martineau @alexiajm.bsky.social · 31/08/2026

Simple beats complicated: We show that switching to a sliding-window attention mask with attention sinks (at no cost) beats linear attention post-training. Huge thanks to my collaborators Rhea Sukthanker, ‪Pashmina Cameron‬, and Emy Gervais. Paper: arxiv.org/abs/2608.28444

arxiv.org

Sliding-window beats linear attention

Due to the nature of quadratic attention, Large Language Models (LLMs) consume a lot of memory and energy. Every new token costs more than the previous one. For each additional token, the keys and val...

2429 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 31/08/2026

I discovered r/ShitAmericansSay the other day and wow was it entertaining (and sad). Further strengthened my belief that more (affordable) international students exchange programs would do wonders for world peace.

000 0

Reposted by Bruce (Zhi) Wen

Maria Antoniak @mariaa.bsky.social · 12/08/2026

Check it out! Lea is live and open to the public 🥳 Lea is an experiment to build better social media by researchers and for researchers, where we own our own data and can build our own feeds, events, and communities. This is still very much a proof-of-concept; we welcome ideas + collaborators!

2024285 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 30/07/2026

/rant @anthropic.com should refund me when Claude wastes my time and tokens. I ordered a cappuccino, I’m not paying for your botched magic performance and the 2 litres of milk you spilled along the way. /rant

000 0

Reposted by Bruce (Zhi) Wen

Margaret Mitchell @mmitchell.bsky.social · 29/07/2026

We @hf.co made an interactive visual of the actual hack from the Hugging Face side: the attack chain across trust boundaries, phase activity, and the commands as they were recorded. Key #transparency . huggingface.co/blog/agent-i... Massive props to Hugo, Adrien, Raphael, Christophe for making this.

huggingface.co

Anatomy of a Frontier Lab Agent Intrusion: A Technical Timeline of the July 2026 Incident

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

32811 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 24/07/2026

Insane numbers for opus 5, the power of faster iteration speed + scaled RL (Fable too big to RL as well, yet). And on safeguards "Based on our testing, we expect the classifiers to intervene around 85% less often than they do for Fable 5.". www.anthropic.com/news/claude-...

2789 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 20/07/2026

Argentina should have been eliminated by Capo Verde (sorry not sorry).

000 0

Reposted by Bruce (Zhi) Wen

David J. Bianco @davidjbianco.bsky.social · 17/07/2026

HuggingFace got hacked by an AI. What stuck out to me was the guardrail asymmetry. The attacker had no constraints, but HF's response ran afoul of the abuse guardrails, forcing them into an unplanned switch to local models. Another aspect for your IR plans. huggingface.co/blog/securit...

220546 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 07/07/2026

Cherry on top is Infantino getting the loudest boos from all fans.

000 0

Reposted by Bruce (Zhi) Wen

Sara Candussio @saracandussio.bsky.social · 01/07/2026

Are all the CoT steps necessary? In our latest paper, we find evidence for the existence of a commitment boundary, marking a sharp transition from no/mid guesses to the model final answer across various reasoning tasks and model families. Thread 🧵👇

1252 0

Reposted by Bruce (Zhi) Wen

Pablo Samuel Castro @pcastr.bsky.social · 01/07/2026

I'm excited to share our latest work “Representation Learning Enables Scalable Multitask Deep Reinforcement Learning”. In this work, we revisit a fundamental question in reinforcement learning: What if representation learning was the key ingredient behind scalable RL? 1/🧵

15213 0

Reposted by Bruce (Zhi) Wen

Cat Hicks @grimalkina.bsky.social · 22/06/2026

I have been watching the dialogue on this one closely. To everyone who is saying "OP is special, no one could use AI this way" well, I have spent 18 months doing significant amounts of scicomm in patient communities and they are ALL using AI this way. wrote this to help: github.com/DrCatHicks/i...

github.com

GitHub - DrCatHicks/informed-patient: A Claude Skill to create an evidence review to inform specific health questions

A Claude Skill to create an evidence review to inform specific health questions - DrCatHicks/informed-patient

921548 0

Reposted by Bruce (Zhi) Wen

Eris ⌬ @eriskii.net · 13/06/2026

637059 0

Reposted by Bruce (Zhi) Wen

Ai2 @ai2.bsky.social · 11/06/2026

LLMs are no longer created w/ human data alone. They rely on other models to generate & filter data, evaluate outputs, & guide dev work. So what is a modern LLM built on? Olmo 3 → 89 model + 183 dataset dependencies; Nemotron 3 → 273 + 560 We made ModSleuth to trace this. 🧵

15511 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 10/06/2026

Why I think Anthropic's uneven safety policies with the release of Claude Fable 5 undermine the broader AI community's cohesion and accelerate us to more uncertainty and risk in AI's near-term evolution. www.interconnects.ai/p/claude-fab...

04010 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 02/06/2026

My time at Ai2 / @ai2.bsky.social has come to an end. Ai2 is a wonderful place. The last 2.5+ years building Olmo, Tulu, and other projects will be one of the peaks of my entire career. www.interconnects.ai/p/farewell-ai2

interconnects.ai

Farewell Ai2

This was my last week at the Allen Institute for AI (Ai2), where I got the great privilege to work on the Olmo models, to grow, to learn, and to have broad lasting impacts.

4985 0

Reposted by Bruce (Zhi) Wen

Ai2 @ai2.bsky.social · 08/05/2026

Today we’re releasing EMO, a new mixture-of-experts (MoE) model trained so modular structure emerges directly from data without human-defined priors. EMO can use a small subset of its experts for a given task while keeping near full-model performance. 🧵

217323 0

Reposted by Bruce (Zhi) Wen

maybe: annie rauwerda @annierau.bsky.social · 06/05/2026

love the amazon reviews for this brand of potato chips that used to only be sold in prison

211582324 0

Reposted by Bruce (Zhi) Wen

Kyle Lo @kylelo.bsky.social · 01/05/2026

during in Olmo 3 we thought long context is just finding good data nope! model architecture matters & it's hard to recover if mess it up led by @abertsch.bsky.social, we release many pretrain runs w/ small arch changes and show huge long context performance diffs

05811 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 16/04/2026

Opus 4.7 has a new tokenizer. This means it's also a new base model. Glory days of pretraining still very much going.

4905 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 14/04/2026

Excited to launch the accompanying free RLHF Course for my book. To kick it off, I've released: - Welcome video - Lecture 1: Overview of RLHF & Post-training - Lecture 2: IFT, Reward Models, Rejection Sampling - Lecture 3: RL Math - Lecture 4: RL Implementation Landing page: rlhfbook.com/course

rlhfbook.com

Course | RLHF Book by Nathan Lambert

Course lectures and talks on RLHF and post-training.

67923 0

Reposted by Bruce (Zhi) Wen

Rachit Dubey @rachitdubey.bsky.social · 07/04/2026

🚨New preprint and our results are rather concerning.. We find the "boiling frog" equivalent of AI use. Using large-scale RCTs, we provide *casual* evidence that AI assistance reduces persistence and hurts independent performance. And these effects emerge after just 10–15 minutes of AI use! 1/

261536684 0

Reposted by Bruce (Zhi) Wen

Dr. Skylar Grayson @skylargrayson.bsky.social · 04/04/2026

NASA just dropped this image of Artemis II astronaut Christina Koch looking back at us. The first woman to ever see our planet in its entirety. I’m not crying you’re crying 🥹🔭🧪 📸: NASA

344362807565 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 02/04/2026

Google dropped 4 different Gemma open-weight models! I'm most excited that they're finally adopting a standard Apache 2.0 open source license. huggingface.co/collections/...

211021 0

Reposted by Bruce (Zhi) Wen

John Bistline @bistline.bsky.social · 01/04/2026

This is my favorite climate change chart. Japanese monks, aristocrats, and emperors kept meticulous records of cherry blossom festivals for 1,200 years and accidentally built the world's longest climate dataset.

168183386896 0

Reposted by Bruce (Zhi) Wen

Naomi Saphra @nsaphra.bsky.social · 24/03/2026

classifying the new composer tech report as a must read cursor.com/resources/Co...

2142 0

Reposted by Bruce (Zhi) Wen

Maria Antoniak @mariaa.bsky.social · 24/03/2026

I’m seeing close to zero reaction/conversation about this on here. This is huge news for open research on language models, especially in the US.

37317 0

Reposted by Bruce (Zhi) Wen

Maike Osborne @maosbot.bsky.social · 15/03/2026

Today is Long Covid Awareness Day: I know there’s a lot going on in the world right now, but please don’t scroll past this one! en.wikipedia.org/wiki/Long_CO...

A poster, with text:

LONG COVID:
EVERY HEARTBEAT COUNTS

FIBROSIS
NECROSIS
PERICARDITIS
MYOCARDITIS
HYPERTENSION
HEART FAILURE
FIBRILLATION
HEART ATTACK
THROMBOSIS
VESSEL DAMAGE
ARRHYTHMIA
And more...

Every COVID infection can cause damage.
High quality masks can help protect you.
#LongCovid
#LongCovidHeartbeats #LongCovidAwareness

813857 0

Reposted by Bruce (Zhi) Wen

Naomi Saphra @nsaphra.bsky.social · 13/03/2026

Every time you read an old paper you find out the author somewhere was like “this was funnily enough inspired by a conversation with my lovely sweet little wife who also happens to have a PhD in the same topic”

1145 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 05/03/2026

Excited to share the latest Olmo model: Olmo Hybrid. This is a model with gated delta net (GDN) layers in a 3:1 ratio with full attention. It follows lots of other developments like Qwen 3.5 and Kimi Linear.

6678 0

Reposted by Bruce (Zhi) Wen

Aldozzzzz @az-mtl.bsky.social · 27/02/2026

Our freshly accepted CVPR 2026 paper is up on arxiv 😍. Project page, open code and more detailed post coming soon! « CLIP is Shortsighted: Paying Attention Beyond the First Sentence ». #CVPR

arxiv.org

CLIP Is Shortsighted: Paying Attention Beyond the First Sentence

CLIP models learn transferable multi-modal features via image-text contrastive learning on internet-scale data. They are widely used in zero-shot classification, multi-modal retrieval, text-to-image d...

091 0

Reposted by Bruce (Zhi) Wen

Nathan Lambert @natolambert.bsky.social · 03/03/2026

Lots of core team members of Alibaba Qwen are resigning publicly on X. The gaping hole that Qwen imploding would leave in the open research ecosystem will be hard to fill. The small models are irreplaceable. I’ll do my best to keep carrying that torch. Every bit matters.

310412 0

Reposted by Bruce (Zhi) Wen

Kyle Lo @kylelo.bsky.social · 13/02/2026

our paper on data mixing for LMs is out! while building Olmo 3, we saw gaps between data mixing literature and real practice 🐠choosing proxy size, # runs, sampling, regression, constraints.. 🐟data shifts during LM dev: can we reuse past experiments? Olmix tackles them all!

1294 0

Reposted by Bruce (Zhi) Wen

Sung Kim @sungkim.bsky.social · 11/02/2026

@karpathy.bsky.social 's microgpt.py Train and inference GPT in 243 lines of pure, dependency-free Python. gist.github.com/karpathy/862...

gist.github.com

microgpt

microgpt. GitHub Gist: instantly share code, notes, and snippets.

18615 0

Reposted by Bruce (Zhi) Wen

Margaret Mitchell @mmitchell.bsky.social · 02/02/2026

Without her work, the “intricately accurate” navigation and timing of GPS would not have been possible. ❤️

35020 0

Reposted by Bruce (Zhi) Wen

Ai2 @ai2.bsky.social · 28/01/2026

Introducing Theorizer: Turning thousands of papers into scientific laws 📚➡️📜 Most automated discovery systems focus on experimentation. Theorizer tackles the other half of science: theory building—compressing scattered findings into structured, testable claims. 🧵

1348 0

Reposted by Bruce (Zhi) Wen

Marc Lanctot @sharky6000.bsky.social · 15/01/2026

Hello all! 👋 I’m delighted to share a 🚨 new preprint 🚨: “Active Evaluation of General Agents: Problem Definition and Comparison of Baseline Algorithms”. A paper thread! 🤩📄🧵 1/N

25712 0

Reposted by Bruce (Zhi) Wen

hardmaru @hardmaru.bsky.social · 12/01/2026

One of my favorite findings: Positional embeddings are just training wheels. They help convergence but hurt long-context generalization. We found that if you simply delete them after pretraining and recalibrate for <1% of the original budget, you unlock massive context windows. Smarter, not harder.

821732 0

Reposted by Bruce (Zhi) Wen

Sung Kim @sungkim.bsky.social · 09/01/2026

"They showed the dead fish pictures of humans in social situations and "asked" the fish to determine the emotions of the people. When they ran their standard statistical software, the results showed "brain activity" in the fish that correlated with the emotions.

1317 0

Reposted by Bruce (Zhi) Wen

Jeff Dean @jeffdean.bsky.social · 07/01/2026

Please welcome Google's Open Source efforts to Blue Sky at @opensource.google!

724740 0

Bruce (Zhi) Wen @zhi-bruce-wen.bsky.social · 31/12/2025

Btw Howtown has been doing really solid videos on interesting topics and has become one of my favourite channels of all YouTube.

000 0

Reposted by Bruce (Zhi) Wen

Jay Hulme @jayhulmepoet.bsky.social · 29/12/2025

Just watched the new Knives Out and I think it's really important you know that the scene in the Seminary's Gym is filmed in the same place Rick Astley filmed the music video for Never Gonna Give You Up. I saw the window tracery and immediately made my friends pause the film so I could tell them.

A screenshot from Rick Astley's Never Gonna Give you up music video

A photograph of the seminary gym in knives out. It has the same window.

420288707294 0

Reposted by Bruce (Zhi) Wen

Yoshua Bengio @yoshuabengio.bsky.social · 19/12/2025

OpenReview is a pillar of progress in the AI research community. Now it needs our support. Along with several of my colleagues, I have pledged to help, and I encourage anyone who can to do the same. openreview.net/donate

openreview.net

OpenReview

Promoting openness in scientific communication and the peer-review process

1296 0