iiinova — where your digital self keeps evolving

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 05/10/2026

How much network bandwidth do you need? The answer is: more! Maia 200 tops the record with 1.4 TB/s (full duplex) Ethernet bandwidth per chip. More than 1.5× over NVLink 5 (Blackwell). It turns out that "bidirectional" was doing quite a bit of work in NLink's 1.8 TB/s number #HPC #AI #Accelerator

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 30/09/2026

When AI, HPC, and Quantum meet at SC Asia 2027 in SIngapore. 📢 Due to popular demand, the paper submission deadline has been extended. We invite the community's very best papers. 🔗 buff.ly/oRS1TE1 #SCA27 #Supercomputing #AI #HPC #QuantumComputing #Singapore

032

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 28/09/2026

"Everything verifiable will be automated." Mathematics is far more than proving theorems. For young researchers, the opportunity is clear: build the automation, write the specifications, and develop the verification tools. My HLF spark talk: buff.ly/mCW9JI2

020

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 24/09/2026

Industry reacted quickly. From lossy packet delivery to reliable multipath spraying: Multipath Reliable Connection (MRC) turns many "Issues at Hyperscale" into engineering solutions. buff.ly/NH2FvrQ buff.ly/pueSosc buff.ly/QpvkyJ0 On the path to Ultra Ethernet. #AI #HPC #Networking

021

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 22/09/2026

AI and Mathematicians - all stages of grief on a single panel. As Turing Award winner Whitfield Diffie put it, "I am very concerned with you people's concern over intellectual property." A collision of proofs, probability, scaling laws, and strong opinions. An experience! > 27k views in 5 days.

120

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 14/09/2026

We keep talking about flop/s. Maybe we should talk about flop/s per square millimeter. Maia 200 achieves ~12 Tflop/s FP4 (6 FP8) in just 1 mm², roughly the size of a grain of salt. When data movement dominates energy consumption, compute density becomes a first-class design objective. #AI #HPC

041

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 09/09/2026

Digital for Good: What if climate predictions could be generated 1,000× more efficiently and with 1,000× less CO₂? In this interview, Fanny Lehmann and the ESFM team explain how AI foundation models are transforming weather forecasting. buff.ly/Il8H4Td buff.ly/yRF5Txv #ClimateAI #AIforScience

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 07/09/2026

Send your best papers to SC Asia before the end-of-month deadline! 🚀 SC Asia is among the flagship international forums for breakthroughs in supercomputing, AI infrastructure, system architecture, networking, quantum, cloud and scientific computing. buff.ly/3C7EUpz #SCAsia #Supercomputing #HPC

051

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 02/09/2026

Most filtered vector search benchmarks rely on outdated datasets. SPCL student Patrick presents arxiv-for-fanns: a new benchmark with 2.7M modern embeddings concludes: There is no universally best filtered ANN algorithm. 📖 buff.ly/hHvx0bl 📽️ buff.ly/r1ERkxb #VectorSearch #RAG #ANN #Databases

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 31/08/2026

Nothing beats chatting and traveling with president Ramos-Horta, talking to the next generation in Timor-Leste, and discussing deep topics about #AI for education and development with Turing Awardees and Nobel Laureates on tropical islands. buff.ly/n0V8ikW

020

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 26/08/2026

We presented how Maia 200's Software-Define Dataflow delivers highest inference performance for production LLMs in Microsoft's fleet at #HotChips26 today. We also released the full paper with many details on arXiv: buff.ly/KJ8yMOp And a blog post: buff.ly/TsrPppe

011

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 17/08/2026

This Thursday at Hot Interconnects #HOTI26: "Demystifying NVSHMEM". Learn how the old #HPC PGAS and symmetric heap concepts nicely accelerate GPU communications 🚀 Reminiscient of our earlier dCUDA paper that turns 10 years now! Great to see concepts productized 🤗 buff.ly/K4aRYqz buff.ly/Z9mHPso

031

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 14/08/2026

Samantika Sury from HPE talks about Macro-Heterogeneity for #AI for #Science at #ModSim26. “A system with diverse hardware should logically look like a unit to applications”. Totally agreed why do we always expose the guts in #HPC 😊? Glad to collaborate through SPCL!

020

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 14/08/2026

"Messages matter packets don't" - learn how our work on Multipath Reliable Connection (MRC) at #HOTI26 shifts to an application-centric view. Join us online next Wednesday 1pm PDT with Rip Sohan (AMD) and Eric Spada (BRCM)! A bigstep towards Ultra Ethernet! buff.ly/K4aRYqz buff.ly/NIZXU9A

040

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 13/08/2026

At #ModSim26, Jeff Vetter highlighted DOE's ambitious goal: 150-250 fault-tolerant logical qubits by 2028 at ≤10⁻⁸ logical error rate. The science is remarkable, but the real story is that #Quantum computing is becoming an engineering discipline - excited to share some new architecture ideas soon.

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 12/08/2026

Hal Finkel highlights at #ModSim26 how the U.S. Department of Energy will converge #HPC, simulation, and #AI pushing 20% of its budget into compute infrastructure. Looking forward to my panel on how Agentic AI will reshape science, engineering, and discovery. #AI #AgenticAI #Accelerate #Science

022

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 10/08/2026

It seems like “linear attention” now means almost anything—as long as there’s an O(L) somewhere in the paper 🙃. Linear compute? Memory capacity? Memory traffic? Those are three different bills, and our accelerators pay all of them 💰️. My plea: show me all three: buff.ly/Yd35IUv

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 27/07/2026

Honored that our paper won the 2025 IEEE TPDS Best Paper Award! buff.ly/4AiBN0S The main idea is to use differential analysis on dependence graphs to causally determine root causes of performance issues. Credits to Yuyang for the hard work, Jidong for leadership, and to all of our co-authors!

053

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 09/07/2026

A successful week at #ICML26 is nearing its end: Learn about (1) weather model scaling laws from Yuejiang, (2) near-optimal quantization from Jiale, (3) sparse data scaling laws from Boqian, (4) a cool algorithm for sparse training from Qiao, and (5) process reward agents from Jiwoong, Tomasz et al

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 06/07/2026

It was great attending the 75th Lindau Nobel Laureate Meeting last week. I'm very much looking forward to deliver the Heidelberg Plenary Lecture in #AI next year at the 76th! Congratulations to both Peter and Nikolaus for receiving those special honors.

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 25/06/2026

Big congrats to our Racklette team for the 1st prize in the #ISC26 student cluster competition. Switzerland is back, very proud of this repeated success!! Thanks to Hussein and CSCS for the strong support. Look at that big golden trophy for the future leaders in #AI and #HPC!

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 24/06/2026

Saverio presents the #ISC26 Hans Meuer award paper. Selecting and tuning collective operations is not simple. Need to consider various systems effects, for example, load on global vs. local links and different phases. Also using ATLAHS #HPC for selection isc-hpc.com/isc-high-per...

012

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 24/06/2026

This year's Jack Dongarra award goes to Devesh Tiwari. He starts his talk with an hommage to Jack and then lures the audience into quantum computing. Well done 😀.

011

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 24/06/2026

Kudos to ETH Zurich's team RACKlette competing at the #ISC26 conference. Next generation #HPC and #AI experts are competing at one of the most prestigious international venues. Learn about the team at buff.ly/ZFBJRSh Wish them all luck!! Fight hard to win!

020

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/06/2026

Surprise: Chinese LineShine supercomputer takes the #1 spot on the #Top500 and #HPCG lists! First time since a while that spot is taken by a homogeneous CPU machine. So is heterogeneity here to stay? CPUs with HBM and tensor cores (e.g., ARM SME). Congrats Yutong and folks.

032

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/06/2026

Martin Schulz from TUM says "heterogeneity is here to stay" and highlights several approaches like quantum, neuromorphic, and ofc. GPUs. Quantum and all of those are #HPC and that's what we're here for at #ISC26! Great opening. We may see a surprise here in an hour 😉.

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 18/06/2026

At #AI4X, Michele Ceriotti questions inductive biases even in material sciences, calling "Let them learn". An interesting hypothesis also in other sciences. I will give an overview of AI for Science in Climate Sciences, one of the hardest to validate. Join us tomorrow 9am! #AI and #HPC

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 16/06/2026

Arrived at #AI4X in Singapore for Chorh Chuan Tan's opening remarks setting the stage for AI for Science as an accelerator. "Nations not using AI in Science will likely fall behind". SG will "converge science" with computation and AI through autonomous labs. What a time to be in #HPC and #AI

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 15/06/2026

News from Jensen Huang @ Build: "Microsoft deployed the largest number of Grace Blackwells in the world today." Kudos to the team for the elegant network with MRC, a step towards UE - enabling very large, cost-effective, and resilient deployments. buff.ly/7WtYXiL buff.ly/rZGTEqm [29:45ff]

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 04/06/2026

Big announcements on MS Build 💪: Maia 200 now online in Iowa and Arizona, going international soon - at 30% better TCO than best GPUs! Big success for our SDLA architecture. 🚀 Running GPT-5.5/copilot and MAI's thinking model achieves 1.4x perf/W vs. GB200! 👏 buff.ly/WuGgZm4 (22:40 and 1:55:17)

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 28/05/2026

After a nice early morning run, #SciFM26 in Chicago continues. Rafael shows how many physics models actually learn the same representations in their latent space if you compare proximity of embeddings. Next: my panel on the disappointment of physical biases and priors in climate foundation models.

001

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 27/05/2026

Just arrived at SciFM in Chigago. First thing I hear from the panel is great: "Agents are the new programming. They form their own language and system stack. And we computer scientists should contribute the algorithms." 💯, we also need to develop the best architectures! #HPC

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/05/2026

Mateo Valero discusses history of vector architectures: Back to the Future in #HPC and #AI. He also mentions the three quantum computers connected to an NVIDIA Blackwell system in BSC's chapel ⛪️. Ending his talk looking for a future site 😀.

052

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/05/2026

Taisuke Boku follows on another interesting note: Japan is "changing lanes" from CPU to GPU and from "Made in Japan" to a collaborative "Made with Japan", partnering Fujitsu with NVIDIA. "We don't chase fp64 performance but focus on #AI flops". Onward!

042

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/05/2026

Yutong Lu reveals the LineShine exascale architecture for #HPC - #AI convergence: 2 exaflop sustained fp64 at 40 MW with 1.34 million ARM CPUs using SME and 4TB/s HBM connected with 800G. From "offline to online acceleration with SME".

063

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 23/05/2026

Jack Dongarra's opening keynote at HACI 2026! #HPC in transition - the investments in compute infrastructure are unprecedented but focus mostly on #AI workloads. Scientific numerical simulations need to adjust! Many interesting challenges ahead.

012

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 01/05/2026

The future is here on my way back from Salishan. My air office is a bit narrow but with both faster Internet than at home and a better view. Very well done Starlink and United! Now, Swiss and Lufthansa - time to catch up :-).

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 30/03/2026

Are you also frantically working on your submission to Supercomputing #SC26? Make sure to follow the scientific benchmarking guidelines to ensure interpretability and good style. Don't miss any of the 12 rules for #HPC and #AI systems benchmarking. buff.ly/Ibqwe4N

041

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 10/03/2026

Was nice attending Koc University's #AI Symposium this week - thanks for having me! Lots of opportunity to connect and meet old and new friends while catching up with Didem Unat and her group on emerging #HPC and #AI systems research. buff.ly/szKlUPR

031

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 04/03/2026

"Shock! Shock!" is how the "Father of the Analysis of Algorithms" Don Knuth described an interaction with Claude, proving an open problem he worked on for weeks #HPC and #AI compute enables the unthinkable and begins to automate the scientific method and human (?) progress 🚀 Full buff.ly/olgx1sX

061

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 02/03/2026

Congratulations to Marcin Chrapek for his successful PhD defense 🎓️. SPCL's 15th doctoral graduate released into the wild to do all kinds of good. Study his papers to learn about confidential #HPC and secure #AI systems! Thanks to all committee members for their insightful comments and presence.

040

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 24/02/2026

Last reminder 🚨 . Only two days left to nominate your favorite young researcher in #HPC for the Jack Dongarra early career award! One of the highest awards for young researchers in the field on honor of our dear friend Jack 🎓️. buff.ly/zJHvUUO

022

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 20/02/2026

Thanks Philipp for another proud advisor moment! The committee explicitly highlighted the well delivered defense - congratulations 🎉. SPCL's 14th PhD graduate released to the wild to make the #HPC and #AI computational world a better/faster/more efficient place.

000

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 05/02/2026

It's always exciting when research topics receive attention on national TV. CNA, one of Asia's premier TV stations reports on Singapore's $1bn AI for Science and highlights our AI for Health collaboration with Ben Helgason and Bryan Tan, part of my AI Visiting Professorship! Watch: buff.ly/28Ck77Q

030

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 28/01/2026

Rio Yokota on the #SCA2026 fishbowl panel: "I don't think humans are in any way more trustworthy than an advanced AI" - "In the same way we trust other humans, we could develop trust to AIs" - "If people or AI generate code - how do we know there is no bug inside?" profound thoughts by a wise man.

011

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 26/01/2026

On the way to SCAsia 2026 in Japan! I'm honored to present the opening keynote to this year's record attendance of more than 2,500 people :-). I'm thrilled to talk about Ultra Ethernet's technical highlights. Including a bit surprise reveal 🎉! Looking forward to see many of you in Osaka this week!

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 25/01/2026

Exciting Singapore AI Research Week Gala Dinner. I was honored to spend an insightful evening sitting next to the guest of honor - Josephine Teo, Minister for Digital Development and Information. A remarkable person! Fun to also meet my AI Visiting Professor partners – Bryan Tan 🏥 and Jingyu Wang 🌏

022

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 21/01/2026

Our discussion of challenged and opportunities with in-network collective communication for #AI has been featured in IEEE Computer's January issue 📖. Check out page 24ff! It currently tops the list of trending articles 🚀. Check it out: buff.ly/sz4yGzk #HPC #Networking

021

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 12/01/2026

The "best #GYSS25" came to an end. Ideas and experiences are still buzzing in my head 🧠. Thanks for the great organization! We had my lecture on the first day and ended on Jack Dongarra's #HPC lecture - #AI and #HPC 🤖 :-) My talk is already online 🎥: buff.ly/WyToOgm . Jack's will follow soon.

010

Torsten Hoefler 🇨🇭 @thoefler.bsky.social · 06/01/2026

I am honored to be named IAS Lee Kong Chian Distinguished Professor at the Nanyang Technological University (NTU) Singapore and give a public lecture today 03.15 PM - 05.40 PM in SHHK Auditorium (HSS) at NTU. buff.ly/JQMSRcf I will talk about #AI for #Climate - join us if you're around!

020