iiinova — where your digital self keeps evolving

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 30/06/2026

We are launching a new blog; Reliable-AI.Review. First post is up: On the Impossibility of Mitigating AI Jailbreaks.

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 16/02/2026

LLMs are largely memory bound! Tokenizers can eat >30% of on‑device memory for small (<1B) models, because we reuse the huge vocabularies from big models. Our method lets you distill large models into small ones with much smaller vocabulary, reducing overall memory footprint.

1151

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 10/12/2025

If “getting started with agents” feels like setup hell — same. So we made a starter tutorial: First agent running in <14 minutes, no Docker/AWS. Laptop + API key only. 👇 www.youtube.com/watch?v=gzNW...

youtube.com

Starting with LLM Agents: Installing and Running OpenApps

YouTube video by Dr. Karen Ullrich - Machine Learning Research

020

Reposted by Karen Ullrich (s/h)

Mark Ibrahim @markibrahim.bsky.social · 10/12/2025

Want to teach AI agents to use apps like humans? Get started with digital agents research using OpenApps, our new Python-based environment.

133

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 10/12/2025

Release Day 🎉 Meet OpenApps — a pure-Python, open-source ecosystem for stress-testing UI agents at scale. Runs on a single CPU. Generates thousands of unique UI variations. And it reveals just how fragile today’s SOTA agents are. (Yes, even GPT-4 and Claude struggle.)

150

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 03/12/2025

Excited to be attending NeurIPS 2025 — my 10-year anniversary since I first walked into NeurIPS back in 2015, just before starting my PhD in Amsterdam. Grateful for a decade of learning, growing, and being part of this incredible community. If you’re around this year, would love to meet.

060

Reposted by Karen Ullrich (s/h)

Mark Ibrahim @markibrahim.bsky.social · 09/10/2025

One can manipulate LLM rankings to put any model in the lead—only by modifying the single character separating demonstration examples. Learn more in our new paper arxiv.org/abs/2510.05152 w/ Jingtong Su, Jianyu Zhang, @karen-ullrich.bsky.social , and Léon Bottou. 🧵

1313

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 06/10/2025

Y’all, I am at #COLM this week, very excited to learn, and meet old and new friends. Please reach out on Whova!

050

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 08/07/2025

How would you make an LLM "forget" the concept of dog — or any other arbitrary concept? 🐶❓ We introduce SAMD & SAMI — a novel, concept-agnostic approach to identify and manipulate attention modules in transformers.

1141

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 01/05/2025

Aligned Multi-Objective Optimization (A-🐮) has been accepted at #ICML2025! 🎉 We explore optimization scenarios where objectives align rather than conflict, introducing new scalable algorithms with theoretical guarantees. #MachineLearning #AI #Optimization

092

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 22/01/2025

🎉🎉 Our paper just got accepted to #ICLR2025! 🎉🎉 Byte-level LLMs without training and guaranteed performance? Curious how? Dive into our work! 📚✨ Paper: arxiv.org/abs/2410.09303 Github: github.com/facebookrese...

Screenshot of arxiv paper "EXACT BYTE-LEVEL PROBABILITIES FROM TOKENIZED LANGUAGE MODELS FOR FIM-TASKS AND MODEL ENSEMBLES."

0120

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 12/12/2024

Thursday is busy: 9-11am I will be at the Meta AI Booth 12.30-2pm Mission Impossible: A Statistical Perspective on Jailbreaking LLMs (neurips.cc/virtual/2024...) OR End-To-End Causal Effect Estimation from Unstructured Natural Language Data (neurips.cc/virtual/2024...)

neurips.cc

NeurIPS Poster Mission Impossible: A Statistical Perspective on Jailbreaking LLMsNeurIPS 2024

030

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 11/12/2024

Starting with Fei-Fei Li’s talk 2.30, after that I will mostly be meeting people and wonder the poster sessions.

050

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 10/12/2024

Folks, I am posting my NeurIPS schedule daily in hopes to see folks, thanks @tkipf.bsky.social for the idea ;) 11-12.30 WiML round tables 1.30-4 Beyond Decoding, Tutorial

150

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 06/12/2024

I will be at #Neurips2024 next week to talk about these two papers and host a workshop on #NeuralCompression.

030

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 28/11/2024

Pro-tip: Use massive black Friday deals at scientific publishing houses to for example buy a copy of @jmtomczak.bsky.social book on generative modeling (long overdue)

1100

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 30/10/2024

#Tokenization is undeniably a key player in the success story of #LLMs but we poorly understand why. I want to highlight progress we made in understanding the role of tokenization, developing the core incidents and mitigating its problems. 🧵👇

10337

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 30/09/2024

🚨 Internship Opportunity at FAIR NY 🚨 I got one PhD internship position available for 2025! Interested in exploring the intersection of information theory, probabilistic reasoning, and LLMs? 📩 Send me a DM with your CV, website, and GScholar profile by October 14th.

021

Karen Ullrich (s/h) @karen-ullrich.bsky.social · 26/09/2024

🎉 Exciting News! 🎉 Two papers have been accepted at #NeurIPS2024 ! 🙌🏼 These papers are the first outcomes of my growing focus on LLMs. 🍾 Cheers to Nikita Dhawan and Jingtong Su + all involved collaborators: @cmaddis.bsky.social Leo Cotta, Rahul Krishnan, Julia Kempe

030