iiinova — where your digital self keeps evolving

Reposted by Maksym Andriushchenko

ELLIS Institute Tübingen @ellisinsttue.bsky.social · 12/02/2026

Are AI systems learning to “game” their safety tests? The UK’s Department for Science, Innovation and Technology has awarded a grant to Principal Investigators Sahar Abdelnabi, @maksym-andr.bsky.social, and @jonasgeiping.bsky.social. Find out more: institute-tue.ellis.eu/en/news/elli...

institute-tue.ellis.eu

ELLIS Institute PIs supported by UK government to research AI safety

052

Reposted by Maksym Andriushchenko

ELLIS Institute Tübingen @ellisinsttue.bsky.social · 08/01/2026

The ELLIS Institute is proud to announce that Coefficient Giving is supporting our Principal Investigator Maksym Andriushchenko with a grant of $1,000,000 to fund his research on AI safety. Find out more on our website: institute-tue.ellis.eu/en/news/pi-m...

institute-tue.ellis.eu

PI Maksym Andriushchenko awarded funding from Coefficient Giving

051

Reposted by Maksym Andriushchenko

ELLIS @ellis.eu · 02/12/2025

👏 Give a big round of applause to our 2025 PhD Award Winners! The two main winners are: @zhijingjin.bsky.social & @maksym-andr.bsky.social. Two runners-up were selected additionally: Siwei Zhang & Elias Frantar Learn even more about each outstanding scientist: bit.ly/4pm2Eji

0142

Maksym Andriushchenko @maksym-andr.bsky.social · 15/10/2025

🙌 It's been a pleasure to participate in this project alongside so many amazing experts! 3/3

110

Maksym Andriushchenko @maksym-andr.bsky.social · 15/10/2025

This is the first key update before the release of the full report early next year. Both this update and the upcoming report discuss the critically important topics of AI risks and capabilities in a balanced way, carefully weighing all available scientific evidence. 2/3

110

Maksym Andriushchenko @maksym-andr.bsky.social · 15/10/2025

📣 Incredibly excited to participate in writing the International AI Safety Report, chaired by Yoshua Bengio, as chapter lead for the capabilities chapter! ⚖️ AI is progressing so rapidly that yearly updates are no longer sufficient. 1/3

110

Reposted by Maksym Andriushchenko

Johannes Zenn @johanneszenn.bsky.social · 11/09/2025

A new recording of our FridayTalks@Tübingen series is online! AI Safety and Alignment by @maksym-andr.bsky.social Watch here: youtu.be/7WRW8MDQ8bk

youtu.be

AI Safety and Alignment - [Maksym Andriushchenko]

YouTube video by Friday Talks Tübingen

161

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

We believe getting this—some may call it "AGI"—right is one of the most important challenges of our time. Join us on this journey! 11/11

000

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

Taking this into account, we are only interested in studying methods that are general and scale with intelligence and compute. Everything that helps to advance their safety and alignment with societal values is relevant to us. 10/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

Broader vision. Current machine learning methods are fundamentally different from what they used to be pre-2022. The Bitter Lesson summarized and predicted this shift very well back in 2019: "general methods that leverage computation are ultimately the most effective". 9/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

... —literally anything that can be genuinely useful for other researchers and the general public. 8/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

Research style. We are not necessarily interested in getting X papers accepted at NeurIPS/ICML/ICLR. We are interested in making an impact: this can be papers (and NeurIPS/ICML/ICLR are great venues), but also open-source repositories, benchmarks, blog posts, even social media posts ... 7/n

110

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

For more information about research topics relevant to our group, please check the following documents: - International AI Safety Report, - An Approach to Technical AGI Safety and Security by DeepMind, - Open Philanthropy’s 2025 RFP for Technical AI Safety Research. 6/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

We're also interested in rigorous AI evaluations and informing the public about the risks and capabilities of frontier AI models. Additionally, we aim to advance our understanding of how AI models generalize, which is crucial for ensuring their steerability and reducing associated risks. 5/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

Research group. We will focus on developing algorithmic solutions to reduce harms from advanced general-purpose AI models. We're particularly interested in alignment of autonomous LLM agents, which are becoming increasingly capable and pose a variety of emerging risks. 4/n

120

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

Hiring. I'm looking for multiple PhD students: both those able to start in Fall 2025 and through centralized programs like CLS, IMPRS, and ELLIS (the deadlines are in November) to start in Spring–Fall 2026. I'm also searching for postdocs, master's thesis students, and research interns. 2/n

100

Maksym Andriushchenko @maksym-andr.bsky.social · 06/08/2025

🚨 Incredibly excited to share that I'm starting my research group focusing on AI safety and alignment at the ELLIS Institute Tübingen and Max Planck Institute for Intelligent Systems in September 2025! 🚨 1/n

290

Maksym Andriushchenko @maksym-andr.bsky.social · 19/06/2025

This is joint work with amazing collaborators: Thomas Kuntz, Agatha Duzan, Hao Zhao, Francesco Croce, Zico Kolter, and Nicolas Flammarion. It will be presented as an oral at the WCUA workshop at ICML 2025! Paper: arxiv.org/abs/2506.14866 Code: github.com/tml-epfl/os-...

github.com

GitHub - tml-epfl/os-harm: OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents

OS-Harm: A Benchmark for Measuring Safety of Computer Use Agents - tml-epfl/os-harm

020

Maksym Andriushchenko @maksym-andr.bsky.social · 19/06/2025

Main findings based on frontier LLMs: - They directly comply with _many_ deliberate misuse queries - They are relatively vulnerable even to _static_ prompt injections - They occasionally perform unsafe actions

100

Maksym Andriushchenko @maksym-andr.bsky.social · 19/06/2025

🚨Excited to release OS-Harm! 🚨 The safety of computer use agents has been largely overlooked. We created a new safety benchmark based on OSWorld for measuring 3 broad categories of harm: 1. deliberate user misuse, 2. prompt injections, 3. model misbehavior.

132

Maksym Andriushchenko @maksym-andr.bsky.social · 09/12/2024

Paper link: josh-freeman.github.io/resources/ny.... This is joint work with amazing collaborators: Joshua Freeman, Chloe Rippe, and Edoardo Debenedetti. 🧵3/n

josh-freeman.github.io

060

Maksym Andriushchenko @maksym-andr.bsky.social · 09/12/2024

3. However, the memorized articles cited in the NYT lawsuit were clearly cherry-picked—random NYT articles have not been memorized. 4. We also provide a legal analysis of this case in light of our findings. We will present this work at the Safe Gen AI Workshop at NeurIPS 2024 on Sunday. 🧵2/n

160

Maksym Andriushchenko @maksym-andr.bsky.social · 09/12/2024

🚨Excited to share our new work! 1. Not only GPT-4 but also other frontier LLMs have memorized the same set of NYT articles from the lawsuit. 2. Very large models, particularly with >100B parameters, have memorized significantly more. 🧵1/n

1151

Maksym Andriushchenko @maksym-andr.bsky.social · 07/12/2024

3. Exploring Memorization and Copyright Violation in Frontier LLMs: A Study of the New York Times v. OpenAI 2023 Lawsuit (openreview.net/forum?id=C66...) Thanks to the amazing collaborators for making all these works possible! 🧵4/4

openreview.net

Exploring Memorization and Copyright Violation in Frontier LLMs: A...

Copyright infringement in frontier large language models (LLMs) has received much attention recently due to the case NYT v. Microsoft, filed in December 2023. The New York Times claims that GPT-4...

000

Maksym Andriushchenko @maksym-andr.bsky.social · 07/12/2024

3. Improving Alignment and Robustness with Circuit Breakers (arxiv.org/abs/2406.04313) Workshops: 1. Does Refusal Training in LLMs Generalize to the Past Tense? (arxiv.org/abs/2407.11969) 2. Is In-Context Learning Sufficient for Instruction Following in LLMs? (arxiv.org/abs/2405.19874) 🧵3/4

arxiv.org

Improving Alignment and Robustness with Circuit Breakers

AI systems can take harmful actions and are highly vulnerable to adversarial attacks. We present an approach, inspired by recent advances in representation engineering, that interrupts the models as t...

110

Maksym Andriushchenko @maksym-andr.bsky.social · 07/12/2024

Here are the 6 papers that we are presenting at NeurIPS 2024: Main track: 1. Why Do We Need Weight Decay in Modern Deep Learning? (arxiv.org/abs/2310.04415) 2. JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models (arxiv.org/abs/2404.01318) 🧵2/4

arxiv.org

Why Do We Need Weight Decay in Modern Deep Learning?

Weight decay is a broadly used technique for training state-of-the-art deep networks from image classification to large language models. Despite its widespread usage and being extensively studied in t...

100

Maksym Andriushchenko @maksym-andr.bsky.social · 07/12/2024

📢 I'll be at NeurIPS 🇨🇦 from Tuesday to Sunday! Let me know if you're also coming and want to meet. Would love to discuss anything related to AI safety/generalization. Also, I'm on the academic job market, so would be happy to discuss that as well! My application package: andriushchenko.me. 🧵1/4

andriushchenko.me

Maksym Andriushchenko

I'm a PhD student in computer science at EPFL advised by Nicolas Flammarion. I'm interested in understanding why machine learning works and why it fails.

150

Reposted by Maksym Andriushchenko

Marcel Salathé @marcelsalathe.bsky.social · 06/12/2024

Mindblowing: EPFL PhD student @maksym-andr.bsky.social, winner of best CS thesis award, showed that leading hashtag#AI models are not robust to simple adaptive jailbreaking attacks. Indeed, he managed to jailbraik all models with a 100% success rate 🤯 Jailbraking paper: arxiv.org/abs/2404.02151

lnkd.in

Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks

We show that even the most recent safety-aligned LLMs are not robust to simple adaptive jailbreaking attacks. First, we demonstrate how to successfully leverage access to logprobs for jailbreaking: we...

0121

Maksym Andriushchenko @maksym-andr.bsky.social · 20/11/2024

really feels like Twitter circa 2018. good old days... 😀

0100