Divya Siddarth argues democracy must evolve to constrain AI power before it concentrates beyond public control. Her 70-country research reveals massive cultural divides: 43% would use AI for…

Recent advances have enabled LLM-powered AI agents to autonomously execute complex tasks by combining language model reasoning with tools, memory, and web access. But can these systems be trusted to…

Sarah Schwettmann (Transluce) presents AI oversight that moves beyond preference alignment to continuous safety measurement. Her approach trains specialized oversight agents on vast amounts of…

As practice for potential future Responsible Scaling Policy obligations, we're releasing a report on misalignment risk posed by our deployed models as of Summer 2025. We conclude that there is very…

Dawn Song (UC Berkeley) identifies cybersecurity as one of the biggest AI risk domains, investigating how frontier AI changes the security landscape. Her BountyBench and CyberGym benchmarks…

Yisen Wang (Peking University) demonstrates that post-training doesn't erase safety mechanisms in large language models but masks them with stronger task-specific functions. Through targeted neuron…

Natasha Jaques tackles a critical problem: 1 billion weekly LLM users face zero guarantees against harmful outputs like bomb-making instructions. Her multi-agent reinforcement learning solution uses…

Neel Nanda (Google DeepMind) discussed his mechanistic interpretability team's pivot from ambitious reverse-engineering goals to more pragmatic work that can be empirically validated on today's…

The Alignment Workshop is a series of events convening top ML researchers from industry and academia, along with experts in the government and nonprofit sect...

Adam Gleave, co-founder & CEO of FAR.AI, and former Google DeepMind employee, discusses potential threats AI could pose to humanity, including job losses, and how companies can develop and ensure…

Turing Award winner Yoshua Bengio (MILA, Law Zero) explains why he shifted from pioneering deep learning to warning about its dangers. In this fireside chat with Adam Gleave (FAR.AI), Bengio…

As the capabilities of large language models continue to advance, so does their potential for misuse. While closed-source models typically rely on external defenses, open-weight models must primarily…