@bradknox.bsky.social, @brianchristian.bsky.social, and Serena Booth argue that a key cause of the OpenAI–Hugging Face incident was overlooked: ExploitGym’s overly simple evaluation metric was itself misaligned. They discuss techniques that could help avoid this in future.
Link below ⬇️
humancompatible.ai
An unexamined cause of the OpenAI Hugging Face hacking incident: its binary performance metric – Center for Human-Compatible Artificial Intelligence