Reposted by Kellin Pelrine
1/ Open-weight AI models often refuse harmful requests... until you “put a few words in their mouth.”
We conducted the largest study of prefill attacks, and found that state-of-the-art models are consistently vulnerable, with attack success rates approaching 100%.
