Hersh Gupta
@hershgupta.com
1.3K followers 447 following 219 posts
Applied Scientist, Responsible AI @BCGX | @bostonu.bsky.social alum | Data, AI, and strategy enthusiast | Open-source contributor Opinions are my own #bikeboston #coys 📍DC -> BOS
Applied Scientist, Responsible AI @BCGX | @bostonu.bsky.social alum | Data, AI, and strategy enthusiast | Open-source contributor Opinions are my own #bikeboston #coys 📍DC -> BOS
![[1] Anthropic verified that BPJ is the first fully automated black-box attack they are aware of to succeed in the Constitutional Classifiers setting and would have met the universal jailbreak bar described in their bug bounty program. We note that BPJ required months of research and development effort, while Constitutional Classifiers is designed to resist jailbreaking by lower skilled actors who may be on smaller query budgets, devote less time to attack development, and struggle to implement the details of BPJ.
[2] OpenAI verified that BPJ is also the first automated attack they are aware of to succeed against OpenAI's input classifier for GPT-5 without relying on human seed attacks. We note that development and execution of BPJ occurred on accounts not subject to enforcement actions like banning; on standard accounts, repeated flags would likely lead to account banning, an example of the batch-level monitoring we recommend.](https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:7obcdkmaphcucglm3a777gct/bafkreic4olmomuq4b34senxg7wibimrswdhtz63xcymeak44h5wmcpmgju)