Sign in

Bufan Gao

@bufangao.bsky.social
8 followers 3 following 4 posts

Psychology PhD student @UChicago 🔗 jouisseuse.github.io

PostsRepliesMedia
Bufan Gao @bufangao.bsky.social · 11/09/2025
🚨 New #EMNLP2025 paper! Do LLMs exhibit distinct behavior when the prompt looks similar to common evaluation prompts? 👀 We show that prompts that signal bias evaluation can flip the measured bias. See below ⬇️
Violin plots of Probability of Pronoun Shift. Models show significant sensitivity to prompt changes: when prompts highlight gender evaluation, pronoun use shifts, with decreased “he” and increased “they” use.
131