Sign in

Marlene Lutz

@marlutz.bsky.social
77 followers 108 following 11 posts

Phd student @ University of Mannheim | Social NLP | she/her

PostsRepliesMedia
Marlene Lutz @marlutz.bsky.social · 14/10/2026
Whether you’re in academia, industry, or somewhere in between, at the start of your career or well established, we want to hear your perspective! We’ll synthesize the findings to facilitate a discussion at #EMNLP2026 and share the aggregated results with the community.
000
Marlene Lutz @marlutz.bsky.social · 14/10/2026
📊 How do people in NLP build their careers, and what shapes those decisions? We’re running a survey on career paths in NLP and we'd love to hear from you! The survey is anonymous and takes only 10-5 minutes: 👉 acpaths.ims.uni-stuttgart.de With @esradonmez.bsky.social and @morlikow.bsky.social
acpaths.ims.uni-stuttgart.de
NLP Career Paths and Challenges — Survey
153
Reposted by Marlene Lutz
Georg Ahnert @ahnert.eurosky.social · 31/07/2026
This morning at #ic2s2 I have the chance to present ongoing work on applying a SEM from survey methods to LLM text annotations: 👉 Evaluating LLM Text Annotations Without Ground Truth 📍10:45, Mansfield (210), Understanding LLMs w/ @maximiliankreutner.bsky.social Alex Cernat & @mstrohm.bsky.social
Scatterplot that shows high correlation (r=0.97) and high NDCG@10 between estimated and true annotator quality for data from the Manifestos project
0174
Reposted by Marlene Lutz
MilaNLP Lab @milanlp.bsky.social · 10/07/2026
@milanlp.bsky.social x #WomeninAI
0265
Reposted by Marlene Lutz
MilaNLP Lab @milanlp.bsky.social · 25/06/2026
For today's reading group, @marlutz.bsky.social presented "State media control influences large language models" by Waight et al. (2026) Paper: www.nature.com/articles/s41... #NLProc
073
Reposted by Marlene Lutz
MilaNLP Lab @milanlp.bsky.social · 21/04/2026
We are delighted to welcome @marlutz.bsky.social to our lab over the next few months! 🎉 She'll work on the representation of different demographic groups in LLMs. #NLProc
0248
Reposted by Marlene Lutz
Nicolai Berk @nicolaiberk.bsky.social · 27/02/2026
🚨 TADA Speaker Series Spring 2026 schedule is here! 🚨 We've assembled a fantastic lineup of researchers exploring the future of survey research in the age of LLMs. Mar 18 - May 27, online at 17:00 CEST. Join us! More info & signup: tada.cool
An image of the schedule with speaker images. You can find the full schedule on tada.cool.
03722
Marlene Lutz @marlutz.bsky.social · 12/03/2026
Survey-style tests developed for humans may not predict how LLMs actually behave. Our #EACL2026 paper shows they can even be misleading when measuring racism and sexism! Check out the paper 👇🏼
021
Reposted by Marlene Lutz
Martin Tutek @mtutek.bsky.social · 07/11/2025
Very honored to be one out of seven outstanding papers at this years' EMNLP :) Huge thanks to my amazing collaborators @fatemehc.bsky.social @anamarasovic.bsky.social @boknilev.bsky.social , this would not have been possible without them!
2236
Marlene Lutz @marlutz.bsky.social · 04/11/2025
👋🏼 I'm at #EMNLP2025 presenting "The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for LLMs" 🕑 Thu. Nov 6, 12:30 - 13:30 📍 Findings Session 2, Hall C3
052
Marlene Lutz @marlutz.bsky.social · 31/10/2025
📄 Paper: arxiv.org/abs/2507.16076 Come chat with me about this at #EMNLP2025! Huge thanks to my amazing collaborators @indiiigo.bsky.social, @wanlo.bsky.social, @ Elisa Rogers, and @mstrohm.bsky.social! 7/7
arxiv.org
The Prompt Makes the Person(a): A Systematic Evaluation of Sociodemographic Persona Prompting for Large Language Models
Persona prompting is increasingly used in large language models (LLMs) to simulate views of various sociodemographic groups. However, how a persona prompt is formulated can significantly affect outcom...
020
Marlene Lutz @marlutz.bsky.social · 31/10/2025
🌍 When simulating Hispanic personas, several LLMs spontaneously switched to Spanish — a pattern not seen for other groups. This is the first systematic evidence of language-switching bias in persona prompting! 6/7
100
Marlene Lutz @marlutz.bsky.social · 31/10/2025
📉 Bigger ≠ better. Across all tasks and measures, larger models performed worse than smaller ones—sometimes even showing lower opinion alignment than a random baseline. 5/7
110
Marlene Lutz @marlutz.bsky.social · 31/10/2025
📊Interview-style prompting also significantly improves alignment with real-world survey data! 4/7
110
Marlene Lutz @marlutz.bsky.social · 31/10/2025
💡The good news: Interview-style prompting (Q&A format) and name-based priming (using culturally associated names instead of explicit labels) consistently: ✅ Reduces stereotyping ✅ Improves diversity of responses 3/7
100
Marlene Lutz @marlutz.bsky.social · 31/10/2025
⚖️LLMs still fall short when simulating marginalized identities. Simulations of nonbinary, Hispanic, and Middle Eastern personas are more stereotyped and less diverse than those of other groups. 2/7
100
Marlene Lutz @marlutz.bsky.social · 31/10/2025
🚨New paper alert🚨 🤔 Ever wondered how the way you write a persona prompt affects how well an LLM simulates people? In our #EMNLP2025 paper, we find that using interview-style persona prompts makes LLM social simulations less biased and more aligned with human opinions. 🧵1/7
1143
Reposted by Marlene Lutz
Indira Sen @indiiigo.bsky.social · 29/07/2025
👋 #ACL2025NLP 🇦🇹 @marlutz.bsky.social and I are presenting our poster on demographic representativeness of LLMs today! 🕦 10:30-12:00 📍 Hall X5 (board 1 or 14 according to different sources 🧐) Here’s the paper on ACL anthology: aclanthology.org/2025.finding... Drop by!
aclanthology.org
Missing the Margins: A Systematic Literature Review on the Demographic Representativeness of LLMs
Indira Sen, Marlene Lutz, Elisa Rogers, David Garcia, Markus Strohmaier. Findings of the Association for Computational Linguistics: ACL 2025. 2025.
0227
Reposted by Marlene Lutz
Indira Sen @indiiigo.bsky.social · 21/07/2025
Joint work w/ @marlutz.bsky.social, Elisa Rogers, @dgarcia.eu and @mstrohm.bsky.social You can find our code and annotated dataset of papers here: github.com/Indiiigo/LLM... We annotated way more things, e.g., LLM used, response format, so please check it out! 5/5
github.com
GitHub - Indiiigo/LLM_rep_review: Systematic Review of the Demographic Representativeness of LLMs
Systematic Review of the Demographic Representativeness of LLMs - Indiiigo/LLM_rep_review
022