Lucy Li @lucy3.bsky.social · 14/10/2026Models are sycophantic, and when they do challenge faulty or incorrect inputs, they're ambiguous and ineffective. In a new paper w/ a multilingual co-author team, we find that people may view LM responses that push back, yet still end up believing false content is true. arxiv.org/abs/2610.17703 0437
Lucy Li @lucy3.bsky.social · 02/08/2026Settling in one place something I haven't experienced for a long time (my phd peers did get things like espresso machines and bed frames but i was always very lazy and wishy washy about it) I am currently buying FURNITURE. my cat hates all of her new trees & beds. she likes human bed 110
Lucy Li @lucy3.bsky.social · 02/08/2026This is the "view" from the floor my office is on, in the computer, data, & info sci building the wood paneling reminds me of swiss cheese 110
Lucy Li @lucy3.bsky.social · 02/08/2026I used to joke that going to Stanford for college w/ palm trees and manicured landscapes was like being on vacation with exams -- summers at UW-Madison have a similar feel. Some evenings are so pretty that these ducks must be paid actors to decorate these lakes also the ice cream is very creamy 2220
Lucy Li @lucy3.bsky.social · 23/06/2026me: "please draw a wisconsin badger hugging a jar of hazelnut spread except instead of the logo being nutella because it's trademarked it is the logo of my new research group" human 👨🎨: 080
Lucy Li @lucy3.bsky.social · 03/03/2026Models’ mistakes may assume correct math solutions. Typically, models are trained on “high quality” math so that they can hill-climb on GSM8k, MATH, etc. However, dev pipelines that favor correct math are tension w/ education, where math errors require extra attention. 101
Lucy Li @lucy3.bsky.social · 03/03/2026We find that this gap is primarily driven by QA related to content description. In addition, VLMs struggle to identify cases when help is needed; the most challenging QA are those related to assessing students’ correctness and errors. 100
Lucy Li @lucy3.bsky.social · 03/03/2026Models are now expert math solvers, and so AI for math education is receiving increasing attention. Our new preprint evaluates 11 VLMs on our QA benchmark, DrawEduMath. We highlight a startling gap: models perform less well on inputs from K-12 students who need more help. 🧵 43512
Lucy Li @lucy3.bsky.social · 19/01/2026ty claude code for helping annotators f̶i̶g̶h̶t̶ ̶e̶a̶c̶h̶ ̶o̶t̶h̶e̶r̶ ̶w̶i̶t̶h̶ ̶m̶o̶r̶e̶ ̶c̶l̶a̶r̶i̶t̶y̶ look at data ... I'm planning to throw this up on github once i test it thoroughly and write artisanal docs for it 926610
Lucy Li @lucy3.bsky.social · 09/01/2026they took away the snowflakes recently. it's still winter outside irl 😦 (in the northern hemisphere at least). miss the little snowy blue fellow 020
Lucy Li @lucy3.bsky.social · 11/11/2025It's the season for PhD apps!! 🥧 🦃 ☃️ ❄️ Apply to Wisconsin CS to research - Societal impact of AI - NLP ←→ CSS and cultural analytics - Computational sociolinguistics - Human-AI interaction - Culturally competent and inclusive NLP with me! lucy3.github.io/prospective-... 15116
Lucy Li @lucy3.bsky.social · 10/11/2025Not to brag too much or anything but after emnlp I got brunch with a llama in Shanghai 1690
Lucy Li @lucy3.bsky.social · 22/10/2025Strangest autocomplete-induced error: I had imported 🐢 and not 🐼 0110
Lucy Li @lucy3.bsky.social · 05/08/2025I just moved and Toast discovered a love for rolling in bathtubs; she had never seen one before now. She also figured out how to open new types of doors, and so my cat-proofing battle continues. 2110
Lucy Li @lucy3.bsky.social · 30/05/2025"Tell, Don't Show" was accepted to #ACL2025 Findings! Our conceptually intuitive, lightweight approach for literary topic modeling combines the new (language models) with the old (classic LDA) to yield better topics. ✨📚 arxiv.org/abs/2505.23166 38413
Lucy Li @lucy3.bsky.social · 05/05/2025I'm joining Wisconsin CS as an assistant professor in fall 2026!! There, I'll continue working on language models, computational social science, & responsible AI. 🌲🧀🚣🏻♀️ Apply to be my PhD student! Before then, I'll postdoc for a year in the NLP group at another UW 🏔️ in the Pacific Northwest 1614514
Lucy Li @lucy3.bsky.social · 25/03/2025A nice diagram from Tsvetkova et al. 2024's "A new sociology of humans and machines" on ways in which "collective outcomes in human-machine social systems differ from those in human-only systems" www.nature.com/articles/s41... 0272
Lucy Li @lucy3.bsky.social · 29/01/2025New @ai2.bsky.social paper accepted to #NAACL2025! We worked with Teaching Lab and ASSISTments to create a new dataset for evaluating VLMs. DrawEduMath includes 2,030 teacher-annotated images of students’ handwritten responses to math problems. Website: drawedumath.org 1265
Lucy Li @lucy3.bsky.social · 09/01/2025i would like to work with my computer monitor but it sets up a cursor catching game for my cat 😑 081
Lucy Li @lucy3.bsky.social · 16/12/2024Today I spelled "chatgpt" so wrong that I later misread it as "chapagetti" 1140
Lucy Li @lucy3.bsky.social · 11/12/2024Each time I do it, I get something different 😅 the interface even said I am "special" and require extra data for them to make their predictions 140
Lucy Li @lucy3.bsky.social · 11/12/2024I tried this "accent guesser" by a service which claims to be "the fastest way to sound like a native English speaker." start.boldvoice.com/accent-guesser 🤔 ... I grew up in a Mandarin-speaking household in suburban Minnesota. What's happening behind the scenes? Why do I sound "Persian"? 3202
Lucy Li @lucy3.bsky.social · 14/10/2024Education & NLP. Education is a domain where NLP, and AI generally, could achieve substantial positive social impact if done responsibly. My work bridges digital humanities w/ education and designs tasks and evaluation frameworks for AI models w/ educators. 141
Lucy Li @lucy3.bsky.social · 14/10/2024Equitable NLP. I question societal defaults: what are the default representations of people in models and media (e.g. books, Internet), and who is disadvantaged by these defaults? I'd like to inform the responsible use of LMs and drive actionable social change more broadly. 121
Lucy Li @lucy3.bsky.social · 14/10/2024Sociolinguistic-y NLP. Many core challenges in language modeling, from fairness to domain adaptation, relate to linguistic differences in data. These differences are socially driven, and so, addressing these challenges benefits from a sociolinguistic perspective. 121
Lucy Li @lucy3.bsky.social · 14/08/2024Finally, we automatically tag math standards in GSM8k problems, and find that it targets a narrow range of skills/concepts! Estimating standards in K-12 benchmarks can allow us to better understand why some problems are more difficult to solve for models than others. 110
Lucy Li @lucy3.bsky.social · 14/08/2024We find that LMs struggle to tag and verify standards linked to problems. They can also generate problems that do not fully align with standards described in prompts, and checking for generation issues w/ GPT-4 can lead to more optimistic predictions than the ones teachers make. 110
Lucy Li @lucy3.bsky.social · 14/08/2024Existing math datasets may be written by crowdworkers or generated by LMs. We introduce data involving curriculum used by actual teachers to encourage more ecologically valid AI & education research. This data is labeled with fine-grained math concepts & skills, or “standards”. 110
Lucy Li @lucy3.bsky.social · 14/08/2024New paper 📝 w/ Ai2! We worked with educators to identify a novel angle for evaluating language models' reasoning around math and pedagogy. 👩🏻🏫 🐟🍏 We ask, can LMs discern which skills and concepts are targeted by math content? Preprint: arxiv.org/abs/2408.04226 182
Lucy Li @lucy3.bsky.social · 29/06/2024I like how I can have both a topical organization of things, but also a chronological one. When prepping for weekly update meetings, I usually forget what I did in the past week, but then I can review by checking my activity: 010
Lucy Li @lucy3.bsky.social · 29/06/2024Trello is organized in a hierarchical way where you have big cards and also little cards. Within the little cards, you can add comments, checklists, and descriptions. My big cards usually include: related work, ideas, questions for advisors/senior people, todo, currently doing, done 110