Sign in

Katie Keith

@katakeith.bsky.social
4.1K followers 290 following 35 posts

NLP and computational social science (CSS) researcher. Assistant Professor in Computer Science at Williams College. AI2 and UMass Amherst alum. she/her. kakeith.github.io

PostsRepliesMedia
Reposted by Katie Keith
nlpandcss.bsky.social @nlpandcss.bsky.social · 18/12/2025
✨The NLP+CSS workshop is returning to ACL 2026!✨ And this year, we have a new shared task with prizes! Website/CfP: sites.google.com/site/nlpandc... Deadlines: March 5 (direct), March 24 (pre-reviewed ARR) #NLProc #CompSocialSci #ComputationalSocialScience #ACL2026NLP @aclmeeting.bsky.social
sites.google.com
NLP+CSS Workshops
https://www.pexels.com/photo/group-hand-fist-bump-1068523/
01912
Reposted by Katie Keith
Andy Halterman @ahalterman.bsky.social · 19/09/2025
Very excited that my paper with @katakeith.bsky.social is now out in @polanalysis.bsky.social. We investigate whether LLMs actually follow the instructions/definitions provided in codebooks, propose some diagnostics, and release a new evaluation dataset. www.cambridge.org/core/journal...
cambridge.org
Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Concepts | Political Analysis | Cambridge Core
Codebook LLMs: Evaluating LLMs as Measurement Tools for Political Science Concepts
04717
Katie Keith @katakeith.bsky.social · 27/08/2025
Whoa...!! If social-science leaning at all maybe try other preprint servers? SocArXiv for example? We put one of our preprints there: osf.io/preprints/so...
130
Katie Keith @katakeith.bsky.social · 12/08/2025
Yes! I agree. It's so rare these days to see a keynote that is so thorough and full of new conceptualizations.
050
Katie Keith @katakeith.bsky.social · 30/07/2025
5300 attendees in person here at #acl2025 😮
040
Reposted by Katie Keith
Maria Antoniak @mariaa.bsky.social · 17/07/2025
The #ACL2025 #ACL2025NLP feed is up and running! It matches both hashtags and any posts from or mentions of @aclmeeting.bsky.social Pin it to your home 📌 and enjoy! bsky.app/profile/did:...
24814
Katie Keith @katakeith.bsky.social · 24/07/2025
Topic @adeldaoud.bsky.social and I were discussing today at lunch at #ic2s2 and want to ask here: What are the “known facts” in the social sciences? Which relationships between at least two social variables have been empirically found to have large effects and replicated by multiple groups?
252
Katie Keith @katakeith.bsky.social · 23/07/2025
Under review! Happy to share a draft if you email me. Thanks!
000
Katie Keith @katakeith.bsky.social · 23/07/2025
Thanks:)
000
Katie Keith @katakeith.bsky.social · 23/07/2025
Highlighting this thread. Based on what I'm seeing at #ic2s2 this week, this line of work is hot (if a bit crowded), but I predict will only be more widely adopted by social scientists in the future.
1113
Katie Keith @katakeith.bsky.social · 23/07/2025
Not as recent, but still LLM-based "WANLI: Worker and AI Collaboration for Natural Language Inference Dataset Creation." GPT-3 composes new examples with similar patterns to challenging examples. aclanthology.org/2022.finding...
aclanthology.org
030
Katie Keith @katakeith.bsky.social · 23/07/2025
I thought this was a clever and useful paper from Xiong, ... Hovy, El-Assady, Ash "Co-DETECT: Collaborative Discovery of Edge Cases in Text Classification." Using LLMs to help humans refine their codebooks (before codebooks are fixed for the true annotation stage) arxiv.org/pdf/2507.05010
arxiv.org
070
Katie Keith @katakeith.bsky.social · 23/07/2025
We used active learning to create a human-annotated dataset of 1050 instances from FOMC transcripts—labeled for FOMC members’ opinions and directional stance towards monetary policy. Preprint and dataset should be released publicly by the end of the summer but email me for an advanced copy.
020
Katie Keith @katakeith.bsky.social · 23/07/2025
Congrats to Alisa Kanganis (Williams College ’25) for presenting her thesis work at #ic2s2 today!
3110
Katie Keith @katakeith.bsky.social · 20/07/2025
Yay! I'm there as well. Let's sync up.
020
Katie Keith @katakeith.bsky.social · 06/06/2025
This was top-down decision and Williams faculty have yet to formally discuss it. Unclear whether it is resistance or capitulation. www.science.org/content/arti...
science.org
U.S. college is first to decline federal science grants because of new DEI language
Williams College says NSF and NIH requirement related to discrimination “undermines” academic freedom
120
Katie Keith @katakeith.bsky.social · 28/05/2025
Honored by the feature on my research, grant, and GPU cluster by the Williams magazine. today.williams.edu/magazine/a-c...
today.williams.edu
A Co-op for Computing
Faculty are diving into the exciting, data-crunching, AI world of GPMoo.
091
Katie Keith @katakeith.bsky.social · 20/05/2025
Personally, I find I have to burn a day answering all the questions (particularly for a dataset release). I think it should be condensed to the 5 most important ones.
120
Reposted by Katie Keith
Ana Marasović @anamarasovic.bsky.social · 27/01/2025
A full room for @katakeith.bsky.social's talk on proximal causal inference with text data ✨✨✨
1171
Reposted by Katie Keith
Scientific Computing & Imaging Institute @sci.utah.edu · 24/01/2025
Mark your calendars for these upcoming events tied to SCI and its One-U Responsible AI Initiative! Visit rai.utah.edu/events for details. @parasharmanish.bsky.social @katakeith.bsky.social @anamarasovic.bsky.social @freiling.bsky.social
074
Katie Keith @katakeith.bsky.social · 11/12/2024
Our semi-synthetic experiments use MIIMIC-III clinical notes and two open-weight LLMs and show that our method produces estimates with low bias.
020
Katie Keith @katakeith.bsky.social · 11/12/2024
For settings with an unobserved (but known) confounding variable, we propose a new causal inference method that uses two instances of pre-treatment text data, infers two proxies using two zero-shot models on the separate instances, and applies these proxies in the proximal g-formula.
110
Katie Keith @katakeith.bsky.social · 11/12/2024
Check out our #NeurIPS2024 poster (presented by my collaborators Jacob Chen and Rohit Bhattacharya) about “Proximal Causal Inference With Text Data” at 5:30pm tomorrow (Weds)! neurips.cc/virtual/2024...
1124
Reposted by Katie Keith
brendan o’connor @brenocon.bsky.social · 19/11/2024
We're hiring new #nlp faculty this year! Asst or Assoc Professors in NLP at UMass CICS -- careers.umass.edu/amherst/en-u...
careers.umass.edu
Details - Assistant/Associate Professor - Natural Language Processing (NLP) | Human Resources | UMass Amherst
16634
Reposted by Katie Keith
Dallas Card @dallascard.bsky.social · 15/11/2024
I'm excited to share that we've released v1.0 of our podcast corpus, SPoRC, led by my PhD student Ben Litterer! This first dataset is a slice of time, comprising over one million episodes from May and June 2020, including transcripts, diarization, and extracted audio features.
15015
Reposted by Katie Keith
Mubashar “Mubs” Iqbal @mubashariqbal.com · 11/11/2024
Starter packs are genius, but I was surprised there wasn't a list of them for people to find. So I built it: blueskydirectory.com/starter-pack... The website monitors the packs being shared and adds the ones it finds to the database. Missed your stater pack? Message me and I'll get it added.
blueskydirectory.com
All - Bluesky Directory
A curated collection of all things relating to the Blue Sky social media platform.
110565222947
Reposted by Katie Keith
Maike Osborne @maosbot.bsky.social · 09/11/2024
New here? Interested in AI/ML? Check out these great starter packs! AI: go.bsky.app/SipA7it RL: go.bsky.app/3WPHcHg Women in AI: go.bsky.app/LaGDpqg NLP: go.bsky.app/SngwGeS AI and news: go.bsky.app/5sFqVNS You can also search all starter packs here: blueskydirectory.com/starter-pack...
66557212
Katie Keith @katakeith.bsky.social · 06/11/2024
🫠🫶
010
Katie Keith @katakeith.bsky.social · 06/11/2024
In my NLP class (www.cs.williams.edu/~kkeith/teac...) next week, we're talking about eval. I'd like to have a large section of the lecture focus on contamination. Crowd-sourcing--please send me your favorite contamination papers! Thanks! 🙏
cs.williams.edu
6163
Reposted by Katie Keith
Maria Antoniak @mariaa.bsky.social · 05/11/2024
go.bsky.app/PCckf3C
11711
Katie Keith @katakeith.bsky.social · 06/11/2024
Yay! thanks
000
Reposted by Katie Keith
Marc Keuschnigg @marckeuschnigg.bsky.social · 25/10/2024
We are hosting the 11th International Conference on Computational Social Science in Sweden 🚀The IC2S2'25 website is LIVE, and submissions are OPEN! 📍Norrköping | July 21-24, 2025 Call for Abstracts (until Feb 24) Call for Tutorials (until Jan 17) 🔗Explore details & submit: ic2s2-2025.org
07447
Katie Keith @katakeith.bsky.social · 04/11/2024
Thanks for the work and openness! I'm having my students explore this paper in my NLP class.
010
Katie Keith @katakeith.bsky.social · 04/11/2024
Amazing! Thanks Maria! Do you know if anyone has something similar for CSS/Digital Humanities outside of CS?
250
Reposted by Katie Keith
Maria Antoniak @mariaa.bsky.social · 04/11/2024
A starter pack for #NLP #NLProc researchers! 🎉 go.bsky.app/SngwGeS
4525199
Katie Keith @katakeith.bsky.social · 07/10/2024
Maybe you already did this, but when they initially reached out via email did you write something like "I am happy to talk if you agree to cite our work in your story." Then it is clearly in writing if they violate that.
120
Katie Keith @katakeith.bsky.social · 20/08/2024
These were some of the many reasons I chose Williams. No institution is perfect, but this one checks a lot of boxes. Hope you can join us! (4/4)
000
Katie Keith @katakeith.bsky.social · 20/08/2024
3. 5 out of 13 tenure-track CS faculty are women 4. Student body: 52% receive need-based financial aid (all grants) and over 40% identify as US students of color. (3/4)
100
Katie Keith @katakeith.bsky.social · 20/08/2024
Why Williams? 1. Strives for high teaching standards with 2-1 course load 2. Emphasis on quality research, evidenced by faculty grant success cfr.williams.edu/recent-exter... (2/4)
cfr.williams.edu
Active Faculty Grants
Here is a list of active external grants that have been awarded to current Williams faculty in support of their leave, research, and/or programmatic activities. Awards are listed alphabetically by fun...
100
Katie Keith @katakeith.bsky.social · 20/08/2024
Our Williams College computer science department is hiring TWO TENURE-TRACK FACULTY this cycle: apply.interfolio.com/148956 (1/4)
120
Katie Keith @katakeith.bsky.social · 19/08/2024
amazing! I will play around with this. 🙏
010
Katie Keith @katakeith.bsky.social · 19/08/2024
Tell me more about www.are.na! Do you use it for all curation or just certain ones?
are.na
Are.na
Are.na is a platform for connecting ideas and building knowledge
110
Katie Keith @katakeith.bsky.social · 26/03/2024
Congrats Julia! You are amazing:)
000
Katie Keith @katakeith.bsky.social · 11/03/2024
Thanks! This is just something I made for this presentation but if you want to cite something scholarly you can always cite my PhD dissertation: kakeith.github.io/attach/kkeit...
010
Katie Keith @katakeith.bsky.social · 28/01/2024
Was introduced to Ted Chiang’s fiction recently and I can’t put it down! So thought provoking!
030
Katie Keith @katakeith.bsky.social · 05/01/2024
👋
010
Katie Keith @katakeith.bsky.social · 22/12/2023
🚨NLP+CSS workshop is back and will be at NAACL 2024!  Paper submission deadline: March 24 sites.google.com/site/nlpandc... Organizing team: Anjalie Field, @dallascard.bsky.social Dirk Hovy and myself
sites.google.com
NLP+CSS Workshops
https://www.pexels.com/photo/group-hand-fist-bump-1068523/
0149