iiinova — where your digital self keeps evolving

Reposted by Emma Harvey

Alicia DeVrio @uhleeeeeeeshuh.bsky.social · 9h

Are algorithm audits meaningfully fixing issues in algorithmic systems? In our paper at #AIES2026 this week, @davidthewid.bsky.social and I argue that it’s time to deprioritize algorithm audits & instead shift scrutiny to the larger systems of power in which audits sit. 1/n

image of first page of the AIES 2026 paper titled "No More Plaudits for Algorithm Audits: A Provocation" by Alicia DeVrio & David Gray Widder

22510

Emma Harvey @emmharv.bsky.social · 01/10/2026

we are 1️⃣ MONTH out from the NYC marathon and I am $2️⃣2️⃣6️⃣0️⃣away from my goal of raising $4️⃣0️⃣0️⃣0️⃣ for climate sustainability!! if you would like to support, I would super appreciate it!! fundraisers.nyrr.org/emma-harvey

fundraisers.nyrr.org

NYRR Team for Climate 2026

I am fundraising to run this year's New York City Marathon with NYRR Team for Climate! If you know me, you know that running, New York City, and sustainability are all very important to me, and I woul...

010

Reposted by Emma Harvey

dan bateyko @dbateyko.bsky.social · 08/09/2026

Local law still formally mandates racial segregation. In 2026. We built the largest dataset of local laws and used LLMs to search for discriminatory provisions across the nation. What we found should not still be on the books. hai.stanford.edu/policy/makin...

hai.stanford.edu

Making Local Law Legible: LLM-Assisted Detection of Discrimination | Stanford HAI

This brief demonstrates the potential of LLM-assisted review to accelerate legal reform.

2127

Emma Harvey @emmharv.bsky.social · 13/08/2026

thank you!! would love to hear any thoughts you have!

001

Emma Harvey @emmharv.bsky.social · 13/08/2026

yay!! it is of course super indebted to your work (+ @hannawallach.bsky.social @madesai.bsky.social et al) on measurement!

020

Emma Harvey @emmharv.bsky.social · 12/08/2026

One more paper + full threads on the three above still to come - but in the meantime, check out this work on arXiv and LMK what you think!!

140

Emma Harvey @emmharv.bsky.social · 12/08/2026

3️⃣ "Hidden Errors in Big Data: The Case of Property Records" by Evelyn Smith, me, @jacobsgoldin.bsky.social, and Dan Ho shows how errors in brokered data can obfuscate estimates of fairness in property taxation. 🔗: arxiv.org/pdf/2607.28827

A screenshot of our paper title, authors, and abstract.
Title: Hidden Errors in Big Data: The Case of Property Records
Authors: Evelyn Smith, Emma Harvey, Jacob Goldin, Dan Ho
Abstract: Big data are the foundation for an increasing share of academic research and AI models deployed in both the public and private sectors, prompting substantial growth over time in reliance on brokered datasets. Brokered property records, which are ubiquitous in studies of gentrification, inequality, and the property tax in the U.S. and serve as inputs to property valuation models, are one notable example. In this paper, we audit two prominent brokered property datasets, finding errors in these data which bias key measures of economic inequality. First, we document that for 1-2% of matched sales in Cook County, IL, from 2018-2021, broker-provided sale prices differ from ground truth sale prices by more than 5%. Moreover, missing data and conceptual differences in the reporting of deed and property characteristics lead to coverage errors ranging from 12 to 15% of transactions. Second, we show that misreporting is highly consistent between brokers: more often than not, brokers make identical reporting errors for the same transactions. Third, to illustrate the significance of these errors, we measure their impact on estimates of property tax regressivity, finding that they drive significant wedges between estimates depending on the data source. These findings generalize to two other large counties in the U.S., and highlight the crucial importance of open administrative data and transparency from brokers regarding data provenance and lineage.

160

Emma Harvey @emmharv.bsky.social · 12/08/2026

2️⃣ "Context and Symmetry in Auditing: A Case Study of Skeleton Inference in Motion Capture" by me, @emoss.bsky.social, @sandhaus.bsky.social, @azjacobs.bsky.social, and @monasloane.bsky.social outlines how concepts from sociology and STS can improve AI audits. 🔗: arxiv.org/pdf/2608.10194

A screenshot of our paper title, authors, and abstract.
Title: Context and Symmetry in Auditing: A Case Study of Skeleton Inference in Motion Capture
Authors: Emma Harvey*, Emanuel Moss*, Hauke Sandhaus, Abigail Z. Jacobs, Mona Sloane
Abstract: Humans are increasingly expected to interact with AI systems that observe and make inferences about them—but do these systems actually work? A standard approach to answering this question is AI auditing. Conducting an AI audit requires identifying how a system behaves (i.e., determining what types of inputs to audit it with and then observing and documenting actual system behavior) and contrasting that with how a system should behave (i.e., determining what the nominal outputs of a system should look like). We argue that this is best done through a contextual audit, which we introduce as a method for auditing measurements within the context of the practices that produce them. We show how contextual auditing enables the interrogation of assumptions implicit in the audit process and allows auditors to be explicit about what serves as ground truth, which we define as verifiable measurements about the real world against which systems are evaluated. We outline how the concept of symmetry from science and technology studies can enable audits when ground truth is unknown, unknowable, or contested. Finally, to demonstrate how contextual and symmetric audits can be conducted in practice, we present a case study of skeleton inference in motion capture and propose areas suggested by our case study as particularly fruitful for future audits of motion capture systems.

180

Emma Harvey @emmharv.bsky.social · 12/08/2026

✨New Work✨ forthcoming at #AIES2026: 1️⃣ "Data Annotation as Measurement" by me, @allisonkoe.bsky.social, and @kizilcec.bsky.social explores how data annotation can go wrong, and how measurement theory can help improve it. 🔗: arxiv.org/pdf/2608.07297

A screenshot of our paper title, authors, and abstract.
Title: Data Annotation as Measurement
Authors: Emma Harvey, Allison Koenecke, Rene Kizilcec
Abstract: Modern AI systems depend on annotated data, but annotation is rarely treated as the act of measurement that it is. Instead, annotation quality is commonly reduced to agreement: if multiple annotators assign the same annotation to a data instance, the annotations are taken to be high-quality. Yet agreement does not establish whether annotations validly capture the underlying concept they are meant to represent. In this paper, we argue that data annotation should be understood as a measurement problem. Like other forms of measurement, annotation requires defining a concept, operationalizing it through an instrument, applying that instrument, and evaluating the reliability and validity of the resulting measurements. Drawing on a literature review of annotation quality research (N=132) and semi-structured interviews with annotation team members (N=10), we develop a framework for diagnosing and correcting annotation issues. First, we map key decision points across annotation processes—including task design, annotator management, quality assessment, quality improvement, and adjudication—that shape annotation outcomes. Second, we identify five distinct sources of annotation issues: error, ambiguity, impossibility, subjectivity, and annotator identity. Annotation problems that appear similar at the level of outcomes often require different process-level interventions based on their sources. Finally, we translate measurement theory into practical guidance for annotation teams, showing how assessments of reliability and validity can move beyond agreement alone. By reframing annotation as measurement, we offer a conceptual foundation for improving the quality of annotated data used in AI research and practice.

3286

Emma Harvey @emmharv.bsky.social · 05/08/2026

thank you so much!! very happy indeed 😊

010

Emma Harvey @emmharv.bsky.social · 05/08/2026

thank you!! and congrats to YOU - UW is so lucky to have you!!

010

Emma Harvey @emmharv.bsky.social · 04/08/2026

Shameless Plug (😅): If this makes you feel celebratory, please consider donating to my NYC marathon fundraiser for climate sustainability!!

120

Emma Harvey @emmharv.bsky.social · 04/08/2026

Life Update (🎉): I am now married!!

4220

Reposted by Emma Harvey

Lauren Chambers @laurenmarietta.bsky.social · 28/06/2026

it's the last day of #FAccT2026 in Montreal (bonjour hiii), and I'm presenting my paper with Diag Davenport on the promise of #PublicInterestTech clinics for training the next gen of critical sociotechnical thinkers. 🏆 plus we got an honorable mention!? come thru @ 10:45! 📄 tiny.cc/pit-clinics-26

screenshot of a title slide, navy background with light blue icons and white and gold text: "a decision-making pedagogy for the public interest technology clinic: putting the ‘practice’ in critical technical practice." lauren m. chambers & diag davenport, uc berkeley. facct @ montreal, june 28, 2026

1217

Reposted by Emma Harvey

Jennah Gosciak @jennahgosciak.bsky.social · 25/06/2026

I am excited to be at @facct.bsky.social this year presenting a new 📝 "Scrutinizing Index-Based Risk Assessments: A Case Study in NYC Decision-making for Heat Emergency Management" (work with Luke Boyce, @angelinawang.bsky.social , and @allisonkoe.bsky.social ). 🔗: dl.acm.org/doi/10.1145/... (1/10)

1196

Reposted by Emma Harvey

Isabel Silva Corpus @isabelcorpus.bsky.social · 24/06/2026

Excited to attend FAccT 2026 in Montreal this week! Let me know if you'll be there and want to catch up :) I'll be presenting a paper with @allisonkoe.bsky.social about ad delivery skew in the context of government advertising, come by and check it out!

2257

Emma Harvey @emmharv.bsky.social · 23/06/2026

If you'll also be at #FAccT2026 and would like to: eat a bagel, go for a run, eat poutine, chitchat, eat some smoked meat, etc., please reach out!!

Me in Montreal, smiling and holding two bagels (one from Fairmount Bagel, one from St. Viateur).

050

Emma Harvey @emmharv.bsky.social · 23/06/2026

I had a blast working on this project as part of my fellowship at Stanford's #RegLab last summer, and learned so much from this brilliant team! I'll be presenting this Sunday AM in the "Public Sector AI Systems" session - come through!!

A screenshot of our paper's entry in the FAccT program, showing that it will be presented during the Public Sector AI Systems session from 10:45AM-12:15PM on Sunday, July 28th in Hemon.

110

Emma Harvey @emmharv.bsky.social · 23/06/2026

I'm so excited to attend #FAccT2026 in 🇨🇦Montreal🇨🇦 to present "Tradeoffs are Domain Dependent: Improving Accuracy and Fairness in Property Tax Assessments" by Evelyn Smith, me, Chris Berry, @jacobsgoldin.bsky.social, and Dan Ho!! 🔗: arxiv.org/pdf/2605.15020

A screenshot of our paper:

Title: Tradeoffs are Domain Dependent: Improving Accuracy and Fairness in Property Tax Assessments
Authors: EVELYN SMITH and EMMA HARVEY (co-first authors), CHRISTOPHER BERRY, JACOB GOLDIN and DANIEL E. HO (co-senior authors)
Abstract: Algorithmic fairness research often assumes a tradeoff between fairness and accuracy. Yet this tradeoff may not be universal. We test this assumption in the context of U.S. property tax assessment - a setting in which the output of predictive algorithms directly determines the distribution of tax obligations among homeowners. Currently, systematic assessment errors cause owners of lower-valued properties to face disproportionately high tax burdens, creating regressivity in the property tax system. Using data on 26 million property sales spanning 95% of U.S. counties, we conduct three complementary analyses. First, we find that assessment accuracy and fairness - measured using domain-relevant metrics - are strongly correlated across counties under status quo practices. Second, in simulated assessment models, we show that adding property features improves accuracy in most cases, and that when accuracy improves, fairness almost always improves as well. Third, we show that incorporating publicly available Census data into assessment models - a feasible reform in most counties - would significantly improve both accuracy and fairness relative to status quo assessments. Together, these results challenge the presumed universality of the fairness-accuracy tradeoff and demonstrate that well-designed modeling improvements can advance both fairness and accuracy in large-scale public sector systems.

1113

Emma Harvey @emmharv.bsky.social · 19/06/2026

Also - every time I post this picture I feel compelled to disclaim that it's NOT a real snake tattoo on my arm, but rather part of a Love Island Halloween costume that took a while to fade 😅 The 2026 marathon is Nov 1, so come cheer me on to see what costume leftovers I'll be sporting this year 🤪

010

Emma Harvey @emmharv.bsky.social · 19/06/2026

If you know me, you know how important NYC, running, and sustainability are to me, so running the marathon with Team for Climate is literally a dream. Your support means the world to me - no donation is too small, and if you can't swing a donation, sharing my fundraising page is also HUGE ❤️❤️

fundraisers.nyrr.org

NYRR Team for Climate 2026

110

Emma Harvey @emmharv.bsky.social · 19/06/2026

I am SO excited to be running the NYC marathon this year with #TeamForClimate!! I'm fundraising to support forest conservation and increased sustainability in NYC running. If you would like to support this cause (and me!) I would so appreciate it: fundraisers.nyrr.org/emma-harvey

Me smiling and waving while running the 2024 NYC Marathon.

180

Reposted by Emma Harvey

ACM FAccT @facct.bsky.social · 02/06/2026

Our schedule for #FAccT2026 is live! facctconference.org/2026/schedul... You can find the full conference program, including sessions and papers, through the above link.

053

Emma Harvey @emmharv.bsky.social · 01/06/2026

I'm in Cambridge MA this summer for a research internship with Apple's Responsible AI team! I am super excited to work with a great team at Apple and also to be near Flour Bakery, which I have been obsessed with since 2018. If you're here too, LMK and let's hang out (optimally at Flour 💁‍♀️)!!

A group of boats with red sails on the Charles River

A pond and trees in the Boston Public Garden

0150

Emma Harvey @emmharv.bsky.social · 23/04/2026

🎉 "Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems" by Jing Nathan Yan, me, Junxiong Wang, Jeff Rzeszotarski, and @allisonkoe.bsky.social is now available in the #CHI2026 proceedings! 🔗: dl.acm.org/doi/10.1145/...

dl.acm.org

Fairness-in-the-Workflow: How Machine Learning Practitioners at Big Tech Companies Approach Fairness in Recommender Systems | Proceedings of the 2026 CHI Conference on Human Factors in Computing Syste...

1151

Reposted by Emma Harvey

ACM FAccT @facct.bsky.social · 20/04/2026

Our call for volunteers for #FAccT2026 is now live! Anyone can apply. Those who volunteer for at least 4 hours will have their entire conference registration fee waived 🌟 Deadline: April 27 Notification: May 6 facctconference.org/2026/cfv.html

044

Reposted by Emma Harvey

Divya Shanmugam @dmshanmugam.bsky.social · 23/03/2026

New in Nature Health: how might we move towards a world in which race is not used in clinical algorithms? We need (1) careful comparison of race-aware and race-neutral algorithms and (2) systemic efforts to address underlying disparities.

1219

Reposted by Emma Harvey

Alexandra Olteanu @aolteanu.bsky.social · 18/02/2026

The deadline for the 2026 FAccT DC is next Tuesday, February 24! If you are a student working on topics relevant to the FAccT's scope, this is an opportunity to interact with a diverse set of peers and mentors! #facct2026 #facct26 #facct Details here: facctconference.org/2026/callfor...

facctconference.org

ACM FAccT 2026 Doctoral Colloquium Call for Applications

0810

Reposted by Emma Harvey

Cornell Tech @cornelltech.bsky.social · 06/02/2026

Applications are now live for Cornell Tech’s Summer Innovation Intensives! This three-week experience invites high school students to explore AI, ethical coding, data science, and product innovation — all on Cornell Tech's NYC campus. Learn more and apply: bit.ly/48cr6gy

022

Emma Harvey @emmharv.bsky.social · 03/02/2026

Good news: I found your new best friend!! My foster dog Ellie is 60 lbs of pure love with the most velvety ears in the world ❤️ She is smart, friendly, and loves walks and snuggles - and she's officially looking for her forever home!! Apply to adopt Ellie here: nycacc.app#/browse/241644

a gray bully breed dog wearing a winter coat and booties

a gray bully breed dog curled up asleep in some blankets

040

Reposted by Emma Harvey

travis lloyd (træve) @travislloydphd.bsky.social · 06/12/2025

I spoke with @kattenbarge.bsky.social for this @wired.com piece about my research into reddit moderators' experiences moderating AI-generated content. Moderators are working hard to keep Reddit "one of the most human spaces left on the internet," but it's a trying and often thankless task.

1114

Reposted by Emma Harvey

Isabel Silva Corpus @isabelcorpus.bsky.social · 01/12/2025

Excited to share a new working paper! What happened when Change.org integrated an AI writing tool into their platform? We provide causal evidence that petition text changed significantly while outcomes did not improve. 1/ arxiv.org/abs/2511.13949

arxiv.org

Introducing AI to an Online Petition Platform Changed Outputs but not Outcomes

The rapid integration of AI writing tools into online platforms raises critical questions about their impact on content production and outcomes. We leverage a unique natural experiment on Change$.$org...

45518

Reposted by Emma Harvey

Jenn Wortman Vaughan @jennwv.bsky.social · 20/11/2025

Spread the word! 📢 The FATE (Fairness, Accountability, Transparency, and Ethics) group at @msftresearch.bsky.social in NYC is hiring interns and postdocs to start in summer 2026! 🎉 Apply by *December 15* for full consideration.

15128

Emma Harvey @emmharv.bsky.social · 18/11/2025

love this thread from Isabel highlighting some really interesting @codemit.bsky.social talks!!

080

Reposted by Emma Harvey

Kaitlyn Zhou @kaitlynzhou.bsky.social · 06/11/2025

No better time to start learning about that #AI thing everyone's talking about... 📢 I'm recruiting PhD students in Computer Science or Information Science @cornellbowers.bsky.social! If you're interested, apply to either department (yes, either program!) and list me as a potential advisor!

Photo of Cornelll University building surrounded by colorful trees

2259

Reposted by Emma Harvey

Shahan Ali Memon @shahanmemon.bsky.social · 27/09/2025

Applying for a #PhD @ischool.uw.edu? Read 👇 Our student-run application feedback program will be open from October 20th through 1st November 2025. Everyone applying, especially those from historically underrepresented groups or who have faced barriers in higher ed are highly encouraged to apply.

157

Reposted by Emma Harvey

ACM FAccT @facct.bsky.social · 17/10/2025

We’re excited to release the Call for Papers for #FAccT2026 which will be held in Montreal, Canada in June 2026! Abstracts are due on January 8th, papers due on January 13th. Call for Papers: facctconference.org/2026/cfp Important info in thread →

facctconference.org

ACM FAccT - 2026 CFP

12117

Reposted by Emma Harvey

Divya Shanmugam @dmshanmugam.bsky.social · 14/10/2025

I am on the job market this year! My research advances methods for reliable machine learning from real-world data, with a focus on healthcare. Happy to chat if this is of interest to you or your department/team.

22812

Reposted by Emma Harvey

Queer in AI @queerinai.com · 09/10/2025

We are launching our Graduate School Application Financial Aid Program (www.queerinai.com/grad-app-aid) for 2025-2026. We’ll give up to $750 per person to LGBTQIA+ STEM scholars applying to graduate programs. Apply at openreview.net/group?id=Que.... 1/5

queerinai.com

Grad App Aid — Queer in AI

179

Reposted by Emma Harvey

Tzu-Sheng Kuo 郭子生 @tskuo.bsky.social · 24/09/2025

🌟 If you’re applying to CMU SCS PhD programs, and come from a background that would bring additional dimensions to the CMU community, our PhD students are here to help! Apply to the Graduate Applicant Support Program by Oct 13 to receive feedback on your application materials:

Carnegie Mellon University School of Computer Science Graduate Application Support Program. Apply by October 13, 2025.

174

Reposted by Emma Harvey

A. Feder Cooper @afedercooper.bsky.social · 15/09/2025

15 days left to submit to the CSLaw '26 main track! (archival and non-archival)!

054

Reposted by Emma Harvey

Hauke Sandhaus @sandhaus.bsky.social · 05/09/2025

Join us for NYC Privacy Day 2025 at Cornell Tech, hosted by DLI @nissenbaum.bsky.social and SETS @mantzarlis.com. We have a great selection of speakers and alongside talks, we’ll feature student posters + demos. 🔗 Details, registration, and poster submission: dli.tech.cornell.edu/nyc-privacy-...

dli.tech.cornell.edu

NYC Privacy Day 2025 | Cornell Tech

NYC Privacy Day hosted at Cornell Tech

022

Reposted by Emma Harvey

travis lloyd (træve) @travislloydphd.bsky.social · 03/09/2025

I'm at Seattle 4S! I'll be part of the "Risks of 'Social Model Collapse' in the Face of Scientific and Technological Advances" panel Friday morning, discussing online community governance of AI-generated content. Would love to meet others studying AI's impact on the info ecosystem! #STS #4S

192

Reposted by Emma Harvey

Gabriel Agostini @gsagostini.bsky.social · 03/09/2025

Are you a researcher using computational methods to understand cities? @mfranchi.bsky.social @jennahgosciak.bsky.social and I organize an EAAMO Bridges working group on Urban Data Science and we are looking for new members! Fill the interest form on our page: urban-data-science-eaamo.github.io

urban-data-science-eaamo.github.io

Urban Data Science & Equitable Cities | EAAMO Bridges

EAAMO Bridges Urban Data Science & Equitable Cities working group: biweekly talks, paper studies, and workshops on computational urban data analysis to explore and address inequities.

188

Reposted by Emma Harvey

Paper Skygest Team @paper-feed.bsky.social · 19/08/2025

**Please repost** If you're enjoying Paper Skygest -- our personalized feed of academic content on Bluesky -- we'd appreciate you reposting this! We’ve found that the most effective way for us to reach new users and communities is through users sharing it with their network

2114143