Awa Dieng @adoubleva.bsky.social · 15/12/2024That’s a wrap for #AFME2024!!! 🎉 Thank you to all the authors, attendees, roundtable leads and speakers for the great presentations and insightful discussions! 050
Awa Dieng @adoubleva.bsky.social · 15/12/2024Our amazing panellists discussed how to define fairness and challenges of evaluation, ethical considerations and interdisciplinary collaboration for addressing different dimensions of fairness! @jessicaschrouff.bsky.social @sanmikoyejo.bsky.social @sethlazar.org Hoda Heidari 181
Awa Dieng @adoubleva.bsky.social · 14/12/2024For the final contributed talk, Ben Laufer discussed the fundamental limits in the search for less discriminatory algorithms!! 040
Awa Dieng @adoubleva.bsky.social · 14/12/2024Another great contributed talk!! Natalie Mackraz discussed her work on evaluating gender bias transfer between pre-trained and prompt-adapted LLMs 020
Awa Dieng @adoubleva.bsky.social · 14/12/2024In the third contributed talk, Prakhar Ganesh presented his paper comparing g bias mitigation algorithms in ML! 020
Awa Dieng @adoubleva.bsky.social · 14/12/2024To kick off the afternoon session, we have a great talk from @angelinawang.bsky.social on the need for group difference awareness and a new suite of benchmark for assessing this metric in LLMs!! 0111
Awa Dieng @adoubleva.bsky.social · 14/12/2024Ending the morning session with great discussions at the roundtables 🎊 See you after lunch 000
Awa Dieng @adoubleva.bsky.social · 14/12/2024In the last invited talk of the morning, we have @sethlazar.org giving an insightful talk on evaluating the ethical competence of LLMs!! 020
Awa Dieng @adoubleva.bsky.social · 14/12/2024The second contributed talk at #AFME2024. To Eun Kim discussed his paper “Towards Fair RAG: On the Impact of Fair Ranking in Retrieval-Augmented Generation” 130
Awa Dieng @adoubleva.bsky.social · 14/12/2024Our first contributed talk is by Alex Tamkin presented his work on Evaluating and Mitigating Discrimination in Language Model Decisions! 000
Awa Dieng @adoubleva.bsky.social · 14/12/2024Another great talk of the day by @krvarshney.bsky.social discussing his work on building harm detectors and guardian models for large generative models! He also addressed the need to broaden the dimensions of harms in different use cases 092
Awa Dieng @adoubleva.bsky.social · 14/12/2024Great first talk by Hoda, giving an overview of fairness metrics in traditional fairness and generative models. She discussed the desiderata for a Good Measurement and steps towards building contextually aware fairness metrics in LLMs! 020
Awa Dieng @adoubleva.bsky.social · 14/12/2024Off to a great start with the opening remarks by @nandofioretto.bsky.social on why this year’s topic. 030
Awa Dieng @adoubleva.bsky.social · 14/12/2024It's time for our #NeurIPS2024 Algorithmic Fairness Workshop #AFME2024 🥳! Join us TODAY for a full day of discussions on fairness metrics & evaluation. Schedule: afciworkshop.org/schedule ⏰ We start at 9 am with the opening remarks, followed by a keynote by on Fairness Measurement by Hoda Heidari 0122
Awa Dieng @adoubleva.bsky.social · 11/12/2024📆AFME workshop: Sat, Dec 14 in room 111-112 My favorite part of the workshop 🥳 💬 Join our amazing leads* at the roundtables for insightful discussions on Fairness/Bias Metrics and Evaluation. * @angelinawang.bsky.social, Candace Ross (FAIR), Tom Hartvigsen (UofVirginia) 060
Awa Dieng @adoubleva.bsky.social · 10/12/2024📆 AFME workshop: Sat, Dec 14 in room 111-112 Join our expert panellists* for a timely discussion on “Rethinking fairness in the era of large language models”!! * @jessicaschrouff.bsky.social, @sethlazar.org, Sanmi Koyejo, Hoda Heidari 0113
Awa Dieng @adoubleva.bsky.social · 08/12/2024Professor Seth Lazar @sethlazar.org from ANU will discuss challenges in evaluating Ethical Competence in LLMs 021
Awa Dieng @adoubleva.bsky.social · 08/12/2024Professor Sanmi Koyejo and Dr Angelina Wang will present a new fairness metric for measuring discrimination in LLMs 142
Awa Dieng @adoubleva.bsky.social · 08/12/2024Dr Kush Varshney from IBM research will discuss ongoing work on detecting harms in deployed LLMs and associated challenges 111
Awa Dieng @adoubleva.bsky.social · 08/12/2024Professor Hoda Heidari from CMU will give an overview of the algorithmic fairness field and discuss reconciling existing methods with bias measurement methods in LLMs 110
Awa Dieng @adoubleva.bsky.social · 17/11/2024In The Nteasee Study, we conducted surveys of 672 general population participants across 5 countries–Ghana, Rwanda, Kenya, Nigeria and South Africa–as well as in-depth interviews of experts working in AI/ML, health, policy, and equity. arxiv.org/abs/2409.12197 (2/11) 110
Awa Dieng @adoubleva.bsky.social · 17/11/2024We (+ @dr-nyamewaa.bsky.social) are excited to present two recent works detailing the landscape of AI in health in Africa from a fairness and equity angle: The Nteasee Study arxiv.org/abs/2409.12197 and The Case for Globalizing Fairness dl.acm.org/doi/10.1145/... (1/11) 142