Sign in

Duke Health AI Evaluation & Governance Program

@dukeaievalgov.bsky.social
154 followers 7 following 51 posts

Evaluating and overseeing algorithms integrated into healthcare practices

PostsRepliesMedia
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 19/08/2026
A new @amergeriatrics.bsky.social Position Statement on Generative AI in the Care of Older Adults by Juliessa Pavon & other national experts provides guidance for responsible development, evaluation, & use of generative AI in aging-related care. agsjournals.onlinelibrary.wiley.com/doi/10.1111/...
agsjournals.onlinelibrary.wiley.com
Generative AI in the Care of Older Adults: A Position Statement From the American Geriatrics Society
Reader environment loaded
012
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 31/07/2026
In a new guest editorial in the American Journal of Bioethics, @dukeaievalgov.bsky.social's Matthew Elmore, Nicoleta Economou, and colleagues explore how transparency can foster trust in health AI. www.tandfonline.com/doi/full/10....
tandfonline.com
Clear by Design: Consensus-Based Transparency Practices to Foster Trust in Health AI
Published in The American Journal of Bioethics (Ahead of Print, 2026)
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 30/07/2026
“We have established a framework for ensuring that the deployment of #AI is not just trusted, but is actually trustworthy,” @dukemedschool.bsky.social Vice Dean for Data Science and AI Chris Lindsell told The Chronicle in a new article about @dukeaievalgov.bsky.social's ABCDS Oversight Initiative.
dukechronicle.com
While Duke Health implements AI, oversight initiatives try to ensure ethical practices
At the center of Duke Health’s approach to an ethical use of artificial intelligence in healthcare is the flagship ABCDS Oversight Initiative, which evaluates and governs any algorithms, including AI ...
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 27/07/2026
In a new NPJ Dig Med commentary, @dukeaievalgov.bsky.social's Nicoleta Economou and Erasmus MC's Davy Van De Sande and Michel van Genderen examine what clinicians and health systems need to effectively question, challenge, and intervene when AI is used in patient care. www.nature.com/articles/s41...
nature.com
Meaningful oversight of medical AI beyond human in the loop - npj Digital Medicine
Human oversight of medical AI is increasingly required, but clinician presence alone does not make oversight meaningful. We propose four interlocking conditions—epistemic capacity, cognitive space, de...
011
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 23/06/2026
👇 @dukeaievalgov.bsky.social's Matt Elmore recently contributed to 'Offloading Ourselves: Staying Human in the Age of AI,' AEI's Council on AI Ethics' inaugural report on human judgment, responsibility, agency, and flourishing in an AI-mediated world. www.thenewatlantis.com/publications...
thenewatlantis.com
Offloading Ourselves
An inquiry into staying human in the age of AI — by the American Enterprise Institute’s Council on AI Ethics
020
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 23/06/2026
In a guest editorial in the American Journal of Bioethics, @dukeaievalgov.bsky.social’s Matthew Elmore, Nicoleta Economou, and colleagues discuss how bias can emerge through data, workflows, implementation decisions, human-AI interaction, and ongoing monitoring. www.tandfonline.com/doi/full/10....
tandfonline.com
Fairness and Bias Management in Health AI: consensus-Based Recommendations for Best Practices Across the AI Lifecycle
Published in The American Journal of Bioethics (Ahead of Print, 2026)
010
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 23/06/2026
@dukeaievalgov.bsky.social's Nicoleta Economou, PhD, was invited to present at #vitalis2026, one of the largest Nordic events for digital health, healthtech, and person-centred care. Her talk provided a focused overview of where health AI stands today. Learn more: invitepeople.com/public/event...
invitepeople.com
Vitalis 2026
Vitalis arrangeras 4-7 maj i Göteborg och är Nordens ledande mötesplats för framtidens hälsa, vård och omsorg med fokus på e-hälsa, välfärdsteknik och innovation. Här möts branschens viktigaste aktöre...
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 27/04/2026
A new study in @jamacardiology.com by Duke researchers Chuan Hong, Nicoleta Economou, and colleagues looks at how the PREVENT score, a tool used to estimate a person’s risk of developing heart disease, performs in everyday clinical care using #EHR data. jamanetwork.com/journals/jam...
jamanetwork.com
Performance of PREVENT Cardiovascular Risk in EHR-Based Clinical Practice
This cohort study evaluates the discrimination and calibration of the Predicting Risk of Cardiovascular Disease Events (PREVENT) equations using 2 cohorts of data collected from electronic health reco...
120
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 30/03/2026
👇 @dukeaievalgov.bsky.social & @dukemargolis.bsky.social show how health systems can build #AI safety into daily practice through clear oversight, ongoing monitoring, & stronger ways to identify & address issues, so AI supports safe, effective patient care. healthpolicy.duke.edu/publications...
healthpolicy.duke.edu
AI Safety in Health Systems: Building Infrastructure and Strengthening Risk Management Practices
021
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 25/03/2026
Duke Health AI E&G Program director, Nicoleta Economou, served on the Steering Committee that developed the latest 'AI at Duke' report on advancing #AI across research, education, and institutional operations. Learn more below. provost.duke.edu/news/new-rep...
provost.duke.edu
New report recommends path forward for Duke and artificial intelligence | Office of the Provost
The AI at Duke Steering Committee report provides a strategic framework to guide future investments and initiatives in artificial intelligence while enhancing the univers
001
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 11/03/2026
Duke Health AI Evaluation & Governance Program Director Nicoleta Economou, PhD, will deliver the keynote at the upcoming SAS Health Care Community Connection virtual event, which is open to the global health care community. Register here: sas.com/en_us/events/2
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
Happening March 24: @dukeaihealth.bsky.social and @dukemargolis.bsky.social are hosting a webinar titled, 'From Deployment to Oversight: Strengthening AI Risk Management and Patient Safety in Health Care,' that will explore strategies to protect patients in the age of AI! To register: duke.is/5/cg7u
032
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
Duke's Dr. Eric Poon, will represent @dukeaievalgov.bsky.social's work at the upcoming #HIMSS2026. The E&G Program has collaborated with Avanade to develop SAIGE (Smart AI Governance Engine), an important step toward advancing responsible health AI. healthaigovernance.duke.edu/abcds-oversi...
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
A new perspective in JAMIA by Duke's Michael Cary, Nicoleta Economou, and colleagues examines the National Academy of Medicine’s AI Code of Conduct. The paper highlights a key gap in health AI governance: the lack of explicit nursing representation. academic.oup.com/jamia/advance-
032
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
Our article, “...Consensus-Based Considerations for AI Usefulness in Healthcare,” is now published in The American Journal of Bioethics. @dukeaievalgov.bsky.social is excited to collaborate with colleagues across CHAI's Usefulness Workgroup for this publication: tandfonline.com/doi/full/10.10
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
ABCDS Oversight Assistant Director Sophia Bessias recently joined Dr. Clay Musser and Dr. Misha Tran at the Duke Department of Medicine AI Symposium for a panel discussion of clinical AI and evaluation, moderated by Dr. Juliessa Pavon. Learn more here: healthaigovernance.duke.edu/news/duke-he...
healthaigovernance.duke.edu
Duke Health AI E&G at the Duke Department of Medicine AI Symposium
Duke Department of Medicine AI Symposium (January 30, 2026): In January, ABCDS Oversight Assistant Director Sophia Bessias joined Dr. Clay Musser and Dr. Misha Tran at the Department of Medicine AI Sy...
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 05/03/2026
We congratulate Erasmus MC's Michel van Genderen, MD, PhD, on his appointment as Adjunct Associate Professor at Duke. Dr. van Genderen will partner with @dukeaievalgov.bsky.social to expand opportunities for joint research and to develop frameworks for trustworthy, evidence-based #healthAI.
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 26/01/2026
New research published in the Journal of Biomedical Informatics by Duke researchers shows how hospitals can use #AI to learn collaboratively which treatments work best while keeping patient data private. www.sciencedirect.com/science/arti...
sciencedirect.com
A federated learning framework for ethical dynamic treatment allocation across heterogeneous hospitals
In this paper, we propose an adaptive federated learning framework to learn optimal treatments for individual hospitals that possibly serve different …
100
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 22/12/2025
As 2025 comes to a close, we remain focused on what matters most: our patients. By advancing safe, fair, and high-quality algorithmic solutions, we’re working to improve and responsibly transform healthcare. Thank you for being part of this progress. Wishing you Happy Holidays! 🥳
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 10/12/2025
Today at 2:00 PM EST: @dukeaievalgov.bsky.social Director, Nicoleta Economou, PhD, will join Avanade's David Galich and David Gormley for the final installment of their Smart AI Masterclass series, where the speakers will discuss #AgenticAI. Register now. events.teams.microsoft.com/event/ebdde5...
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 11/11/2025
👇 @dukeaievalgov.bsky.social welcomes Elijah Richardson, MPH, who is the new Evaluation & Governance Lead for our flagship ABCDS Oversight initiative. Learn more about his new role and his professional background here: healthaigovernance.duke.edu/personnel/el...
010
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 16/10/2025
Nicoleta Economou, PhD, director of @dukeaievalgov.bsky.social has been appointed to the AI at Duke Steering Committee and will also serve as liaison for the Trustworthy & Responsible AI Advisory Committee. Provost Alec Gallimore launched the AI at Duke initiative in May 2025. duke.is/g/newp
duke.is
AI at Duke Initiative Strengthens Leadership and Expands Faculty Engagement - AI at Duke
The AI at Duke steering committee continues to gain momentum as it enters a critical phase of strategic planning and university-wide engagement. Launched by Provost Alec Gallimore in May, the initiati...
100
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 10/10/2025
The @dukeaievalgov.bsky.social team was excited to present our work at the Duke Summit on AI for Health Innovation. Throughout the event, we observed meaningful engagement and genuine curiosity from attendees regarding our program, the ABCDS Oversight Initiative, and our published research.
100
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 10/10/2025
@dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently joined leading experts in #AI, data science, public health, and healthcare emergency management for an AI Panel Series hosted by the Academic Healthcare Emergency Management (AHEM) Consortium. ahemconsortium.org/from-chaos-t...
ahemconsortium.org
From Chaos to Coordination: Reimagining Healthcare Emergency Management with AI
This event is a part of the AHEM Expert Panel Series Join us for the fifth session in the Academic Healthcare Emergency Management (AHEM) Expert Panel Series, where leading voices in AI, healthcare…
010
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 19/09/2025
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, recently delivered a keynote at the National Evaluation Center of Quality and Technology in Health Conference in Athens, which highlighted @dukehealth.bsky.social’s leadership in advancing trustworthy and responsible #AI for healthcare.
020
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 18/09/2025
👇 @dukeaievalgov.bsky.social Director Nicoleta Economou, PhD, joined other AI leaders on a @sassoftware.bsky.social-hosted webinar exploring how agentic AI, generative AI, and AI governance are reshaping health and life sciences. Watch the webinar on demand here: www.sas.com/en_us/webina...
sas.com
Agentic AI, Generative AI and AI Governance
Explore how agentic AI, generative AI and AI governance are driving transformation across health and life sciences.
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 09/09/2025
🤔Typo or something more? The Verge's Hayden Field spoke with @dukehealth.bsky.social's Chief Data Scientist Michael Pencina, PhD, about the risks of "hallucinations" in medical #LLMs like Google's Med-Gemini, which mistakenly cited an anatomical structure that doesn’t exist, in a recent preprint.
theverge.com
Google’s healthcare AI made up a body part — what happens when doctors don’t notice?
The basilar ganglia does not exist.
010
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 04/09/2025
Looking to add some academic heat to your fall reading list, the @dukeaievalgov.bsky.social is spotlighting our latest research on algorithm oversight, #LLM evaluation, fairness, and safety in #healthAI. healthaigovernance.duke.edu/news/fall-re...
healthaigovernance.duke.edu
Fall Reading on AI Governance
Looking to add some academic heat to your fall reading list? The Duke Health AI Evaluation & Governance Program is spotlighting our latest research on algorithm oversight, LLM evaluation, fairness, an...
120
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 27/06/2025
North Carolina Public Radio (@wunc.org) reports on @dukehealth.bsky.social's national leadership in health #AI governance, spotlighting two new evaluation frameworks developed by Duke researchers to assess the safety, reliability, and clinical performance of #LLMs. www.wunc.org/health/2025-...
wunc.org
Duke innovates on implementing and assessing AI in health spaces
Researchers are creating evaluation frameworks to ensure the safe usage of LLMs, like ChatGPT, at Duke Health
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 26/06/2025
👇@axios.com reports on how a team of Duke researchers led by Chief Data Scientist Michael Pencina has developed two important evaluation frameworks to assess the safety, accuracy, and reliability of large language models (LLMs) in clinical care. axios.com/local/raleig... @dukehealth.bsky.social
axios.com
Duke researchers want to ensure AI is safe in a health care setting
Health systems across the country are investing heavily in AI as a way to reduce burnout for providers and potentially improve care
020
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 26/06/2025
Duke researchers, led by Dr. Michael Pencina and Dr. Chuan Hong, have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large language models (LLMs) in healthcare. corporate.dukehealth.org/news/duke-un... 1/2
corporate.dukehealth.org
Duke University Sets New National Standard for Safe, Scalable AI in Health Care
DURHAM, N.C. — Duke University School of Medicine researchers have developed two pioneering frameworks designed to evaluate the performance, safety, and reliability of large-language models in health ...
121
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 23/06/2025
New in @jamahealthforum.bsky.social: Duke’s Michael Pencina and colleagues make a case for third-party enablers, smarter local governance, and shared evidence networks to make health #AI safe, scalable, and truly impactful. jamanetwork.com/journals/jam... @dukehealth.bsky.social
jamanetwork.com
Bridging the Gap Between Developers and Implementers in Health AI
This Viewpoint describes opportunities for health care organizations to close gaps between the development and implementation of artificial intelligence using third-party enablers for training, adhere...
032
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 09/06/2025
ATTN: Duke faculty, staff, and students: Join @dukeaievalgov.bsky.social for a special webinar: 'Shaping the Future of Responsible Health #AI'. Learn how Duke is advancing the deployment of trustworthy and responsible AI across the institution. Register: qrcc.me/swb9tiwh8cw6... (Duke login required)
qrcc.me
Welcome! You are invited to join a meeting: Shaping the Future of Responsible Health AI: Introducing the Duke Health AI Evaluation & Governance Program. After registering, you will receive a confirmat...
Speakers: Michael J. Pencina, PhD, Chief Data Scientist, Duke Health Nicoleta J. Economou-Zavlanos, PhD, Director, Duke Health AI Evaluation & Governance (E&G) Program Sophia Bessias, MPH, MSA, Assist...
011
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 28/05/2025
Exciting News! @dukeaievalgov.bsky.social Program proudly launches its new website. The Program promotes the safe, fair, and effective use of #AI in healthcare, ensuring AI innovations improve patient care ethically. Visit & explore here: healthaigovernance.duke.edu 1/2
A website launch flyer showcasing the front page of the new Duke Health AI Evaluation & Governance website on various screens.
111
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 23/05/2025
Passionate about making clinical #AI safer, fairer, and more effective? The @dukeaievalgov.bsky.social Program is looking for an Evaluation Lead to support our flagship ABCDS Oversight initiative. Apply now or share with someone who should: careers.duke.edu/job-invite/2... 1/2
A 'We are Hiring' poster with the Duke Health AI Evaluation & Governance Program logo.
110
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 19/05/2025
Thank you to all who joined @dukeaievalgov.bsky.social for a compelling seminar with Dr. Michel van Genderen, Associate Professor at Erasmus Medical Center and a thought leader in operationalizing responsible #AI, who shared insights from his work in #trustworthyAI development across Europe.
Dr. Michel van Genderen speaking at a podium
211
Reposted by Duke Health AI Evaluation & Governance Program
Duke Health @dukehealth.bsky.social · 15/05/2025
Duke Health has partnered with Avanade to design, build and implement a Smart AI Governance Engine (SAIGE), a-first-of-its-kind, healthcare-specific AI governance platform that uses Microsoft Azure and Microsoft Fabric applications. 1/6 @dukeaievalgov.bsky.social
Duke Health Logo
111
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 25/02/2025
Hot off the press 👇 @dukeaievalgov.bsky.social's Matthew Elmore, Nicoleta Economou, and Michael Pencina have developed a practical heuristic to ensure patients are informed about #AI tools in their care. Read here: www.tandfonline.com/eprint/GWJTP...
tandfonline.com
A Heuristic for Notifying Patients About AI: From Institutional Declarations to Informed Consent
Published in The American Journal of Bioethics (Vol. 25, No. 3, 2025)
110
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 15/01/2025
We are hiring! Join the Duke Health AI Evaluation & Governance Program as an Operations Leader and drive the future of #healthAI. Lead transformative projects, manage operations, and shape ethical, impactful AI in healthcare. Ready to innovate? Apply now: careers.duke.edu/job-invite/2...
010
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 24/12/2024
As the year ends, we reflect on our commitment to advancing trustworthy AI for better healthcare. Thank you for supporting safe, fair, and high-quality solutions that prioritize patients. Wishing you a joyful season and a new year filled with health, hope, and progress. — The Duke Health AI E&G Team
000
Duke Health AI Evaluation & Governance Program @dukeaievalgov.bsky.social · 22/11/2024
Congratulations to Nicoleta Economou on being named the Director of @dukeaievalgov.bsky.social! In this pivotal role, Dr. Economou will lead efforts to ensure the trustworthy, responsible, and equitable integration of #AI in healthcare. Learn more about her impactful work here: lnkd.in/d2_Tt3gj
010