iiinova — where your digital self keeps evolving

Timothy Keyes @timothykeyes.bsky.social · 17/09/2025

I’m not sure what face I’m making in that screenshot (lol) but I’m glad you enjoyed! (Funny faces notwithstanding)

Reposted by Timothy Keyes

Simon P. Couch @simonpcouch.com · 17/09/2025

Just wrapped up a talk at #positconf2025 about LLM evaluation with R! Such a joy to hang out with #rstats folks in person and hear about what others are working on. Resources and slides: github.com/simonpcouch/...

A chat interface showing a conversation starting with a user saying "Are there any talks about evals" and a response "Yes, Simon Couch just gave one, and he hopes you enjoyed it." There's a teddy bear mascot wearing a teal shirt and cap in the bottom right corner of the chat window.

A picture from the side of a conference session room, with myself standing in front.

1253

Timothy Keyes @timothykeyes.bsky.social · 13/05/2025

my most recent hot take: after a year working inside my hospital’s IT system, i’m increasingly convinced that clinical informatics should have been a residency (like pathology or radiology), not a fellowship.

050

Timothy Keyes @timothykeyes.bsky.social · 23/03/2025

idk what it means that so many people I know to be thoughtful, compassionate, and brilliant physicians have told me that - while they love taking care of patients - the growing frustrations and exhaustion they experience in clinical life make the whole thing feel unsustainable in the long-term

030

Timothy Keyes @timothykeyes.bsky.social · 23/03/2025

as i prepare to go back to med school, i am haunted daily by the number of my med school classmates (who are now residents, fellows, or attendings) who have reached out to me to learn about my side-career in health tech because they want to explore alternatives to a full-time clinical career

110

Timothy Keyes @timothykeyes.bsky.social · 20/03/2025

how are you such a legend - this is amazing!

050

Timothy Keyes @timothykeyes.bsky.social · 20/03/2025

all this talk about AI and i’m still sitting here thinking about the warm, familiar embrace of OLS

050

Timothy Keyes @timothykeyes.bsky.social · 20/03/2025

today i got an email in which a statistician cited a paper from over 200 years ago and all i could think is how that’s the kind of power computer scientists wish they had

4232

Timothy Keyes @timothykeyes.bsky.social · 12/03/2025

I feel like every paper I read about LLMs in health care takes for granted that the encouraging, but not necessarily transformative, results we’ve seen so far are going to scale upward as LLMs improve. But are we really safe to assume that LLMs will keep getting better? I’m not so sure.

120

Timothy Keyes @timothykeyes.bsky.social · 12/03/2025

anyone who made me learn the brachial plexus will now be forced to understand gradients, sorry i don’t make the rules

000

Timothy Keyes @timothykeyes.bsky.social · 12/03/2025

forced my physician collaborators to listen to me talk about partial derivatives today

Meme of a still from a Dr. Phil interview. An unamused girl is pictured with a banner reading “aneska says violence works for her”

130

Timothy Keyes @timothykeyes.bsky.social · 08/03/2025

I can already tell that this paper is going triple-platinum in the Keyes household. Thank you for sharing!

100

Reposted by Timothy Keyes

Roxana Daneshjou, MD, PhD @roxanadaneshjou.bsky.social · 07/03/2025

It’s finally out! We brought a multidisciplinary team of physicians, computer scientists, and engineers to red team LLMs for healthcare uses. And we have shared the dataset! www.nature.com/articles/s41...

nature.com

Red teaming ChatGPT in medicine to yield real-world insights on model behavior - npj Digital Medicine

npj Digital Medicine - Red teaming ChatGPT in medicine to yield real-world insights on model behavior

24411

Timothy Keyes @timothykeyes.bsky.social · 01/03/2025

disclaimer: I haven’t finished medical school yet (i will someday!) so this is mostly stolen valor, but even having a small amount of clinical training has imo helped me so much to understand small details that my technical colleagues don’t really notice or care about

020

Timothy Keyes @timothykeyes.bsky.social · 01/03/2025

i’m working on a few really cool applications of LLMs in health right now (in the real world, in a deployment environment) and my most valuable asset by far in this work isn’t being the most technical person on the team (i’m not); it’s knowing just enough about medicine to ask the right questions

140

Reposted by Timothy Keyes

NEJM AI @ai.nejm.org · 19/02/2025

Dr. @emilyalsentzer.bsky.social, a Stanford faculty member and expert in clinical #AI, discusses the evolution of natural language processing, the challenges of AI in clinical settings, and what the future holds for open-source medical AI. Full episode: nejm.ai/4gOGeSo #MedSky #MLSky

AI Grand Rounds
Episode 27
From Clinical Notes to GPT-4: Dr. Emily Alsentzer on Natural Language Processing in Medicine

1176

Reposted by Timothy Keyes

Eric Topol @erictopol.bsky.social · 17/02/2025

"What I find hard to reconcile is, on the one hand, we want to not fall behind on AI writ large. And on the other hand, the very people we need to ensure that agility are being let go.”—Nigam Shah @stanfordhai.bsky.social

914524

Timothy Keyes @timothykeyes.bsky.social · 18/02/2025

i have to respect how non-technical folks use spreadsheets - they give you these beautiful murals with all kinds of colors and spacing and intricate patterns. i must say it really breaks my heart to immediately flatten it all with read_csv

020

Timothy Keyes @timothykeyes.bsky.social · 02/02/2025

(i appreciate the use of benchmarks and think they’re really valuable, but benchmarks must be drawn from some population of possible observations, right? so there will still be sampling error in any metrics computed using a benchmark, even if all models use the same benchmark)

010

Timothy Keyes @timothykeyes.bsky.social · 02/02/2025

i’ve been trying to understand why reporting some estimate of confidence intervals around performance metrics (or null hypothesis significance testing) is not more common in the machine learning/AI literature. i think this is changing, but there’s still a lot of weird (or missing) statistics ime

120

Timothy Keyes @timothykeyes.bsky.social · 31/01/2025

i think the vast ambiguity in the term “data scientist” causes a lot of headaches. am i an engineer? am i a computer scientist? am i a statistician? who knows!!!

110

Timothy Keyes @timothykeyes.bsky.social · 31/01/2025

started my day writing a few (simple) statistical proofs for a data science project (to justify simplifying a calculation from something complicated to something simpler and equivalent) and wow it really is nice to dust off the old PhD and put it to use every once in a while

020

Timothy Keyes @timothykeyes.bsky.social · 27/01/2025

This was such a wonderful read - thanks for sharing it @emilyriederer.bsky.social! I’ve been using poetry for package development recently, but now I’m eager to try uv!🤞 (And seaborn.objects might be a nice alternative to plotnine too!)

010

Timothy Keyes @timothykeyes.bsky.social · 03/01/2025

This is really cool! Congrats and thanks for sharing!

020

Timothy Keyes @timothykeyes.bsky.social · 23/12/2024

i rounded on stanford’s palliative medicine service today, and it was such a powerful reminder that end-of-life care clinicians are some of the most kind and empathetic people in health care. truly in awe of their ability to bear witness to (and guide people through) such difficult moments

010

Timothy Keyes @timothykeyes.bsky.social · 07/12/2024

Thanks for sharing! I’m excited to bring this to our group for journal club.

120

Timothy Keyes @timothykeyes.bsky.social · 06/12/2024

when someone tells you that they’ve solved an important problem using ai, that’s very exciting! but you should not take their word for it. if they don’t provide very transparent tools for monitoring/evaluating their ai product, it’s pretty safe to assume even *they* don’t know if it actually works

070

Timothy Keyes @timothykeyes.bsky.social · 06/12/2024

i am not an ai doomer by any stretch, but building ai systems (big or small) that solve useful problems in health care is really hard! validation experiments are really hard (and sometimes really expensive) to do! very few ai products work exactly as advertised, and many don’t work at all!

150

Timothy Keyes @timothykeyes.bsky.social · 06/12/2024

if i could distill my time in the world of health ai down to a single thesis statement, i think it would be that imo everyone in health care (patients, health care workers, researchers, caregivers of all kinds) should have a very, very healthy dose of skepticism about every ai product they encounter

180

Reposted by Timothy Keyes

Josiah @josiah.rs · 27/11/2024

Whattt?!

13810

Reposted by Timothy Keyes

Carolyn Bertozzi @carolynbertozzi.bskyverified.social · 23/11/2024

Now more than ever the world should learn about the life and impact of @stanfordmedicine.bsky.social neuroscientist Ben Barres, the movie is underway! @atqmovie.bsky.social

218738

Timothy Keyes @timothykeyes.bsky.social · 21/11/2024

Would love to be added! I’m trying to connect with as many health ML people as possible!

020

Reposted by Timothy Keyes

John Paul Helveston @jhelvy.bsky.social · 18/11/2024

This isn't really an #rstats vs #python thing but rather a tidyverse vs pandas thing, and for data wrangling the tidyverse API is just so darn good it's hard to compete with, which is why there are ports of it to other languages, e.g. Tidier in #julia, siuba in python

4339

Timothy Keyes @timothykeyes.bsky.social · 20/11/2024

today, i’m struggling a bit with how rare it feels to see those values reciprocated. but i refuse to become bitter! imo scientists who only care about how much they publish in fancy journals have missed the point. community, thoughtfulness, being a dependable colleague - these are all more important

030

Timothy Keyes @timothykeyes.bsky.social · 20/11/2024

one of the guiding principles of my life as a scientist (inherited from a mentor who has since passed away) has been to resist the incentives that foster egoism, possessiveness, and competition over collaboration in science - and to instead lead with generosity, openness, and lifting others up.

130

Timothy Keyes @timothykeyes.bsky.social · 19/11/2024

i am lucky to be on a strong team within a health system very committed to deploying ai responsibly, but i worry about smaller orgs who are not as well-resourced to sniff out the snake oil rampant in this field. i worry that they’ll take vendors’ claims at face value when they really shouldn’t

020

Timothy Keyes @timothykeyes.bsky.social · 19/11/2024

i’ve been working on the ai team at stanford health care for about a year and the overwhelming take-home message for me so far is to be increasingly horrified at how aggressively ai vendors will market their products without any apparent obligation to demonstrate that they actually work

181

Timothy Keyes @timothykeyes.bsky.social · 18/11/2024

i’ve been off the internet (ie tw*tter) for so long that i actually don’t remember how to write in pithy short-form anymore. all of my “terminally online” references are from 2022. i have 0 memes saved in my camera roll. i have a phd now like the vibes have shifted bro what do i do

030

Timothy Keyes @timothykeyes.bsky.social · 12/11/2024

The layout of this app is activating my long-suppressed medTw*tter instincts like a sleeper agent activation phrase.

000

Timothy Keyes @timothykeyes.bsky.social · 12/11/2024

Maybe I’ll actually start using this app. What’s the vibe? Who should I follow?

110

Timothy Keyes @timothykeyes.bsky.social · 08/09/2023

(fingers crossed for 🏳️‍🌈 people and data people)

110

Timothy Keyes @timothykeyes.bsky.social · 08/09/2023

now that i’ve followed a few people i’m really eager to take this new recommendation algorithm for a spin

150