iiinova — where your digital self keeps evolving

Hamel Husain

@hamel.bsky.social

6.7K followers 655 following 129 posts

evals evals evals. evals.info

Posts Replies Media

Hamel Husain @hamel.bsky.social · 31/08/2026

Over the summer, @sh-reya.bsky.social and I hosted 13 sessions on AI Engineering topics like retrieval, post-training, inference, and evals. I've summarized all the sessions, organized by theme, with links to the source materials. Enjoy! hamel.dev/notes/llm/ai...

2143

Hamel Husain @hamel.bsky.social · 08/11/2025

👀 Animals have been assigned. Scheduled to print fall 2026! We have iterated on this with over 3k students (and continue to do so). We give our students access to the full draft as part of our evals course (link in bio)

1281

Hamel Husain @hamel.bsky.social · 03/10/2025

"Can I just get an LLM to do my error analysis?" We get this question constantly. The answer is no, and trying is the fastest way to miss critical bugs. Full podcast: youtu.be/BsWxPI9UM4c?...

080

Hamel Husain @hamel.bsky.social · 03/10/2025

I recently sat down with Lenny Rachitsky to discuss why AI Evals are becoming the most sought after skill for product builders. As a bonus, we step through an end-to-end example of building an eval in a spreadsheet so everyone can understand. See reply for links.

170

Hamel Husain @hamel.bsky.social · 08/06/2025

Last chance to signup for this free lesson with OpenAI on evals, Including a sneak peek of their new eval products! Link: maven.com/p/d2dc30/how...

020

Hamel Husain @hamel.bsky.social · 17/05/2025

Can non-data scientists write AI Evals? The answer is nuanced and not just "Yes". @eugeneyan.com and I discuss this in the context of the "analyze-measure-improve" cycle from our course. Links to more resources in the reply

180

Hamel Husain @hamel.bsky.social · 12/05/2025

If you are writing evals without error analysis, our course AI Evals for Engineers & PMs is for you. Begins monday next week. Full syllabus in this link: maven.com/parlance-lab...

040

Hamel Husain @hamel.bsky.social · 29/04/2025

GitHub CoPilot is one of the first commercially successful LLM products (predating ChatGPT). What was the secret? A robust eval suite! In this lightning lesson, John Berryman will reveal the eval techniques (and mistakes) from working on this product maven.com/p/da8264/how...

2265

Hamel Husain @hamel.bsky.social · 27/04/2025

I keep hearing about the emerging role of AI PM. How is this any different than a normal PM? Is it hype? We are gonna find out in this free lightning lesson. I will ask difficult questions. With @schof.bsky.social and Aman Khan maven.com/p/544677/wha...

151

Hamel Husain @hamel.bsky.social · 16/04/2025

Last chance to sign up for this. Recording sent to everyone who signs up. maven.com/p/29a33a/hyb...

040

Hamel Husain @hamel.bsky.social · 14/04/2025

If you are building RAG applications, you don't want to miss this. Doug Turnbull is going to show you his tricks he's learned from a decade of optimizing retrieval in search systems, and how that transfers to RAG. Link: maven.com/p/29a33a/hyb...

0194

Hamel Husain @hamel.bsky.social · 07/12/2024

Are you frustrated by how GitHub renders Jupyter notebooks? I have public service that renders GitHub notebooks with Quarto nbsanity.com It now works with gists!

76714

Hamel Husain @hamel.bsky.social · 03/06/2023

Just Incase someone else doesn’t know 😂

020