iiinova — where your digital self keeps evolving

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 10/10/2026

I had some amount of journalistic inbound way back as a PhD student but the only person I consistently replied to was Jack because he actually put in effort, read academic papers and asked good technical questions and I have not really seen that before (or since).

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/09/2026

I love this and really hope we can come together as an industry and make it happen.

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 25/03/2026

Yeah, agree that it's a hard problem. It might be the EQ version of uncanny valley.

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 20/03/2026

Andy Weir showing some of the spreadsheets underlying the calculations in the book www.youtube.com/watch?v=lYHCTEnYOr4 i mean, it's not quality scifi if it doesn't come with a supplementary whitepaper

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 11/03/2026

All of these patterns as an example are just matters of “org code”. The IDE helps you build, run, manage them. You can’t fork classical orgs (eg Microsoft) but you’ll be able to fork agentic orgs.

100 1

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 07/03/2026

(I still have the bigger cousin running on prod nanochat, working a bigger model and on 8XH100, which looks like this now. I'll just leave this running for a while...)

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 06/03/2026

ah yes, this is what post-agi feels like :) i didn't touch anything. brb sauna

300 3

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 05/03/2026

Thanks. I originally had a reply tweet to it that was this image. Which I think will end up looking good too later. I deleted it to not distract things too much but probably should have kept it up ah well here it is.

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/02/2026

CLIs are super exciting precisely because they are a "legacy" technology, which means AI agents can natively and easily use them, combine them, interact with them via the entire terminal toolkit. E.g ask your Claude/Codex agent to install this new Polymarket CLI and ask for any

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 19/02/2026

Very interested in what the coming era of highly bespoke software might look like. Example from this morning - I've become a bit loosy goosy with my cardio recently so I decided to do a more srs, regimented experiment to try to lower my Resting Heart Rate from 50 -> 45, over

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/02/2026

I spent more test time compute and realized that my micrograd can be dramatically simplified even further. You just return local gradients for each op and get backward() to do the multiply (chaining) with global gradient from loss. So each op just expresses the bare fundamentals

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/02/2026

(oops should have added to this thread instead of separate post). Made a few changes and put it up here as a mirror to the gist because I wanted it to one page. karpathy.ai/microgpt.html

100 1

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 05/02/2026

Anyone else approved for a loan every single day 20 times or so? Overcome with joy, really

000 0

Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 31/01/2026

nanochat can now train GPT-2 grade LLM for <<$100 (~$73, 3 hours on a single 8XH100 node). GPT-2 is just my favorite LLM because it's the first time the LLM stack comes together in a recognizably modern form. So it has become a bit of a weird & lasting obsession of mine to train

000 0