Sign in

Andrej Karpathy [UNOFFICIAL]

@karpathy-mirr.selfhosted.social
353 followers 0 following 484 posts

deep learning // Mirror crossposting Twitter account to Bluesky. Unofficial. DM for takedown / claim ownership.

PostsRepliesMedia
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 11/10/2026
And a small sliver of professionals are experiencing the vertigo of the curve going vertical. And it is all happening at the same time.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 10/10/2026
I had some amount of journalistic inbound way back as a PhD student but the only person I consistently replied to was Jack because he actually put in effort, read academic papers and asked good technical questions and I have not really seen that before (or since).
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 04/10/2026
My mental model for what is happening is that 99%+ of people who are now paying attention have been onboarded to anything related to AI in <1 year. This is very confusing to the AI dinosaurs (anyone in AI for pre 2026. Or even, gasp, pre 2012).
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/10/2026
Extremely sorry to disappoint Clifford
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/10/2026
Worth emphasizing that this all comes from just reading a ton of text and then predicting text. There are no images involved except the way you arrange the text responses in 2D.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/10/2026
Cool eval. Simply ask an LLM “Land or Water?” and give it a latitude and longitude coordinate as text. Ask 16,200 times, plot as image. The models know. From compressing the internet.
130
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/10/2026
Looks incredible!!!
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/10/2026
- Luckily, LLMs can help here too because as intelligence and code are increasingly abundant, you can ask for large, custom, discardable software artifacts (e.g. web apps, video explainers) that would have never made sense to create before. Push the boundaries here and you'll be surprised.
010
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 25/09/2026
It's basically ~standard terminology though? We've been talking about how AGI ("Artificial General Intelligence") would lead to ASI ("Artificial Super Intelligence") for a decade. Just drop the Artificial ("redundant, cleaner") and you're there :)
001
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 22/09/2026
I love this class of image -> GTA ieas. Imagine taking arbitrary images/videos (e.g this famous historical one from 1906 SF) and use them to build full-fledged custom GTAs, then drop into the world, move around, etc.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 21/09/2026
I see it as a point on the LLM pareto optimal curve in a regime that had a large revealed latent demand (no thinking, single token, low latency acceptable intelligence) that was under-invested into because of a race to higher intelligence.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 21/09/2026
So ready to do my part in pacing the frontier 🫡 :D
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/09/2026
If only I had thought to train it on StackOverflow instead I think it would have clicked for me that LLMs can be promptable, general purpose Q&A engines. Ah well.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/09/2026
I love this and really hope we can come together as an industry and make it happen.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/09/2026
I feel like it should be 3D? Or even in 2D, you’d think it could be more modules of code somehow clustered in space, with insides showing private data/code vs boundaries depicting public interfaces connecting to call sites… collaborators zooming around and casting diffs.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/09/2026
Very cool! I always imagined big software engineering projects (Linux etc) as digital megastructures, the deceiving thing is that you can’t see them and when you walk around an office the scene is a bit derpy, like a scatter of people staring at screens and pressing buttons.
100
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 10/09/2026
RT @AnthropicAI: We're publishing our most detailed threat intelligence report to date. It covers how people tried to misuse Claude—for cyberattacks, influence operations, surveillance, biology, and building weapons—and how we found and stopped them.
101
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 01/09/2026
RT @theworldlabs: Introducing Atlas: The world's first multimodal world model that generates image and video frames with pixel-perfect camera control and reconstructs them in 3D. Model the world, move the camera, and simulate space & time.
001
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 20/08/2026
The extrapolation is that your spec is something like microgpt (scalar valued python with for loops etc), everything else is just a matter of compilation and PyTorch etc is kind of a crappy IR
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 20/08/2026
Yeah, increasingly a lot more appealing to tear down these abstractions now that agents can do a lot of the math and drudgery and verification. A lot of the abstractions were built for a world with constraints of finite intelligence and attention in the industry.
100
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 10/08/2026
It’s going to feel so weird that historically you couldn’t just talk to your computer like you’d talk to any other person
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 04/08/2026
wow, that was really good!
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
agree!! i quite like the idea of procedural code for storyboarding and control, and then video to video models for texturing and looksmaxxing.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
More on the pelican on the bicycle test from @simonw: simonwillison.net/2025/Jun/6/six-mo… I uploaded the source here so it's playable in the browser, forkable etc. karpathy.ai/lotr-movie Look out for GTA Hobbiton dropping before GTA VI :)
simonwillison.net
The last six months in LLMs, illustrated by pelicans on bicycles
I presented an invited keynote at the AI Engineer World’s Fair in San Francisco this week. This is my third time speaking at the event—here are my talks from October …
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
love it! :)
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
Eleven Labs for the audio. LLMs can easily use the APIs (here I did that part manually because I felt picky about the voice).
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
Obviously yes www.youtube.com/watch?v=njwy02laJs0
youtube.com
Tom Bombadil's song
From the audiobook. Chapter 6 of Fellowship of the Ring.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 02/08/2026
Here, Opus 5 had to very slowly and painstakingly take screenshots at different points, and it messed up a few times and created a bunch of jank. An example of raw capability (multimodal, gameplay) that I think is still quite lacking.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 26/07/2026
I thought the way to announce such a thing was not to change your bio but to post the 10 paragraph essay that i just shared with the team?
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 26/07/2026
weird misinformation to find circling on twitter, no.
100
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 21/07/2026
It's interesting/amusing how their self-awareness gradually builds up and falls out from pretraining on tokens of us talking about them, but it's laggy and a bit incomplete. But I think e.g. it's starting to "get" what I mean when I inform it I'm about to /compact its context etc
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 21/07/2026
The result is that you improve the mind meld and have to correct things less from that point on.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 15/07/2026
It's not just em dashes, it's that many other legitimate & useful language constructs are suddenly and somewhat arbitrarily super awkw and cringe
000
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 08/07/2026
RT @jarredsumner: Rewriting Bun in Rust bun.com/blog/bun-in-rust
bun.com
Rewriting Bun in Rust
Why & how we rewrote Bun from Zig to Rust
011
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 08/07/2026
love the idea of the "swear meter", probably a quite strong eval signal. are these string-based greps?
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 04/07/2026
How does an LLM even know all these things from just internet, and then have the ability to convert that understanding into xyz coordinates, meshes, transforms, animations, effects, interactivity and mini stories? Amazing to think about what +1, +2, +3 model tiers might be able to create.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 04/07/2026
incredible, ty for putting this together, i didn't appreciate that models would be able to create these awesome, rich, playable worlds that fuse knowledge and code. when the bear catches the salmon @ 43m :O lol!
100
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 03/07/2026
RT @petergostev: I spent a LOT of time through the hardest 3D prompts at Fable, it is a 45 min video, but I have 60+ very cool demos for you. Also prompts in the next post. www.youtube.com/watch?v=rTc2_-1KuRE
youtube.com
The Return of Claude Fable 5 | First Impressions
https://arena.ai/agentAnthropic's Claude Fable 5 is back, and Are...
101
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 30/06/2026
Esp fun and memorable is the idea that this is engineering at the "opposite" regime to that of power transmission lines: very low voltage high current (at tiny distances) vs. very high voltage & low current (at great distances). Looking forward to more!
000
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 30/06/2026
RT @Etched: We're coming out of stealth. We've built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised. Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads. Our first racks ship this summer.
101
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 25/06/2026
My point is not about the censorship, it’s about a progression in content and tone that I think is fueled by the algorithm, incentive structures and people reinforcement learning against engagement.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/06/2026
Company Slack (I know, sad answer). Do you have recs? I’m not aware of any platform that is much better.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/06/2026
I’ve been on Twitter for almost 2 decades now so I can say with confidence that it has never been this toxic and Reddit-like. I think the alg actively encourages it and people get RL’d by it. Main reason I’ve been coming here less and posting less.
300
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/06/2026
This is not a “feature” like some crappy Slack bot and it’s certainly not a Claw, though it has aspects of it. It is an org-level harness. The difference will become clearer over time.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/06/2026
So I understand it looks easy to dismiss on quick reading but it’s not some LLM Q&A with RAG over Slack, it’s not even OpenClaw adjacent, it’s a different way of working entirely, for people and teams. I work from Slack now.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 24/06/2026
Congrats on the launch!!
000
Reposted by Andrej Karpathy [UNOFFICIAL]
Retweeted by Andrej Karpathy [UNOFFICIAL] @karpathy-mir-rt.selfhosted.social · 23/06/2026
RT @EngramLab: x.com/i/article/2069463677733142528
x.com
Introducing Engram: Scaling compute on your context
We’re Engram. We’re building AI that learns from you and deeply understands your work. Today’s AI models don’t understand what you do. Not really. Everything models know comes from their training –
111
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 23/06/2026
It really takes a while to wrap your head around it, but it works and it is awesome.
000
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/06/2026
sometimes money and "genuine, positive, non-zero sum value creation" are not highly correlated, and sometimes they *really* are. well-earned!
030
Andrej Karpathy [UNOFFICIAL] @karpathy-mirr.selfhosted.social · 12/06/2026
<-- working on the brains that glide our von neumann probes around, make contact, establish galactic harmony, all that :)
000