Nate @so8res.bsky.social · 06/03/2026I agree. There are actions that AI execs could yet take that would make a big difference for Earth's survival, by alerting the world to the danger. In fact, some actions far short of burning the whole company down could help in that regard. 021
Nate @so8res.bsky.social · 06/03/2026In an interview today I said AI execs don't really have the power to stop this suicide race; we need global intervention. The interviewer objected that if one of these companies simply shut down, foregoing billions and tanking lawsuits, the world wouldn't be able to ignore it. 120
Nate @so8res.bsky.social · 05/03/2026I'm partway through seven Spanish interviews and three Dutch ones, and they're asking great questions. No "please relate this to modern politics for me", just basics like "What do you mean that nobody understands AI?" and "Why would it kill us?" and "holy shit". Warms the heart. 040
Nate @so8res.bsky.social · 05/03/2026For anyone interested in learning more about the extinction threat, Eliezer and I recently wrote a book about it: ifanyonebuildsit.com. It's a grim title, but it starts with "if", and the book ends on a hopeful note. The danger can be averted if we act in time.ifanyonebuildsit.comIf Anyone Builds It, Everyone DiesThe race to superhuman AI risks extinction, but it's not too late to change course. 011
Nate @so8res.bsky.social · 05/03/2026I'm honored that you took the time to speak with us. It gives me hope. 100
Nate @so8res.bsky.social · 02/03/2026ChatGPT is just a sophisticated text transformer. ChatGPT cannot kill you. That doesn't mean that smarter text transformers are impossible, nor that they would be safe. 010
Nate @so8res.bsky.social · 02/03/2026A housecat is just biochemical reactions. A housecat cannot kill you. That doesn't mean that tigers are impossible, nor that they are safe. 110
Nate @so8res.bsky.social · 19/02/2026When it comes to stopping the reckless race to artificial superintelligence: Don't sit around hoping for a warning shot. Prepare well. 020
Nate @so8res.bsky.social · 19/02/2026The moral of the first tale is that warning shots alone don't save you. The moral of the second tale is that you don't need to wait for exactly the right disaster to do something you think needs doing. You just need to prepare well, and wait for an excuse. 120
Nate @so8res.bsky.social · 19/02/2026A tale of two warning shots, #2: George W. Bush was worried about Saddam Hussein. Some completely unrelated terrorists slammed planes into the twin towers. That was the final straw. The USA took out Saddam Hussein. 110
Nate @so8res.bsky.social · 19/02/2026A tale of two warning shots, #1: COVID happened. Scientists are divided on whether it was a lab leak. The world did not rally against dangerous viral research in labs. The warning shot was squandered. 121
Nate @so8res.bsky.social · 17/02/2026(Also: modern AIs are trained on problem-solving, not just prediction. But even ignoring that, "next-token prediction" is not an atomic ability that is superficial and therefore safe; doing it really really well would require potent & dangerous internal mechanics.) 010
Nate @so8res.bsky.social · 17/02/2026"The AI just predicts the next token" is like "the container just lifts up." How does it achieve lift? Both a hot air balloon and a rocket lift up, but one of them violently explodes and kills everyone in range if you design a big one even slightly wrong. 100
Nate @so8res.bsky.social · 15/02/2026Just having the book in front of the crowd here was probably worth more than all my sideline interviews and roundtables combined. I'm honored by whoever made that call. I've heard folks behind the conf see superintelligence as a possibility worth putting on the radar. Progress. 010
Nate @so8res.bsky.social · 15/02/2026The empty holders are where more copies used to sit, and at the beginning of the conference there were stacks. When I walked in just now, the people working at the bookstore were reading it and asked for my signature. 100
Nate @so8res.bsky.social · 15/02/2026The Munich Security Conference has a little bookstore where they feature about a dozen books, including If Anyone Builds It, Everyone Dies. Most of the books have multiple stacks left. My book has exactly one copy left. 110
Nate @so8res.bsky.social · 13/02/2026I gave my remarks to a bunch of high-powered intelligence community folks, and didn't shy away from the dangers. Most responded with something mild that avoided acknowledging superintelligence was a possiibilty. But they also didn't argue against it. I'm honored they invited me. It's progress. 010
Nate @so8res.bsky.social · 13/02/2026A couple people have recognized me and told me they like my book and confided in me that they harbor worries. Then when it's their turn to talk they say something mild that avoids acknowledging superintelligence as a possibility. 100
Nate @so8res.bsky.social · 13/02/2026I also feel a bit like a child here because it keeps feeling like I'm the child straight out of "The Emperor Has No Clothes". 100
Nate @so8res.bsky.social · 13/02/2026I was invited to give remarks at a high-powered intelligence community dinner, but my badge lacked the "high powered intelligence community member" marker so I got held up at the door until a grownup came and rescued me. 100
Nate @so8res.bsky.social · 13/02/2026I, uh, also had to go to the mall and buy a suit real quick, once I noticed what kind of conference I was at. 100
Nate @so8res.bsky.social · 13/02/2026For some reason the check-in instructions didn't make it to me, so I just tried to waltz onto the premises rather than routing through the special check-in desk that was squirreled away in a building I was unaware of. The police didn't love that. 100
Nate @so8res.bsky.social · 13/02/2026I feel like a child here, in part because most everyone else is older and in part because I keep having funny mishaps. For instance: 100
Nate @so8res.bsky.social · 13/02/2026I'm at the Munich Security Conference. It's interesting. It feels a lot like a normal academic conference, except it's packed with generals and senators and there's armed police pouring out or every orifice. 🧵 130
