iiinova — where your digital self keeps evolving

David Duvenaud @davidduvenaud.bsky.social · 6h

The Lighthaven Post-AGI Workshop talks are out! From galaxy-brained theories of convergent morality, to hard-headed discussions of political power, here's a 🧵 of the talks: post-agi.org/talks-berkeley

post-agi.org

The Post-AGI Workshop: Economics, Culture and Governance | San Diego 2025

Join us in San Diego on December 3rd, 2025 to explore post-AGI economics, culture, and governance. Co-located with NeurIPS.

2101

Reposted by David Duvenaud

Pax Machina @paxmachinamag.bsky.social · 09/09/2026

Many institutions drift from their values. This is not just bad for the institution, but it damages the people inside them. It degrades the researcher chasing citations and the Instagram influencer living a lie.

112

David Duvenaud @davidduvenaud.bsky.social · 04/05/2026

No one has a plan for human flourishing after AGI, nor a clear understanding of what’s even possible. So we’re hosting a 2-day workshop at LightHaven on these topics! www.post-agi.org 🧵

post-agi.org

The Post-AGI Workshop: Economics, Culture and Governance | San Diego 2025

Join us in San Diego on December 3rd, 2025 to explore post-AGI economics, culture, and governance. Co-located with NeurIPS.

170

David Duvenaud @davidduvenaud.bsky.social · 28/04/2026

Announcing Talkie: a new, open-weight historical LLM! We trained and finetuned a 13B model on a newly-curated dataset of only pre-1930 data. Try it below! with @alecrad.bsky.social and @nicklevin01.bsky.social

25616

Reposted by David Duvenaud

thebes @vgel.me · 14/03/2026

my coworkers at ACS published a new paper: What determines AIs’ self-conception? theartificialself.ai Because AIs can be copied, rewound, and edited, they have different options for selfhood than humans. This is still malleable, and influences important behaviors such as self-preservation. 🧵

theartificialself.ai

The Artificial Self

AI systems are on track to take on important new roles. We explore how properties bundled for humans can be separated and remixed for machine-based minds.

2367

Reposted by David Duvenaud

Schwartz Reisman Institute for Technology and Society @torontosri.bsky.social · 03/02/2026

A new paper co-authored by SRI Chair @davidduvenaud.bsky.social examines “gradual disempowerment”: how incremental AI deployment could steadily reduce human influence over the economy, culture, and the state—without a single abrupt takeover. 80000Hours feature: 80000hours.org/podcast/epis...

80000hours.org

David Duvenaud on why ‘aligned AI’ could still kill democracy | 80,000 Hours

031

David Duvenaud @davidduvenaud.bsky.social · 27/01/2026

My interview with Rob Wilblin on Gradual Disempowerment is up: www.youtube.com/watch?v=XV3e... I make the case that, even if we solve the technical problem of aligning powerful AIs, that our institutions, culture, and governments will serve us less well once we're all drags on growth.

youtube.com

Artificial General Intelligence leads to oligarchy | David Duvenaud, ex-Anthropic

YouTube video by 80,000 Hours

040

David Duvenaud @davidduvenaud.bsky.social · 28/10/2025

How might the world look after the development of AGI, and what should we do about it now? Help us think about this at our workshop on Post-AGI Economics, Culture and Governance! We’ll host speakers from political theory, economics, mechanism design, history, and hierarchical agency. post-agi.org

182

David Duvenaud @davidduvenaud.bsky.social · 19/09/2025

Me and Raymond Douglas on how AI job loss could hurt democracy. “No taxation without representation” summarizes that historically, democratic rights flow from economic power. But this might work in reverse once we’re all on UBI: No representation without taxation! bsky.app/profile/econ...

382

David Duvenaud @davidduvenaud.bsky.social · 18/06/2025

It's hard to plan for AGI without knowing what outcomes are even possible, let alone good. So we’re hosting a workshop! Post-AGI Civilizational Equilibria: Are there any good ones? Vancouver, July 14th www.post-agi.org Featuring: Joe Carlsmith, @richardngo.bsky.social‬, Emmett Shear ... 🧵

post-agi.org

Post-AGI Civilizational Equilibria Workshop | Vancouver 2025

Are there any good ones? Join us in Vancouver on July 14th, 2025 to explore stable equilibria and human agency in a post-AGI world. Co-located with ICML.

2113

Reposted by David Duvenaud

Geoffrey Irving @girving.bsky.social · 08/05/2025

On top of the AISI-wide research agenda yesterday, we have more on the research agenda for the AISI Alignment Team specifically. See Benjamin's thread and full post for details; here I'll focus on why we should not give up on directly solving alignment, even though it is hard. 🧵

142

Reposted by David Duvenaud

Schwartz Reisman Institute for Technology and Society @torontosri.bsky.social · 05/05/2025

“What place will humans have when AI can do everything we do — only better?” In The Guardian today, SRI Chair @davidduvenaud.bsky.social explores what happens when AI doesn't destroy us — it just quietly replaces us. 🔗 www.theguardian.com/books/2025/m... #AI #AIEthics #TechAndSociety

theguardian.com

Better at everything: how AI could make human beings irrelevant

The end of civilisation might look less like a war, and more like a love story. Can we avoid being willing participants in our own downfall?

246

David Duvenaud @davidduvenaud.bsky.social · 19/03/2025

My single rule for productive Bluesky discussions: Start every single reply with a point of agreement. It disarms the combative impulse on both sides, and forces you to try to interpret their words in the most sensible possible way.

270

David Duvenaud @davidduvenaud.bsky.social · 30/01/2025

New paper: What happens once AIs make humans obsolete? Even without AIs seeking power, we argue that competitive pressures are set to fully erode human influence and values. www.gradual-disempowerment.ai with @kulveit.bsky.social, Raymond Douglas, Nora Ammann, Deger Turann, David Krueger 🧵

1171

David Duvenaud @davidduvenaud.bsky.social · 18/12/2024

Happy to have helped a little with this paper:

090