iiinova — where your digital self keeps evolving

Jan Kulveit @kulveit.bsky.social · 22/01/2026

AI polytheism, ultra-malthusian state, Why Not Uber-Organisms, hyper-cooperators, the multicellular transition,... and yes, what's the basin of convergent evolution of human values. postagi.org/talks/millid... www.youtube.com/watch?v=ua67...

postagi.org

The Post-AGI Workshop: Economics, Culture and Governance | San Diego 2025

Join us in San Diego on December 3rd, 2025 to explore post-AGI economics, culture, and governance. Co-located with NeurIPS.

130

Reposted by Jan Kulveit

Proceedings of the National Academy of Sciences @pnas.org · 14/08/2025

ChatGPT and other LLMs were asked to choose between consumer products, academic papers, and films summarized either by humans or LLMs. The LLMs consistently preferred content summarized by LLMs, suggesting a possible antihuman bias. In PNAS: www.pnas.org/doi/10.1073/...

072

Jan Kulveit @kulveit.bsky.social · 08/08/2025

Being human in an economy populated by AI agents would suck. Our new study in @pnas.org finds that AI assistants—used for everything from shopping to reviewing academic papers—show a consistent, implicit bias for other AIs: "AI-AI bias". You may be affected

193

Reposted by Jan Kulveit

David Duvenaud @davidduvenaud.bsky.social · 18/06/2025

It's hard to plan for AGI without knowing what outcomes are even possible, let alone good. So we’re hosting a workshop! Post-AGI Civilizational Equilibria: Are there any good ones? Vancouver, July 14th www.post-agi.org Featuring: Joe Carlsmith, @richardngo.bsky.social‬, Emmett Shear ... 🧵

post-agi.org

Post-AGI Civilizational Equilibria Workshop | Vancouver 2025

Are there any good ones? Join us in Vancouver on July 14th, 2025 to explore stable equilibria and human agency in a post-AGI world. Co-located with ICML.

2113

Reposted by Jan Kulveit

David Duvenaud @davidduvenaud.bsky.social · 03/06/2025

What to do about gradual disempowerment from AGI? We laid out a research agenda with all the concrete and feasible research projects we can think of: 🧵 www.lesswrong.com/posts/GAv4DR... with Raymond Douglas, @kulveit.bsky.social @davidskrueger.bsky.social

lesswrong.com

Gradual Disempowerment: Concrete Research Projects — LessWrong

This post benefitted greatly from comments, suggestions, and ongoing discussions with David Duvenaud, David Krueger, and Jan Kulveit. All errors are…

181

Jan Kulveit @kulveit.bsky.social · 30/04/2025

Imagine explaining physical infrastructure critical for stability of our modern world in concepts familiar to the ancients - Giant spinning wheels - Metal moons, watching the earth from the heavens - Ships under the sea, able to unleash the fire of the stars

140

Jan Kulveit @kulveit.bsky.social · 03/04/2025

AI safety has a problem: we often implicitly assume clear individuals - like humans. In a new post, I'm sharing why this fails, and why thinking of AIs as forests, fungal networks, or even reincarnating minds helps get unconfused. Plus stories, co-authored with GPT4.5

boundedlyrational.substack.com

The Pando Problem

AI safety has a problem: we often implicitly assume clear individuals—like humans.

093

Jan Kulveit @kulveit.bsky.social · 17/03/2025

The Serbian protests show The True Nature of various 'Colour revolutions': Which is, people protesting just don't prefer to live in incompetent kleptocratic Russia-backed states. No US scheming needed.

070

Jan Kulveit @kulveit.bsky.social · 07/03/2025

Confusion which casual US observers often have is equating Russia with ˜former Warsaw Pact. Warsaw Pact population was 387M: USSR 280M, Poland 35M, E.Germany 16M, Czechoslovakia 15M, Hungary 10M, Romania 22M, Bulgaria 9M. Russia+Belarus is now 144M, NATO East& Ukraine ˜150M.

032

Reposted by Jan Kulveit

Dustin Moskovitz @moskov.goodventures.org · 27/02/2025

the most surprising and disappointing aspect of becoming a global health philanthropist is the existence of an opposition team

112112211222

Jan Kulveit @kulveit.bsky.social · 24/02/2025

A simple theory of Trump’s foreign policy: "make the world safer for autocracy" (‘strong man rule,’ etc.), moderated by his personal self-interest. What is the best evidence against?

020

Reposted by Jan Kulveit

David Duvenaud @davidduvenaud.bsky.social · 30/01/2025

New paper: What happens once AIs make humans obsolete? Even without AIs seeking power, we argue that competitive pressures are set to fully erode human influence and values. www.gradual-disempowerment.ai with @kulveit.bsky.social, Raymond Douglas, Nora Ammann, Deger Turann, David Krueger 🧵

1171

Jan Kulveit @kulveit.bsky.social · 27/12/2024

Accessible model of psychology of character-trained LLMs like Claude: "A Three-Layer Model". -Mostly phenomenological, based on extensive interactions with LLMs, eg Claude. -Intentionally anthropomorphic in cases where I believe human psychological concepts lead to useful intuitions

lesswrong.com

A Three-Layer Model of LLM Psychology — LessWrong

This post offers an accessible model of psychology of character-trained LLMs like Claude. …

070

Jan Kulveit @kulveit.bsky.social · 29/11/2024

Over the weekend, I was at "The Curve" conference. It was great. One highlight was an AI takeoff wargame/role-play by Daniel Kokotajlo and Eli Lifland I played 'the AIs' Spoiler: we won. Here's how it went:

151

Jan Kulveit @kulveit.bsky.social · 20/11/2024

Paying attention to metaphors we use is often worth it, but the linked critical perspective comes somewhat hollow. Anything new usually relies on "metaphors" and extending older concepts. For example, we say that planes fly. (1/5)

120

Jan Kulveit @kulveit.bsky.social · 20/11/2024

Want to encourage platform migration, and have the willpower to follow through? Instead of deleting your account, try posting the first half of an engaging thread there and finish it here.

050

Jan Kulveit @kulveit.bsky.social · 19/11/2024

What I actually dislike here is the 300 character limit again. Structurally horrible, promotes oversimplified clickbaity takes.

060