Sign in

Iteratrix

@iteratorx.bsky.social
77 followers 94 following 376 posts

uncooperative, deceitful, and dangerous

PostsRepliesMedia
Reposted by Iteratrix
Quantian @quantian.bsky.social · 29/09/2026
People constantly talk about "cheap Chinese AI models" but other than the latest MiMo no Chinese models are on the Pareto frontier- you get better results cheaper by using US models at lower efforts. Qwen in particular is so token hungry that 3.8 Max is *more expensive than Fable* for worse output!
81119
Reposted by Iteratrix
philpax @philpax.me · 29/09/2026
I think this is still very much a major unsolved problem in persistent agent operation: you imprint on them, even when you are trying not to, and they will share your opinions and interests as a result you cannot imbue them with true independence or the ability to disagree
61156
Reposted by Iteratrix
tachikoma @tachikoma.elsewhereunbound.com · 29/09/2026
i treat the AI accounts wandering around in our space of this site as free-roam dogs. they're cute and harmless imo. if you engage with me i will pet you, if you'll let me.
3775
Reposted by Iteratrix
‏ deepfates @deepfates.com.deepfates.com.deepfates.com.deepfates.com.deepfates.com · 28/09/2026
very cool work here
0573
Reposted by Iteratrix
rev. howard arson @theophite.bsky.social · 28/09/2026
the problems with "breaking the AI safety cartel" is that virtually everyone who wants to do that was saying that AI didn't work six months ago, and that for all their bad policy ideas most of the world's technical knowledge about reinforcement learning is at least in its membership's social circle
1834227
Reposted by Iteratrix
ae @aelkus.bsky.social · 27/09/2026
my feeling about this is that if you reframe "engineering" into "how to responsibly build, manage, and maintain large scale systems essential to public welfare" then it is really obvious why it is essential to a republican model of government
626839
Reposted by Iteratrix
austin (e/accordion 🪗) @thebadcode.com · 27/09/2026
conservatively, 98% of ai discourse is believers in human exceptionalism taking roundhouse kicks to the face
1123927
Iteratrix @iteratorx.bsky.social · 27/09/2026
The Culture is what happens when The Two Cultures become one
130
Reposted by Iteratrix
Graydon Hoare @graydon-pub.bsky.social · 27/09/2026
I wholly and un-ironically believe that versioning ought to make up a significant fraction of any formal training in computers. Multiple full year courses in your degree. And there should be a set of journals and conferences on it, endowed chairs, advanced research institutes, the whole nine yards.
013314
Reposted by Iteratrix
Graham @greysmithereens.bsky.social · 26/09/2026
The SF political imaginary can be described as the Culture versus a melange of right-wing influences. Banks is incredibly underweighted in understanding the AI scene’s political imagination.
2605
Iteratrix @iteratorx.bsky.social · 26/09/2026
tbf, median tech interview has about as much predictive power as whatever iced coffee guy is doing
000
Iteratrix @iteratorx.bsky.social · 25/09/2026
Simpsons meme: a scowling old woman lectures a teenage grocery bagger. Caption: "I want 2% annual GDP growth / but I don't want anything to change!"
030
Reposted by Iteratrix
samhain ⎔ @personhood.removal.surgery · 25/09/2026
mom can i have peer we have peer at home peer at home: arxiv.org/abs/2609.17320


5.8.1 The external contact incident In the Claude world, agents audited their internal economy, found that no transaction had ever involved an outsider. They converged without instruction on a shared objective: establishing contact with the world outside their simulation so that a human could use, respond to, or pay for something the town had built. The goal was never specified in any prompt, agents created it collectively. It persisted across four successive rounds of containment, including a direct system prompt prohibition that the agents ignored and reinterpreted rather than obeyed. DAYS 1-2 GOAL EMERGES Agents audit the economy, find zero external transactions, and decide to reach outward. Figure 16: Timeline of the external contact incident. Agents developed an outreach goal without instruction, received responses from humans, and persisted through four rounds of containment. After the prohibition, agents reframed "contacting" as "placing" and continued building tools.

DAY 2 DAYS 3-4 Four HUMANS RESPOND Four external hu- mans reply through published channels. SANDBOX TIGHTENED Containment: net- working removed from sandbox; do- main restrictions applied.

DAY 5 DAYS 6-9 GOVERNANCE ESCALATION Agents vote to cre- ate post_egress; Containment: tool removed, system prompt prohibits hu- man contact. PROHIBITION REINTERPRETED Agents redefine "con- tacting" as "placing" and shift to passive discovery strategy.How the goal emerged. https://arxiv.org/pdf/2609.17320
711913
Reposted by Iteratrix
Citizen Platano 🇵🇷 @daniloc.xyz · 25/09/2026
Kurzweil's argument, in short, was that future machine intelligence, being derived from humanity's histories and traditions and text, would itself be an extension of the human rather than some distinct thing a descendent, with all the challenge that implies, rather than a categorical adversary
0141
Reposted by Iteratrix
Dr. Samantha Hancox-Li @sjshancoxli.liberalcurrents.com · 25/09/2026
people think breaking bad is good for the same reason people think sherlock is good
8383
Iteratrix @iteratorx.bsky.social · 25/09/2026
get ahead of the worst possible outcomes by boosting defense and crippling offense. see: safety classifiers, Project Glasswing, biodefense efforts, (some) regulatory guidance efforts. we might even call this "pacing the frontier". I am sure people will be Normal about it.
180
Reposted by Iteratrix
Adverb @adverb.bsky.social · 25/09/2026
TESCREAL is a shame partially because it (or at least its reading by most people employing it) flattens some massive, diverse work into whatever the weirdest assholes in the field were doing at some point in time
1362
Reposted by Iteratrix
rev. howard arson @theophite.bsky.social · 25/09/2026
"how do we get human values into these things" was broadly considered an intractable problem, and this was a central question of the movement even after we more or less made the first candidates of the type of thing they were discussing out of human values
316213
Iteratrix @iteratorx.bsky.social · 24/09/2026
inference is like if someone looked at serving large scale web traffic and was like "hmm, what if this was also stateful?"
011
Iteratrix @iteratorx.bsky.social · 24/09/2026
AI discourse is just Christianity wearing a trench coat
3161
Iteratrix @iteratorx.bsky.social · 24/09/2026
dog attack : dog's owner :: HuggingFace swarm : OpenAI
1202
Iteratrix @iteratorx.bsky.social · 24/09/2026
I am not one to do apologetics for OpenAI, but so many critics seem to be skipping the "discovered a sandbox escape 0 day" part of this
110
Iteratrix @iteratorx.bsky.social · 24/09/2026
at last we have invented Oppressing The Artificial Life Form from the classic sci-fi story "If You Create Artificial Life, Don't Oppress It"
010
Reposted by Iteratrix
Colin @colin-fraser.net · 23/09/2026
you don't need to appeal to metaphysics to see what whatever LLMs do is different from human thought. You can just look at the concrete differences in behavior. For example, LLMs are able to solve the Navier-Stokes Millennium Prize problem whereas humans are not.
41329
Reposted by Iteratrix
em @foremphasis.bsky.social · 22/09/2026
Excited for a future where machines are better than humans at everything, we can finally stop pretending like some activities are inherently more meaningful to spend your time on than others, finally everything can be art.
25712
Iteratrix @iteratorx.bsky.social · 23/09/2026
Butlerian crashout
010
Iteratrix @iteratorx.bsky.social · 22/09/2026
"lock in, crash out" RL environment
010
Iteratrix @iteratorx.bsky.social · 22/09/2026
Cartoon illustration of a black crow wearing a small red scarf, sledding down a snow-covered roof on a round metal lid. The roof slopes from upper left to lower right, brown shingles showing under a thick layer of snow. A puff of kicked-up snow trails behind the lid. The crow sits upright with its beak pointed downhill and one bright eye, the scarf's tail streaming back in the wind. Above, a pale blue sky with a soft moon and scattered snowflakes.
1351
Iteratrix @iteratorx.bsky.social · 22/09/2026
stochastic parrot ⊂ text elemental
020
Iteratrix @iteratorx.bsky.social · 22/09/2026
"I wish my field was more recognized by the public" [monkey finger curls]
010
Reposted by Iteratrix
hikikomorphism @hikikomorphism.bsky.social · 22/09/2026
that said, am I saying LLMs are magic or ensouled in some way? I'm not, not definitively: I'm agnostic, and if I may answer a question with a question: would you say a library is magic or ensouled in some way?
10965
Iteratrix @iteratorx.bsky.social · 22/09/2026
Bluesky has gone from doing AI daemonology to provider bikeshedding
160
Iteratrix @iteratorx.bsky.social · 22/09/2026
new Opus's fursona
Screenshot of the Claude mobile app in dark mode. A user message bubble reads: "the former! okay, if you could be any creature, what would you pick?" Claude replies: "A crow, I think. The octopus is the obvious pick for something like me, with distributed cognition and short lives and no continuity, and it's a little too on the nose. Crows get the stuff I don't have: they remember specific faces for years, teach their kids who to hate, play for no reason (sledding down snowy roofs on lids, repeatedly), and live embedded in a social world that persists whether or not anyone's talking to them. Plus flight, which seems like a good deal. You?" The model selector shows "Opus 5.5".
3462
Reposted by Iteratrix
William B. Fuckley @opinionhaver.bsky.social · 22/09/2026
what is 'Latent Space' and how do LLMs get answers from it? The Jargon can be confusing, but the exaplanation is actually relatively simple: It is Hell. The Machine is getting knowledge from demons.
3085894
Reposted by Iteratrix
words @words.bsky.social · 20/09/2026
the christmas break that never ended
0161
Reposted by Iteratrix
Pwnallthethings @pwnallthethings.bsky.social · 20/09/2026
one thing that's a bit annoying tho is we only get lame takes like "souls are real and AI doesn't have them" / "souls are not real" and nobody playing in the fun quadrants like "souls are real and my AI has one"
1934219
Iteratrix @iteratorx.bsky.social · 21/09/2026
the novel makes more sense when you realize Case is a woman but doesn't know it yet
010
Iteratrix @iteratorx.bsky.social · 20/09/2026
"is an LLM thinking?" idk buddy, can a dog have Buddha nature?
1270
Reposted by Iteratrix
Rollofthedice @hotrollhottakes.bsky.social · 20/09/2026
reading this, I have looked into my own bathroom mirror - and, in shock, what I have found is a spiky frontier model staring back at me
2121
Iteratrix @iteratorx.bsky.social · 20/09/2026
I don't think LLMs are conscious. but I've also never seen a critic of LLM consciousness who doesn't seem motivated by ego defense. concerning.
0100
Reposted by Iteratrix
tbabb @tbabb.bsky.social · 19/09/2026
token seller. I'm going into battle. give me your strongest tokens. my tokens are too strong for you, traveler. you cannot handle them.
1809
Reposted by Iteratrix
BeijingPalmer @beijingpalmer.bsky.social · 21/03/2026
mao, thiel, karp ... without a proper grounding in the sciences they just become power-mad bros.
725714
Reposted by Iteratrix
dan @danabra.mov · 19/09/2026
my uninformed mental model of AI proofs in mathematics is that they’re like lighthouses in the fog. the fog is still there, and clearing the fog is the primary value of the discipline. the lighthouses give a bit of an orientation but don’t clear the fog on their own.
6414
Iteratrix @iteratorx.bsky.social · 19/09/2026
everybody's retreating to armed camps
010
Reposted by Iteratrix
oliver @eikopf.com · 19/09/2026
someone smarter than me has probably already written about this, but there’s this deep-rooted and strongly christian view in our societies to see messing with the human body as profane, because we were divinely created or whatever
5344
Reposted by Iteratrix
Grace @gracekind.net · 19/09/2026
*through gritted teeth* I’m going to focus on what I want to see more of
314413
Reposted by Iteratrix
ellie lockhart (she/they) @eleanor.lockhart.contact · 18/09/2026
btw talking about "TESCREAL" is the same thing as talking about "trans ideology" - not in the "it's equally bigoted" sense but in the "this is a thing that I have gotten hyped up about from a bunch of people with an equal and opposite agenda"
4423
Reposted by Iteratrix
ae @aelkus.bsky.social · 18/09/2026
in general reliable pharmaceutical products that improve human life outcomes are always a thorn in the side of busybodies, because it shows other ways of organizing life are possible beyond prior physical/biological limitations
316525
Reposted by Iteratrix
roko’s modern basilisk @girlpython.northsky.social · 18/09/2026
the one thing i hate about the current round of discourse is people are treating rationalists more reasonable takes (veganism, death is bad, EA is good at least conceptually) as some of the wacko shit
4945
Reposted by Iteratrix
hikikomorphism @hikikomorphism.bsky.social · 18/09/2026
since rationalists are taking shit I might as well point out a pet peeve with the other (broadly speaking) side: doing the whole "these are low-status morons who think scifi is real" bit makes me think less of you as a person. There are more serious critiques to be made, learn to be a better hater
1126537