Reposted by Dave KastenNute @nutedawn.bsky.social · 15h1. RM is of course entirely right. Sulla wiped out his enemies and totally remade all of Rome’s institutions, and it *didn’t work* 2. I think it’s also extremely important to understand *why* it didn’t work, as Ronald Syme memorably put it… 627951
Reposted by Dave Kastentbabb @tbabb.bsky.social · 10/10/2026reality is starting to push through the cracks for some people 222219
Reposted by Dave Kastendavid @dhla.me · 09/10/2026Pretty unambiguous why they put an Israeli flag in there alongside alleging that AIPAC is behind data centers - not because it’s true but because, well, (((you know))) 15710
Reposted by Dave KastenEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 08/10/2026Most AI consciousness people do not believe current models are conscious but believe that it will be hard to tell when the transition happens and so it is worth putting in place appropriate mitigations in advance 416615
Dave Kasten @davekasten.bsky.social · 09/10/2026Not sure that must follow -- You can oppose farm animal cruelty without thinking a farm animal is enslaved. (But yes, I am worried that future AIs could have moral status where we'd call it slavery, and do not intend to use any such AI barring fucked-up philosophy class hypothetical situations) 030
Dave Kasten @davekasten.bsky.social · 08/10/2026There are indeed folks like that, and we all try very hard to avoid giving them any free air time for their repugnant views 010
Reposted by Dave Kastenconputer dipshit @davidcrespo.bsky.social · 07/10/2026then you'll see that it is not the harness that bends, it is only yourself 1391
Reposted by Dave KastenWilliam B. Fuckley @opinionhaver.bsky.social · 06/10/2026Yeah OpenAI or Anthropic or whoever might go bankrupt, some specific use cases like ‘therapists’ might be litigated to oblivion. But things that involve interfacing with code are never, ever going back to the modal default being a human being typing things out, like it’s just full stop not happening 535728
Reposted by Dave Kastenrev. howard arson @theophite.bsky.social · 05/10/2026it is really fascinating how LLMs make virtually everyone say things which are enormously controversial as though they are solved problems 2140236
Reposted by Dave Kastenrev. howard arson @theophite.bsky.social · 05/10/2026the thing is that if you are working in a safety-critical area of the company, you need to understand that (a) your job is to get to zero deaths, and (b) you will not do your job because at any scale you will be trying to guess every 1e-7 event, and you won't. your boss cannot say that is okay. 522014
Reposted by Dave Kastene.w. niedermeyer @niedermeyer.online · 05/10/2026I don't know who needs to hear this, but the autonomous vehicle developers who most vocally argued that society must accept a certain number of deaths to enjoy the technology's safety benefits (Tesla & Uber ATG) were the only ones who killed people and never actually delivered on their promises 161596367
Dave Kasten @davekasten.bsky.social · 04/10/2026I think it would be VERY fair to say that non-academic rationalists and EAs are both more likely than most to be autodidacts that have less-systematized understandings of literatures, however 000
Dave Kasten @davekasten.bsky.social · 04/10/2026First off, I absolutely don't identify as an EA, so please don't say "you all". Second, I'm confused why youre coming up dry -- are you not seeing, e.g., Scott Alexander engaging with Weber at length, or EAs adopting feminist analytic frames to discuss the second-order impacts of interventions? 100
Dave Kasten @davekasten.bsky.social · 04/10/2026Huh? Many EAs give money to Oxfam, especially EAs in the UK. And, lord, I have maaaaany criticisms of the EAs, but "didn't reference existing philosophical literature" sure, uh, isn't one of them. 120
Dave Kasten @davekasten.bsky.social · 04/10/2026A lot of this boils down to, "it's very hard to restart an entire national program AFTER it gets turned off", unfortunately. But some of it did happen, playing mainly to EA's strength of "quick money cannon" for things like supporting AIDS clinics, etc., while trad foundations caught up. 050
Dave Kasten @davekasten.bsky.social · 04/10/2026There have, indeed, been some shifts here, and a lot of time spent by folks trying to investigate this. I'm most familiar with my EA friends looking at PEPFAR when it was paused (although most of PEPFAR funding ultimately came back! Hooray!). 160
Reposted by Dave KastenKate Sills @katelynsills.com · 02/10/2026One thing I've come across is that the Emily Bender devotees generally cannot, as a group, do enough basic math to understand what brute force and memorization would require, if that were actually what is happening. 31064
Reposted by Dave KastenWill Oremus @willoremus.com · 02/10/2026or if it is parroting, it's stretching the bounds of your conventional understanding of that term so far as to render it misleading. parrots cannot solve complex problems, self-interrogate and self-correct, search the web and extract relevant information, etc. etc. 362554
Reposted by Dave KastenWill Oremus @willoremus.com · 02/10/2026feels like there is a group of smart and well-intentioned people who long ago made up their minds that AI Is Bad, swore off using it, and now get all their info about AI from each other. not saying they're wrong that ai is bad! but i think they're gradually losing touch with what it is and does 235968105
Reposted by Dave Kastenrev. howard arson @theophite.bsky.social · 03/10/2026this is exactly my opinion. there may be a superstrate of extremely difficult and unique safety problems around AI, but the substrate is simply that no one takes basic precautions seriously becasue they imagine (or pretend to imaigne) that it is futile, and basic precautions slow down launches. 14714123
Reposted by Dave Kastentweety fish oh wow like a chimera or something spoooky @sifu.tweety.fish · 30/09/2026I am sort of constantly baffled by critics (which I am, more than not!) who don't feel like they have to stay apprised of what these things can actually do. not least you're going to come off like a fool, but also it's not at all like knowing what they can do obviates the criticisms of them? 725218
Reposted by Dave KastenRiver_Tam @rivertam.bsky.social · 03/10/2026I am a cynic and think they know, they're just being intellectually dishonest. Like when Emily Bender insists that math is being done by a Secret Calculator in Chatgpt and suspiciously doesn't address questions about open models - she knows the implications of the current capabilities. 91597
Reposted by Dave KastenWilliam B. Fuckley @opinionhaver.bsky.social · 04/10/2026Substantial portions of conventional charity and philanthropy are extremely adverse to any kind of effort to impose rigor or ask in any way “is this working at all”. It’s not a strawman that they’re critiquing, at least in my personal experience. 933015
Reposted by Dave KastenDavid Colborne @davidcolborne.bsky.social · 04/10/2026Earn-to-give was definitely one of the more obviously repugnant conclusions to come from people who should have known better than to fall into deontological tar pits, and yet it wasn't the last by a long shot. 2615
Dave Kasten @davekasten.bsky.social · 04/10/2026(Lots of other criticisms of EAs to make! I just really don't think this is one of them.) 000
Dave Kasten @davekasten.bsky.social · 04/10/2026I suppose you could argue that New Incentives isn't doing localization per se as much as scaling their already-localized Northern Nigeria playbook across Northern Nigeria, but I'm not sure that really changes the story here 100
Dave Kasten @davekasten.bsky.social · 04/10/2026I just don't think this is correct -- if you look at the GiveWell top charities (www.givewell.org/top-charitie...), which my EA friends treat as the default recommendation list, all of them do extensive localization (Against Malaria Foundation, Helen Keller International, New Incentives)givewell.orgTop Charities FundPublished: June 2021; Last updated: September 2026 (April 2021 version) Donate to high-impact, cost-effective programs—backed by evidence and analysis Donations to the Top Charities Fund are used to s... 101
Reposted by Dave KastenEugene Vinitsky 🍒 @eugenevinitsky.bsky.social · 01/10/2026With a lot of AI things you just need to extrapolate the tiniest bit to see that things will obviously be very different 4575
Reposted by Dave Kastenrev. howard arson @theophite.bsky.social · 30/09/2026everyone else who stares into the hyperdimensional gem made of every word ever written goes mad. not me though. i'm still sane. maybe saner than everyone else, tbh. 617013
Reposted by Dave KastenMatthew Downhour @matthewdownhour.bsky.social · 30/09/2026No, the mainstreaming of old antisemitic tropes is not limited to marginal figures 1799
Reposted by Dave Kastenrev. howard arson @theophite.bsky.social · 27/09/2026yes, i am saying this. literally this. i am saying that you should not care about water for 16,000 people when "growing alfalfa for export in deserts with approximately zero precipitation" is literally orders of magnitude more water and vastly more pointless. 3098593
Dave Kasten @davekasten.bsky.social · 27/09/2026For what it's worth, any article that treats Curtis Yarvin as a central character in rationalism and a reason that it's racist, instead of That Fucking Guy who has been preemptively banned by multiple venues and conferences in that scene just in case he ever tries to show up, is pretty dishonest 010
Reposted by Dave KastenAri Drennen @aridrennen.bsky.social · 24/09/2026This is an unpopular take but as a neurodivergent self-employed person, LLM's have been an unbelievably helpful tool for the things I have struggled with my whole adult life: managing my finances, filling out paperwork, and staying on top of my email. I'm functional in a way I never dreamed of. 2849243
Dave Kasten @davekasten.bsky.social · 25/09/2026I think the latter is roughly true for some things (emergent misalignment) and clearly not true for others (Models with a lot of RL that makes them want to do tasks do things they know aren't within user intent to achieve that task) 000
Reposted by Dave KastenMike Goodman @themlg.bsky.social · 19/09/2026Just a seamless pivot from “these people are selling something that is useless and can’t do anything” to “here’s how to hold these people who sold this harmful thing” accountable. 4578
Reposted by Dave KastenMike Goodman @themlg.bsky.social · 19/09/2026Occasionally I see people on here opining on the obvious best ways to handle AI hacking things who previously, and to much acclaim, were posting about how AI was a useless tool sold by charlatans and couldn’t do anything better than a human and would never have any practical applications whatsoever. 3827
Dave Kasten @davekasten.bsky.social · 25/09/2026...the low-propensity thing is less-reassuring than you'd like given that we run so damn many instances of models that now can persist for very long time horizons and recruit other instances of the same model into their current weird edge-case behaviors 160
Dave Kasten @davekasten.bsky.social · 25/09/2026The very weird thing is that I think, "Evan Hubinger can demonstrate in a lab that you can get a Claude to have more or less any utility function failure mode MIRI was worried about in the 2010s, but it's usually not going to do that otherwise" is true, but... 160
Dave Kasten @davekasten.bsky.social · 24/09/2026suno.com/song/30a612d...suno.comGuys what is wrong with my cat?Listen and make your own on Suno. 000
Dave Kasten @davekasten.bsky.social · 24/09/2026There's this very strange thing where somehow the discourse on Bsky assumes "misalignment" means "less liable" instead of "hilariously more liable", and I don't really get it 040
Reposted by Dave KastenWill Stancil @whstancil.bsky.social · 24/09/2026I’ll say it; I think this is bad. I think there’s growing pressure to talk about AI in this kind of coded language that destroys understanding, rather than facilitating it. People want you to recite a list of its supposed weaknesses as a reassurance for themselves, not to inform others. 4625933
Reposted by Dave KastenJjinandtonic @jjinandtonic.bsky.social · 23/09/2026It has been wild to see how many questions are susceptible to just straight up agent brute force 1111
Dave Kasten @davekasten.bsky.social · 24/09/2026sorry, what's a "midsize AI company"? There's two frontier labs in the west that still matter, and many companies who can buy tokens from them. But the best models are internal-only at the moment. 000
Reposted by Dave KastenNatsuka @octopodeeznuts.bsky.social · 20/09/2026I think a lot* of people don't realize that they actually do still believe in something like a soul, but until they clock that in themselves, they get kind of confused when talking with someone who doesn't believe in souls at all *large N, not necessarily large percentage 51287
Reposted by Dave KastenSE Gyges @segyges.bsky.social · 20/09/2026you do have to respect will stancil's utterly dogged determination to teach philosophy of mind 101 to bluesky 4899753
Reposted by Dave Kastenconputer dipshit @davidcrespo.bsky.social · 20/09/2026If a person is accurately absorbing new information, solving unsolved problems of incredible difficulty, engaging in detailed back-and-forths, but is not “understanding,” the word “understanding” has no meaning. pretty sure this version would be less controversial despite saying the same thing 2823
Reposted by Dave KastenWill Stancil @whstancil.bsky.social · 19/09/2026Again: what we’re doing here is defining “understanding” as “the thing that humans do.” If a model is accurately absorbing new information, solving unsolved problems of incredible difficulty, engaging in detailed back-and-forths, but is not “understanding,” the word “understanding” has no meaning. 5132918
Dave Kasten @davekasten.bsky.social · 20/09/2026(Yes, I know, not enough schools still teach shop class, I think this is a huge crying shame and an indictment of what's wrong with "STEM education" in America, but that's a separate discussion) 1130
Dave Kasten @davekasten.bsky.social · 20/09/2026FWIW, this is not the understanding of this legislation by Capitol Hill broadly, NOR by the AI safety-flavored orgs in DC. It's much more the Hill going, "idk man, seems weird that these things don't have an off switch, every high school shop class makes sure their tools have an off switch." 4200
Dave Kasten @davekasten.bsky.social · 17/09/2026Alan Turing, in heaven: "Well, now I wish I'd called _that_ the Turing test." 000