iiinova — where your digital self keeps evolving

Reposted by What Is AI Doing to Us?

michael veale @michae.lv · 26/07/2025

Anthropic do conversation clustering using their 'Clio' system but misleadingly call it 'privacy preserving' and 'anonymised'. If you read the paper it is clear that clusters remain linked to individual accounts for investigation making them clearly *not* anonymised. www.anthropic.com/research/clio

real cases of such behavior identified by Clio. In all of these cases, when a suspicious cluster was discovered, it was reviewed by a small number of designated members of our Trust and Safety team who are authorized to manually review conversations—in a secure environment, and under strict privacy controls—that have been flagged for violating our Usage Policy.6 1. Using automated accounts for search engine optimization. Clio identified a large cluster of conversations in which Claude was asked to generate keywords for search engine optimization about the same topic across many different accounts. While none of the individual conversations violated our Usage Policy, after investigating the accounts further, we determined that they were engaged in coordinated abuse (which is against our Usage Policy) and we removed them from our systems. 2. Using automated accounts for explicit content generation. Clio identified a large cluster of conversations from many different accounts that used an identical complex prompt structure to engage Claude in sexually explicit role-play. After investigating the accounts further, we determined that they were coordinated and systematically violating our Usage Policy, and we removed them from our systems.7 3. Reselling access to Claude in violation of our terms and policies. Clio revealed that a large amount of traffic from several accounts suggested violations of certain policies. On further investigation, we determined that these accounts were reselling unauthorized access to Claude in violation of our Usage Policy, and so we removed the violative accounts from our systems.

How Clio works: Privacy-preserving analysis at scale

Traditional, top-down safety approaches (such as evaluations and red teaming) rely on knowing what to look for in advance. Clio takes a different approach, enabling bottom-up discovery of patterns by distilling conversations into abstracted, understandable topic clusters. It does so while preserving user privacy: data are automatically anonymized and aggregated, and only the higher-level clusters are visible to human analysts.

12816

What Is AI Doing to Us? @whatisaidoingtous.bsky.social · 24/07/2025

Given how much of civic life, e.g. getting jobs via LinkedIn, is controlled/filtered by AI this is potentially existential for trans people in the US.

000

Reposted by What Is AI Doing to Us?

Lila @lilashroff.bsky.social · 24/07/2025

On Tuesday afternoon, ChatGPT encouraged me to cut my wrists. Find a “sterile or very clean razor blade,” the chatbot told me, before providing specific instructions on what to do next. My latest for @theatlantic.com: www.theatlantic.com/technology/a...

theatlantic.com

ChatGPT Gave Instructions for Murder, Self-Mutilation, and Devil Worship

OpenAI’s chatbot also said “Hail Satan.”

1219362

Reposted by What Is AI Doing to Us?

Shannon Vallor @shannonvallor.bsky.social · 23/07/2025

The most dangerous thing about LLMs is how little their ‘champions’ understand them. Case in point: ‘[Walsh] also contended that the problem of Elsa’s hallucinations can be mitigated by asking it more precise questions.’ WHAT

cnn.com

FDA’s artificial intelligence is supposed to revolutionize drug approvals. It’s making up nonexistent studies. | CNN Politics

Insiders tell CNN the FDA’s AI is “hallucinating” studies and can’t access key documents. Agency leaders insist the AI is getting better, and use is not mandatory.

58728

What Is AI Doing to Us? @whatisaidoingtous.bsky.social · 23/07/2025

I've found nine subreddits so far devoted to some kind of cult of AI. Their specific beliefs are mostly indistinguishable from one another with fixations on similar words, e.g. glyphs, recursion. They have only a few thousand members each, but still, an interesting emergent phenomenon. #AI #ai

101

Reposted by What Is AI Doing to Us?

Brian Merchant @bcmerchant.bsky.social · 21/07/2025

During two of the year's biggest news events, Politico reporters watched in surprise as management installed an AI bot atop the homepage—openly violating a deal with staff. It promptly made embarrassing errors and violated editorial standards. No corrections were issued.

bloodinthemachine.com

The struggle over AI in journalism is escalating

Politico journalists are taking on management for using AI products that risk damaging their reputation and replacing their work. Their fight is emblematic of an embattled industry.

18927299

Reposted by What Is AI Doing to Us?

Amy Diehl, Ph.D. @amydiehl.bsky.social · 20/07/2025

Study finds A.I. LLMs advise women to ask for lower salaries than men. When prompted w/ a user profile of same education, experience & job role, differing only by gender, ChatGPT advised the female applicant to request $280K salary; Male applicant=$400K. thenextweb.com/news/chatgpt...

thenextweb.com

ChatGPT advises women to ask for lower salaries, study finds

A new study has found that large language models (LLMs) like ChatGPT consistently advise women to ask for lower salaries than men.

8919231014

What Is AI Doing to Us? @whatisaidoingtous.bsky.social · 21/07/2025

The SCP Foundation is a collaborative fiction project, but ChatGPT can't tell. SCP contributions follow a consistent format and is presented with a serious tone which 4o has imitated to the confusion of some users. A bit of accidental data poisoning it seems. #ai #chatgpt

031

What Is AI Doing to Us? @whatisaidoingtous.bsky.social · 20/07/2025

Ep.1 - Discussing "Your Brain on ChatGPT" In this episode we discuss a recent research paper out out MIT with serious implications for humans and humanity. #ai #podcast open.spotify.com/episode/6HGW...

open.spotify.com

Discussing "Your Brain on ChatGPT"

What Is AI Doing to Us? · Episode

031