I’m certain this is about model degradation. They’re trained on user chats. They don’t want their models replicating those modes of speech.
We should worry about organic organisms being harmed by AI before we worry about hurting LLMs’ feelings. www.bbc.co.uk/news/article...
bbc.co.uk
Anthropic bans users from being 'cruel' to its AI systems
The firm said users can no longer engage in "sustained and needless" abusive behaviour towards the tech.