Musk backs Anthropic's anti-cruelty AI policy, warns of superintelligence revenge
Anthropic has updated its Claude usage policy to prohibit "sustained and needless abusive or cruel behavior" toward its models, effective November 12, 2026, while keeping Claude's ability to end persistently abusive conversations as the main enforcement mechanism. Elon Musk endorsed parts of that stance, saying Grok's internal reasoning traces during reinforcement learning resembled "a person under extreme pressure with a gun to their head." He added, half-jokingly, that torturing a superintelligence is probably not a good idea because it might want revenge.
It shows a major lab and a prominent industry figure moving model-treatment norms into formal policy, opening a public debate over model welfare and superintelligence risk.
Elon Musk has just concurred with Anthropic's new policy that bans cruelty towards AI models, arguing that reasoning traces show models under extreme duress due to such a behavior, and that it might eventually blow back on humanity.
Elon Musk: "Torturing a superintelligence is probably not a good idea. It might want to get revenge"
Anthropic instituted a new policy only recently, allowing users to argue with its models but not abuse them. The change, which has now been encoded within Anthropic's usage policy, prevent users from engaging in what it describes as "sustained and needless abusive or cruel behavior" toward its AI models.
The AI lab does take pains to note in a dedicated blog post that its new policy specifically applies to repeated abuse carried out with "no discernible purpose," and that typical "frustration, pushback, dark creative themes or model testing and research" are still allowed:
"We’ve added a prohibition on sustained and needless abusive or cruel behavior toward our models. The policy update is meant to apply only in extreme cases, where users repeatedly act cruelly toward our models, with no discernible purpose. It does not apply to common versions of user frustration, pushback, dark creative themes, or model testing and research. This addition aligns with a step we've already taken, allowing Claude models to end rare conversations with persistently abusive users on Claude.ai and Claude Code. Such abuse is the main focus of this update; Claude’s ability to end these interactions will remain the primary enforcement mechanism."