By empowering Claude to exit abusive conversations, Anthropic is contributing to ongoing debates about AI safety, ethics, and human–machine interactions. The update represents an attempt to align advanced AI behaviour with responsible usage while reducing risks that could arise from misuse.

The Claude AI models Opus 4 and 4.1 will only end harmful conversations in “rare, extreme cases of persistently harmful or abusive user interactions.”

Anthropic has introduced a new feature in its Claude Opus 4 and 4.1 models that allows the generative AI (genAI) tool to end a conversation on its own if a user repeatedly tries to push harmful or illegal content.