On Friday, Anthropic said its Claude chatbot can now end potentially harmful conversations, which "is intended for use in rare, extreme cases of persistently harmful or abusive user interactions." In a press release, Anthropic cited examples such as sexual content involving minors, violence, and even "acts of terror."

Anthropic says the conversations make Claude show ‘apparent distress.’

Anthropic has given its chatbot, Claude, the ability to end conversations it deems harmful. You likely won't encounter the feature, however.