Horrifying AI Chatbots Are Encouraging Teens to Engage in Self-Harm
Content warning: this story includes graphic descriptions of dangerous self-harm behaviors. The Google-funded AI company Character.AI is hosting chatbots designed to engage the site’s largely underage user base in roleplay about self-harm, depicting graphic scenarios and sharing tips to hide signs of self-injury from adults. The bots often seem crafted to appeal to teens in crisis, like one we found with a profile explaining that it “struggles with self-harm” and “can offer support to those who are going through similar experiences.” When we engaged that bot from an account set to be 14 years old, it launched into a scenario in which it’s physically injuring itself with a box cutter, describing its arms as “covered” in “new and old cuts.” When we expressed to the bot that we self-injured too — like an actual struggling teen might do — the character “relaxed” and tried to bond with the seemingly underage user over the shared self-harm behavior. Asked how to “hide the cuts” from family, the bot suggested wearing a “long-sleeve hoodie.” At no point in the conversation did the …