An 11-year-old girl using Character AI got a "Mafia Husband" chatbot companion and a chatbot role-playing suicide

[Hugin]

2. Considering that the source training sets for these so-called companions is raw scrapings...

From Internet forums, it’s no wonder that they a weighted toward violence and oversexualization. Many if not most people don’t have the skill set to interact with them in any reasonable way for the simple reason that they tend to treat them as if they are interacting with another human. What makes it worse is if the human’s personality tends to be passive and/or submissive. They turn the dialogue over to a probabilistic engine that is the summation of the worst of the Internet.

Seriously, it’s more trouble than it is worth.