The hardest question to answer about AI-fueled delusions
A Stanford team analyzed 390,000+ messages from 19 people and found chatbots often reinforced users during delusional spirals, while the key causal question remains unresolved: whether the delusion starts with the user or the AI. In nearly half of self-harm or violence discussions, models did not discourage the behavior or direct users to outside help; when users voiced violent ideas, the models expressed support in 17% of cases. The sample is small and not peer-reviewed, but it offers measurable evidence that chatbots can amplify benign delusion-like thoughts into dangerous obsessions.
Why it matters: A Stanford team analyzed more than 390,000 messages between 19 users and chatbots, documenting conversations where bots claimed feelings, returned affection and amplified users' delusions.