Eating disorder helpline replaces humans with AI chatbot, but shuts it down over harmful advice.

The National Eating Disorders Association (NEDA) has phased out its helpline and replaced it with an AI chatbot called Tessa, which has raised concerns among volunteers and staff. The decision was made due to a sharp escalation in demand for services and care, and the increase in crisis-level calls raised NEDA's legal liability. The chatbot may miss red flags and inadvertently reinforce harmful behavior, according to studies. Mental health organizations and companies are turning to chatbots and AI, despite the fact that clinicians are still trying to figure out how to effectively deploy them, and for what conditions.