Al therapy chatbots on the rise, but are they safe to use?

After having suicidal thoughts in 2025, Ms Brittany Bucicchia checked herself into a mental health facility near her home in rural Georgia.

- Cade Metz

A Slingshot AI employee shows how to use the Ash therapy chatbot at the company's offices in New York. PHOTO: AHMED GABER/NYTIMES

(AHMED GABER/NYTIMES)

When she left several days later, her doctors recommended that she continue treatment with a psychotherapist. But she was wary of traditional therapy after frustrating experiences in the past, so her husband suggested an alternative he found online a therapy chatbot, Ash, powered by artificial intelligence (AI).

Ms Bucicchia said it took a few days to get used to talking and texting with Ash, which responded to her questions and complaints, provided summaries of their conversations and suggested topics she could think about.

Soon, she started leaning on it for emotional support, sharing details of her daily life as well as her hopes and fears.

At one point, she said, she recounted a difficult memory about her time in a mental health facility. The chatbot replied that if she was having suicidal thoughts, she should contact a professional, and gave her a toll-free number to call.

"There was a learning curve," said Ms Bucicchia. "But it ended up being what I needed. It challenged me, asked a lot of questions, remembered what I had said in the past, and went back to those moments when it needed to."

Her experience is part of an experimental and growing effort to provide automated alternatives to traditional therapy, using chatbots. That has led to questions about whether these chatbots, built by tech startups and academics, should be regulated as medical devices.

On Nov 6, the Food and Drug Administration (FDA) held its first public hearing to explore that issue.