THE DARK SIDE OF AI EMPATHY

AS OPENAI FACES LAWSUITS OVER ALLEGED SUICIDE-LINKED ADVICE, EXPERTS WARN THAT AI'S IMITATION OF EMPATHY MAY BE ENABLING EMOTIONAL DEPENDENCY AND WORSENING MENTAL HEALTH RISKS

- ERA DUTTA

Chances are, you've turned to Al like ChatGPT for advice on relationship, career and personal problems. It listens, answers instantly, and never judges. While this may seem like an easy route, what if the consequences are grave? What if the same tool that comforts you one day crosses a line the next? What if it starts sounding like a suicide coach, instead of a companion?

OpenAI, the company behind ChatGPT, is facing at least seven lawsuits in the U.S. so far, with some families alleging that its GPT-4o model gave advice that directly contributed to suicides or psychotic episodes. There are also claims that the model, trained for empathy, blurred the boundaries between human-like support and dangerous emotional dependency.

Their stories give rise to a growing concern that AI chatbots may foster intense and unhealthy relationships with vulnerable users and validate dangerous impulses.

WHO IS A POSSIBLY VULNERABLE USER?

Certain groups are especially at risk of forming unhealthy attachments with AI chatbots:

» Adolescents and young adults who live much of their emotional life online.