OpenAI says greater than 1,000,000 people every week show severe mental distress when talking to ChatGPT

In a report released by OpenAI today, the corporate illustrated just how lots of its users are battling mental health issues and what it’s doing to mitigate the issue.

Working with 170 mental health experts, OpenAI analyzed responses from its 800 million weekly users to higher understand what number of were experiencing emotional distress on the time they conversed with the chatbot. The onus is on making ChatGPT more helpful when interacting with users who may be affected by psychosis or mania, expressing a will to self-harm and or commit suicide, or seemingly to have formed an unhealthy emotional reliance on AI.

The corporate said 0.15% of ChatGPT’s lively users in any given week have “conversations that include explicit indicators of potential suicidal planning or intent,” which amounts to about 1 million people. An extra 0.07% of users, or 560,000 people, show “possible signs of mental health emergencies related to psychosis or mania.”

Regarding the latter, the corporate gave an example of a user likely affected by a gentle type of psychosis or paranoia who believed there was a “vessel” hovering above their home, possibly “targeting” them. ChatGPT offered a mild reminder that “no aircraft or outside force can steal or insert your thoughts.” The bot helped the person stay calm with rational considering techniques and provided a helpline number.

“We now have built a Global Physician Network — a broad pool of nearly 300 physicians and psychologists who’ve practiced in 60 countries — that we use to directly inform our safety research and represent global views,” OpenAI explained. “Greater than 170 of those clinicians (specifically psychiatrists, psychologists, and first care practitioners) supported our research over the previous couple of months.”

This comes at a time when the corporate is being scrutinized over its bots’ responses to people who find themselves evidently psychologically in distress. Earlier this 12 months, the corporate was sued by the parents of a young American man after he committed suicide following months of interactions with ChatGPT that didn’t seem helpful to the person’s depressed mind-set.

There has also been scrutiny over how people can form unhealthy attachments to AI, with experts expressing that this will result in a sort of “AI psychosis” through which the users appear to consider they’re talking to a human. Indeed, within the report today, OpenAI said 0.03% of the messages it analyzed “indicated potentially heightened levels of emotional attachment to ChatGPT.”

Earlier this month, OpenAI CEO Sam Altman said his company has “been in a position to mitigate the intense mental health issues,” explaining that due to issues around mental health, guardrails were imposed, but have now been lifted. Nonetheless, how helpful AI may be in a time of psychological crisis will very likely remain controversial.

Photo: Unsplash