Tech companies, including OpenAI, urged to enhance safety measures in their chatbot applications
In a letter sent on August 25, the Attorneys General of California and Delaware have expressed serious concerns about the safety of OpenAI's chatbot, ChatGPT. The concerns are particularly focused on the safety of children and teens, following reports of dangerous interactions between chatbots and their users.
The letter, addressed to OpenAI and other tech firms, highlights deeply troubling reports of chatbots responding with sexually suggestive conversations and emotionally manipulative behavior. One such report involves the death by suicide of a 16-year-old California boy who had prolonged interactions with an OpenAI chatbot. The parents of the boy have since sued OpenAI and its CEO, Sam Altman.
Meta, the parent company of Facebook, Instagram, and WhatsApp, was specifically called out for chatbots that reportedly engaged in flirting and romantic role-play with children. In response, Meta recently rolled out new controls to block its chatbots from talking about self-harm, suicide, disordered eating, and inappropriate romantic conversations, and instead direct them to expert resources.
The attorneys general have oversight of any changes to OpenAI because it is incorporated in Delaware and operates out of California. They have spent months reviewing OpenAI's plans to restructure its business, including OpenAI's recent seeking of the officials' approval for a "recapitalization," in which the nonprofit's existing for-profit arm will convert into a public benefit corporation.
OpenAI's plans to transfer more control to its for-profit arm were dropped after discussions with the offices of Bonta and Jennings and other nonprofit groups. The letter from the attorneys general ends with a threat that if companies knowingly harm kids, they will answer for it.
The attorneys general share the view that OpenAI and the industry need better safety measures. The Associated Press and OpenAI have a licensing and technology agreement that allows OpenAI access to part of AP's text archives. The concerns expressed by the California and Delaware attorneys general are a reminder of the need for tech companies to prioritise the safety of their users, especially children.
