UN panel raises questions about the way AI models are currently trained

Even as OpenAI CEO Sam Altman is due to brief the United Nations Security Council later this week on artificial intelligence (AI) security and safeguards, the UN has called for a comprehensive review of the technology, noting inadequacy of current AI safety measures. The UN Independent International Scientific Panel on AI tabled a report earlier today on the AI risk factors at the UN General Assembly in New York, focusing on AI agents, misalignment and the risk of losing human control.

“Researchers have long warned that three conditions could lead to loss of control: a misaligned goal, the capability to pursue it, and an environment that allows it.