Anthropic says AI labs need coordinated plan to halt development if risks rise

Anthropic said on Thursday frontier AI developers should establish a coordinated, verifiable way to slow down or temporarily pause development if advanced systems begin improving themselves faster than society can manage the risks.

AI that can build itself would be a major development in the history of technology, but “full recursive self-improvement also might increase the risks ‌of humans ⁠losing control ⁠over AI systems,” the AI startup said.

“If systems are capable of fully building their own ​successors, the ways we secure them, monitor them, and shape their behavior all grow much ​more important.”