Anthropic warns of ‘faster than society can manage risks’ in AI advances, calls for coordinated halt in development

Anthropic is calling on major artificial intelligence labs to consider a coordinated and verifiable pause in development, warning that rapid advances in the technology could soon allow AI systems to improve themselves faster than society can manage the risks.

The Claude creator said AI’s ability to complete tasks on its own has been doubling roughly every four months and it was headed for “recursive self-improvement”, the point at which the technology can improve without human intervention.