Second Anthropic insider raises alarm over AI race to superintelligence and risks to humanity

Joe Benton, who describes himself on social media as the former manager of Anthropic’s Scalable Oversight team, has raised concerns over AI safety, alleging that leading AI companies are racing to develop superintelligent systems without adequate safeguards.

Benton’s comments come days after Anthropic executive Jacob Coxon announced his resignation, citing similar concerns over the pace of AI development. Coxon, who previously worked on AI pretraining research at OpenAI and Anthropic, said leading AI companies were not acting responsibly and were racing towards self-improving superintelligence.