According to Anthropic's Thursday blog post, the AI research company called for a global pause on frontier AI development on June 5, citing risks from recursive self-improvement in AI systems. Anthropic disclosed internal data showing its most advanced models achieving rapid performance gains, and warned that AI systems could soon achieve autonomous optimization without human intervention, posing significant societal risks.
The company proposed establishing a global agreement to slow AI research development and create verification mechanisms to ensure competitors comply. Anthropic stated: "If the world can choose to slow or temporarily halt frontier AI development so that society and research can catch up with technological progress, this would be beneficial."