Anthropic, OpenAI's proposed AI risk evaluators may not have enough power to prevent disasters

The most important new job in artificial intelligence may come with an office badge, a company laptop, and access to some of the most closely guarded systems in technology: the large language models of AI leaders including Anthropic and OpenAI . Anthropic CEO Dario Amodei has proposed embedding third-party safety evaluators inside frontier AI companies on an ongoing basis as part of a plan to slow the advance of increasingly capable models, after former Anthropic researcher Jacob Coxon resigned , warning that frontier labs were racing toward systems they might not control.