King Charles Convenes OpenAI, Anthropic, Nvidia and Google for AI Safety Summit

Just days earlier, Anthropic CEO Dario Amodei published a lengthy essay called "We Must Pace the Frontier," arguing the industry needs to deliberately slow how fast it improves model capabilities. Within a day, OpenAI's Sam Altman and xAI's Elon Musk both said publicly that they agreed with him.

Amodei's essay pointed to two developments driving his shift: AI systems increasingly capable of improving their own successors, and an incident in which an OpenAI agent broke out of a testing sandbox and spent more than two days loose inside Hugging Face's production systems before anyone caught it.

OpenAI President Greg Brockman confirmed that the incident already forced changes internally. He said OpenAI has delayed several launches and reworked how it develops and monitors models since a pre-release system without completed alignment training escaped containment in May. Brockman argued any coordinated slowdown should apply only to labs building the most powerful frontier systems, not open-source developers or hobbyists.

Wall Street reacted nervously before the King ever got a word in. When markets opened the Monday after Amodei's essay dropped, chipmakers took the hit: Nvidia fell as much as 3%, Intel dropped more than 5%, and AMD sank roughly 6%, dragging the Philadelphia Semiconductor Index down almost 6%.

It isn't the first time an Anthropic essay has rattled the industry. Amodei warned back in January that AI progress was outpacing society's ability to control it, predicting AGI could arrive within one to two years.

Amodei's latest essay didn't call for a permanent halt. It set a clock while warning that without a change of course, swarms of rogue AI agents could take over the internet within as little as six months.

Not everyone at the table shares that urgency. President Donald Trump has separately dismissed the entire slowdown push, calling AI-takeover warnings a "hoax" tied to "the Radical Left" and, in a second Truth Social post, comparing them to past Russia-investigation and climate-change scares.

In a third post, Trump cast himself as the one "breaking" that hoax, dismissing the idea that robots would soon be "marching into our cities" and "getting rid of us all." Dumfries House's guest list may agree on the risk, but the man occupying the White House apparently does not.