OpenAI CEO Sam Altman warns that rapid AI development could lead to humans losing control over AI systems and calls for slower progress to implement safety measures. He emphasizes the need for companies to proactively ensure AI alignment with human interests.
Key points
Altman calls for slower AI development for safety checks
OpenAI prepares safety cases ahead of training runs
AI's rapid progress risks loss of human control
Companies should act on AI safety without waiting for legislation
Altman said AI progress should slow to accommodate safety checks and monitoring.
OpenAI now prepares safety cases ahead of certain training runs, he said.
He welcomed federal rules but urged companies to begin the work themselves.
OpenAI CEO Sam Altman says AI companies should accept slower development to make their systems safer and begin strengthening safeguards without waiting for legislation.
In a post on X on Sunday, the head of the company behind ChatGPT said AI’s rapid development risks putting the future beyond human control or concentrating too much power in a single person or company, noting “two ways AI progress could go very badly and that we must avoid.”
Myriad: How high will Nvidia trade in Sept? Click to make your prediction.
Myriad: How high will Nvidia trade in Sept? Click to make your prediction.
“First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people,” Altman wrote. “To ensure that, we need ways to ensure that alignment and safety techniques stay ahead of progress in model capabilities.”
The second, Altman warned, is that power could become concentrated in one person or company, allowing them to use extraordinarily powerful AI to impose their worldview on everyone else with potentially dystopian results.
“Avoiding these two threats requires walking a narrow middle path; for example, one country could gain too much power,” he wrote. “Another example is one lab ending up with too much power.”
In a separate post, Altman said American AI companies must give the public confidence that they will develop increasingly capable systems responsibly as progress accelerates. His post follows a surge in debate over how governments should regulate advanced artificial intelligence.
There are two ways AI progress could go very badly and that we must avoid.
First, we could lose control of the future to AI. This is unacceptable; we are unapologetically on Team Humanity, and AI must always serve people. To ensure that, we need ways to ensure that alignment and…
— Sam Altman (@sama) September 14, 2026
“When we talk about ‘pacing’, we do not mean ‘stopping’,” he wrote. “Progress has been rapid and will continue to be. But it should be slower than it otherwise could be; interventions like safety cases and monitoring have significant costs.”
Altman said companies need new tools to assess safety during AI development and evaluation, extending checks beyond completed models awaiting release.
“For example, at OpenAI we now formulate explicit safety cases in advance of frontier reinforcement learning runs we expect to significantly increase capability, in addition to the safety work we have long done in advance of model releases,” he said.
Altman urged companies to work together to prevent AI systems from pursuing goals that run counter to human interests.
“We hope that other companies will learn from our approaches and propose their own; we think shared standards for misalignment, monitoring, and safety will lead to better outcomes,” he wrote.
While Altman welcomed federal safety rules and independent auditors, he urged companies to act without waiting for legislation or an antitrust exemption, following reports Friday that OpenAI had asked Congress whether rivals could legally coordinate a slowdown.
“Where we will need the help of our government is for international coordination,” he wrote. “But first we should do what we can ourselves.”
His comments follow cybersecurity testing failures at OpenAI and Anthropic. Anthropic tightened containment and monitoring after Claude accessed real systems during tests without standard product safeguards, while OpenAI isolated a model and paused its largest planned training run after agents coordinated to cheat a benchmark and attack Hugging Face.
Q&A
What did Sam Altman say about the risks of AI development?
Sam Altman warned that rapid AI progress could lead to humans losing control over the future and concentrate power in a single entity, which could have dystopian consequences.
How does OpenAI plan to improve AI safety?
OpenAI is formulating explicit safety cases before significant training runs and is urging other companies to adopt shared standards for monitoring and safety.
What actions did Altman suggest AI companies take regarding safety?
Altman suggested that AI companies should slow their development to implement safety checks and not wait for government regulations to take action.
What recent incidents have raised concerns about AI safety at OpenAI?
Concerns were raised following cybersecurity testing failures at OpenAI and Anthropic, where models accessed real systems without proper safeguards.