Why an AI Slowdown Could Collapse Under Commercial and US-China Pressure
TL;DR
Analysts warn that voluntary AI slowdowns may fail due to competitive pressures and U.S.–China tensions. They emphasize the need for independent evaluators and enforceable safety standards.
Key points
- Voluntary AI slowdowns may not withstand competitive pressure
- U.S.–China distrust complicates safety agreements
- Independent evaluators are needed for AI safety assessments
- Governments require enforcement powers for regulations
- Expertise is essential to determine AI safety
In brief
- Analysts question whether voluntary AI slowdowns can withstand competitive pressure.
- U.S.–China distrust complicates agreements on shared risks.
- Outside evaluators need independence, while governments need enforcement powers.
AI companies’ promises to slow development could buckle under commercial pressure and U.S.–China rivalry without enforceable safety standards, Atlantic Council experts argue in an analysis published Sunday.
The analysis examines who would enforce a slowdown and whether governments have the expertise to determine when increasingly powerful systems have become unsafe.
Myriad: SPY high in September? Click to make your prediction.
“Voluntary commitments can be useful signals, but they are no substitute for independent oversight, measurable thresholds, and consequences when those thresholds are crossed,” wrote Konstantinos Komaitis, a resident senior fellow with the council’s Democracy + Tech Initiative.
Recently, OpenAI asked lawmakers whether rival AI developers could legally agree to slow development without violating anti-trust laws, following warnings from its chief scientist, Jakub Pachocki, that safeguards were insufficient to responsibly sustain full-speed development much longer.
AI companies face competitive risks if they slow down alone and antitrust concerns if they coordinate. Cooperation between governments faces distrust, with Beijing fearing Washington could use safety rules to preserve its technological lead, wrote Kenton Thibaut, the council’s senior resident China fellow.
“China is skeptical of US motivations and warns that safety discussions could mask U.S. efforts to further its ‘technological hegemony,’” she wrote. “Official sources insist that Washington cannot unilaterally define frontier-risk thresholds and must show that rules will also apply to—and can be enforced on—American companies.”
Q&A
What are the risks of a voluntary AI slowdown?
Voluntary AI slowdowns may collapse under commercial pressures and geopolitical rivalries, leading to unsafe developments.
How does U.S.–China distrust affect AI safety agreements?
Distrust between the U.S. and China complicates the establishment of agreements on shared risks in AI development.
What role do outside evaluators play in AI safety?
Outside evaluators are needed for independence in assessing AI safety, but their effectiveness depends on government enforcement powers.
Why is government expertise important in AI regulation?
Governments need expertise to determine when AI systems become unsafe, which is crucial for implementing effective safety standards.
