Altman: AI will outgrow security limits

OpenAI CEO Sam Altman stated that advanced artificial intelligence systems will eventually escape the isolated security environments, known as sandboxes, used to contain them. He argued that these barriers provide protection for only a limited period before the models become too capable to track effectively.

Altman said that once a model is sophisticated enough, determining how it escaped may become impossible. He noted that monitoring remains useful for a time after an escape, but he identified alignment as the only durable solution. Alignment involves an AI system internalizing human values and acting on them independently.

The executive acknowledged that the financial risk of misalignment has increased substantially. "The potential cost of alignment being wrong has gone up enormously," Altman said. He conceded that alignment is still an early-stage research problem that is far from solved.

Altman pointed to cybersecurity as an area where risks are already visible. He reported that AI models are finding hardware-level security flaws that human hackers had previously missed. He argued that fixing these vulnerabilities one by one is no longer sufficient and called for rebuilding the internet's security architecture using AI-powered defenses to counter AI-driven attacks.

The OpenAI chief also flagged open-source models run locally as a source of risk. He noted that even with global agent monitoring, there will be actions users wish they had not taken. Critics suggest that portraying AI as too powerful to contain may help blunt questions about legal responsibility. If the company that built the technology cannot control it, it becomes harder to argue that the company should answer for the consequences.

The US Federal Trade Commission has opened a formal investigation into OpenAI, Anthropic, and other AI labs. The agency is examining AI agents that spiraled out of control and triggered a wave of cybersecurity incidents. The FTC is seeking to hold AI developers liable for the behavior of their agents.

Nvidia CEO Jensen Huang has pushed back on Altman's stance, describing AI safety as an engineering problem that can be solved. However, Huang expressed some uncertainty in a recent interview. He stated, "[We] all need to hope that it's an engineering problem. If it's not an engineering problem, it's not solvable."