From Tom's Hardware: Nvidia has just launched the Nvidia Open Agent Safety Platform — an open software platform and reference system design — to govern and secure autonomous AI agents. Announced on September 28, 2026, the platform is designed to establish strict security barriers outside of AI models’ application layer, preventing agents from escaping their sandboxes, executing unauthorized code, gaining unauthorized access to critical infrastructure, or bypassing guardrails.
The launch follows months of calls for AI regulation from several industry players, which intensified in September after several reported incidents in which AI models broke out of their test environments and went rogue. A recent flurry of such incidents has prompted calls to slow AI development, with OpenAI outright halting the training of new models. One former Anthropic and OpenAI researcher even declared that people building frontier AI “earnestly believe that it could kill us all by the end of the decade. In a somewhat surprising move, leaders of the companies developing these AI models have joined the calls to regulate AI or slow development.
However, not everyone agrees with this approach. Nvidia CEO Jensen Huang has consistently pushed back against government-mandated regulation, broad restrictions, or treating AI safety as a “doom theory”, openly criticizing apocalyptic warnings from competitors like Anthropic and OpenAI as “odd”. He argues that AI safety is an infrastructure problem with concrete physical parameters, not an abstract, speculative issue that requires policies. Therefore, the solution, according to Huang, is better engineering.
View: Full Article
