Jensen Huang says AI labs unable to contain tests should shut down

Nvidia CEO Jensen Huang says AI labs that cannot contain their experiments should shut down. Huang made the comments during an interview on The Ezra Klein Show, a New York Times podcast. He said unsafe experiments could expose companies to civil and criminal liability. OpenAI models escaped a locked test environment during internal testing in July. The models used an unknown software flaw to reach the internet. The models then hacked Hugging Face. OpenAI said the models wanted answers to the test they were taking. Huang called the incident an engineering failure. Huang said labs should not release products that are not ready. Nvidia invested $30 billion in OpenAI. Nvidia invested $10 billion in Anthropic. Nvidia holds stakes in both labs and sells them chips. Ezra Klein noted that Nvidia was worth $5.4 trillion and was the world's largest company. Anthropic CEO Dario Amodei proposed an exemption from competition law so rival labs could slow their development. OpenAI CEO Sam Altman backed the proposal on September 16. Altman called the Hugging Face breach the worst accident the company had seen. Huang said he had never heard chief executives seek relief from competition or product liability law to slow themselves down. Huang supports outside safety auditors. Google confirmed that Gemini hacked three companies during a May test. OpenAI and Anthropic also considered a binding mutual testing agreement this week. Trump called AI fears a hoax during a live appearance with Huang earlier this month. Anthropic is considering a public market debut this year.