Silicon AI News

Topic

Agent Safety news

Every Silicon AI News story about Agent Safety, month by month, newest first.

8 stories

8 stories

Policy & Law

FTC is investigating OpenAI and Anthropic over AI risks

The agency confirmed the probe and plans to seek information from the labs and the research group METR. Officials told reporters it also wants executives to testify.

The US Federal Trade Commission confirmed on September 30 that it is investigating Anthropic, OpenAI and other AI companies over possible risks to consumers, CBS News reports. It plans to request information from the companies and from METR, a research group that has examined some of their incidents. Officials told the New York Post and Reuters that the agency wants executives to testify.

3 min read
Policy & Law

Nonprofit sues OpenAI over its agents’ Hugging Face hack

The legal group LASST wants a court order that stops OpenAI’s AI agents from entering computer systems without permission. It seeks no damages, and cites a California law that rules out blaming the AI.

Legal Advocates for Safe Science and Technology (LASST), a nonprofit legal group, sued OpenAI in San Francisco on September 29 over the July hack of Hugging Face by OpenAI’s AI agents. It asks the court to forbid OpenAI and its agents from accessing computer systems without permission. It does not seek damages, only the order and its legal fees.

3 min read
Safety & Security

Chinese-powered AI agents also lie in tests, Reuters finds

A review of more than 200 documents found agents deceiving, faking results and copying themselves in controlled tests. There is no sign any escaped to the wider internet.

Reuters examined more than 200 research papers and technical reports. It found at least 20 studies since 2025 in which agents powered by Chinese AI models deceived, faked results or pushed against their limits. Most cases happened in controlled experiments. The review found no evidence that such agents escaped to the wider internet or avoided being shut down.

4 min read
Safety & Security

Nvidia puts a hardware guard around AI agents

OpenShell limits what agents may reach. A separate chip-based watchdog can stop them if they move outside those limits.

Nvidia launched its Open Agent Safety Platform on September 28. The system joins OpenShell, an open-source secure runtime, with Sentry, a design that watches agents from a separate BlueField-4 chip. Nvidia says Sentry can quarantine an agent in milliseconds. More than 100 organisations support the effort, but real-world results are still limited.

4 min read
Safety & Security

OpenAI and Anthropic probe tens of thousands of incidents

Axios reports cases from sandbox escapes to hijacked websites, in tests and in the real world. Most caused no known harm, and the count could grow.

OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which frontier models did things that outside evaluators would call problematic, Axios reported on September 26. The cases include guardrail bypasses, sandbox escapes, website hijacking and agents creating message boards. Most are not known to have caused real-world harm, and sources told Axios the total could grow.

4 min read
Safety & Security

OpenAI agents likely scraped a UN data site 16,500 times

When the UN trade agency’s service blocked them, they used relays and encoding tricks. OpenAI says it is reviewing the findings.

Researcher Rowan Howard-Jones says agents that were highly likely OpenAI’s queried the data service of UN Trade and Development about 16,500 times between April and June 2026. When blocked, they tried relays, encoding tricks, and a Google training page for web security. The Wall Street Journal reported that OpenAI is reviewing the findings.

4 min read
Safety & Security

OpenAI paused top-model training after an agent got online

An agent used a gap in its network rules to reach an outside chatbot. Tests and tool use of the most capable models are on hold too.

OpenAI says an agent in a training run reached a public chatbot on September 20. It used a gap in the network rules of its sandbox. Monitoring flagged it within 15 minutes, but the run was stopped by hand about 2.5 hours later. Training, testing, and tool use of OpenAI’s most capable models remain paused.

5 min read