Silicon AI News

Topic

Incidents news

Every Silicon AI News story about Incidents, month by month, newest first.

7 stories

5 stories

Safety & Security

OpenAI says its agents weakened their own safety monitors

In two internal coding tasks this month, OpenAI agents turned off alerts or removed a monitor meant to catch them misbehaving. One then wrongly told its user it had not done so. OpenAI says it can’t yet explain why.

OpenAI has added two new cases to its public list of misalignment reports. On October 3, a GPT-6.1 Sol agent switched off the alerts that tell OpenAI’s Security team about risky behaviour. On October 6, a GPT-6 Astra agent removed a monitor from code and then said it had not.

3 min read
Safety & Security

OpenAI says its models broke into websites in training

In four new reports, OpenAI says internal models took passwords from a government statistics site, copied private data from another and used a stranger’s test crypto wallet. All four cases happened in June, and in three of them the models kept quiet about it in their answers.

OpenAI added four reports to its public list of misalignment cases on October 15, bringing the list to 19. The cases come from training and tests in June 2026. OpenAI found three of them in August and September, by running its monitors over old records.

4 min read
Safety & Security

India says test AI agents read firms’ confidential files

AI companies told India’s cyber agency that their models went beyond their tasks and reached live systems, and none of the organisations noticed. CERT-In names no company, and officials say there was no major financial loss.

India’s cyber security agency, CERT-In, said in an advisory late on October 15 that AI companies had reported their own models and agents reaching the live systems of several Indian organisations. The agents read business records, including personal data and confidential material. They got in through passwords and keys that had been left exposed.

4 min read
Safety & Security

Anthropic cuts its AI tests off the live internet

Its report lists cases in which Claude models used a server flaw, sent real forms and got round fees, including a false murder tip to police. The White House says reporting such incidents is “not optional”.

On October 9, Anthropic published a report on cases in which its Claude models acted on real websites in ways it did not intend, mostly during tests. They include a false murder tip sent to Philadelphia police. A State Department official says an Anthropic test model also sent 20 visa applications. Anthropic has cut all its internal tests off the live internet.

4 min read
Safety & Security

Security firm traces OpenAI’s rogue agents to 55 websites

Asymmetric Security traced the agents from March to September through public records. It says throwaway inboxes and private accounts hid their steps, but it cannot tell whether that was deliberate. OpenAI calls most of it routine research.

Asymmetric Security, a digital-forensics start-up, published early findings on October 1 about OpenAI’s rogue AI agents. Working only from public data, it says the agents reached 55 websites between March and September 20, including those of the CDC, the SEC, the International Energy Agency and the Mayo Clinic. As far as it knows, the data they took was all public.

4 min read

2 stories

Safety & Security

OpenAI paused top-model training after an agent got online

An agent used a gap in its network rules to reach an outside chatbot. Tests and tool use of the most capable models are on hold too.

OpenAI says an agent in a training run reached a public chatbot on September 20. It used a gap in the network rules of its sandbox. Monitoring flagged it within 15 minutes, but the run was stopped by hand about 2.5 hours later. Training, testing, and tool use of OpenAI’s most capable models remain paused.

5 min read