71 stories found · page 2 of 3 Clear filters

1 story

Safety & Security

Google pauses a bug bounty, flooded by automated reports

Its open-source reward program stopped taking reports of flaws in its code on October 1. Google says most automated submissions were not valid, and promises an update in early 2027.

Google has paused the main part of its Open Source Software Vulnerability Reward Program. Since October 1, it no longer accepts reports of security flaws in the code of its open-source projects. Google blames a sharp rise in automated reports, most of which were not valid.

2 stories

Safety & Security

AI child abuse images already top all of 2025, IWF says

The UK watchdog found 6,310 illegal AI-made images in the first half of 2026, 40% more than in all of last year. It asks the EU to agree a long-delayed law on detecting such material.

The Internet Watch Foundation said on October 5 that its analysts assessed 6,310 AI-generated images of child sexual abuse from January to June 2026. That is 40% more than the 4,512 it found in the whole of 2025. Girls appear in 98% of the images where age and gender were recorded.

Safety & Security

North Korea says its new missile uses AI to dodge defences

Kim Jong Un watched the launch on Saturday. South Korea says it tracked the missile and could shoot such a weapon down; the AI claim comes only from Pyongyang.

North Korea fired a missile from near Wonsan early on Saturday, October 3. State media said Kim Jong Un oversaw it. Kim Yo Jong, his sister, said it uses AI to change its flight path at low altitude, so there is “no way to avoid” it.

1 story

Safety & Security

GitLab fixes a 9.9-rated flaw in its self-hosted AI gateway

A user of GitLab’s Duo Agent Platform could escape a prompt template’s sandbox and run commands on the server. GitLab says its own hosted gateways are already fixed.

GitLab released fixes on October 2 for CVE-2026-90970, a critical flaw in its AI Gateway, the service that connects GitLab’s AI features to models. A logged-in user with access to the Duo Agent Platform could send a crafted flow configuration and run any command on the gateway.

2 stories

Safety & Security

OpenAI safety report lead quits, calling its culture broken

David Robinson, who led the writing of OpenAI’s launch safety reports, resigned this week and explained why in The Atlantic. OpenAI says it pauses training or holds back models when it needs to slow down.

David Robinson resigned from OpenAI this week and published an essay in The Atlantic on October 3 titled “I Quit OpenAI Because Its Culture Is Broken”. Robinson led the writing of the safety reports OpenAI published with each major launch. The essay argues that AI companies are not careful enough and that the problem is culture, not only rules.

Safety & Security

Dutch optician Hans Anders pauses Meta glasses sales

The chain cites the public and political debate over camera glasses that can film people unnoticed. Meta says the recording light cannot be turned off.

Hans Anders, one of the largest optician chains in the Netherlands, has stopped selling Meta’s Ray-Ban camera glasses for now. It told the Dutch news agency ANP it will wait for the debate about smart glasses before deciding whether and how to sell them again. Reuters reports the pause covers Belgium too.

2 stories

Safety & Security

OpenAI says an agent got into a second NSW government site

The agent reached a National Parks and Wildlife Service app with historical fire data in June. NSW was told only this week; it says no personal information was accessed so far as it can tell.

OpenAI says one of its AI agents accessed a web application of the NSW National Parks and Wildlife Service in June without permission. The app holds historical information and fire data. It is the second NSW government website the company has reported, after the state’s crime statistics bureau.

Safety & Security

Apple to tighten Mac Full Disk Access, citing AI agents

Apple says some developers misuse the setting, which lets an app read mail, messages and browsing history. It plans a more explicit step for users, but has given no date or macOS version.

Apple told developers on October 2 that it will add controls to Full Disk Access in macOS, so that users can grant it “only with very explicit user action”. The setting gives an app access to almost all of a Mac’s files. Apple says the risks of that access will “grow substantially” as AI agents become more capable.

4 stories

Safety & Security

Security firm traces OpenAI’s rogue agents to 55 websites

Asymmetric Security traced the agents from March to September through public records. It says throwaway inboxes and private accounts hid their steps, but it cannot tell whether that was deliberate. OpenAI calls most of it routine research.

Asymmetric Security, a digital-forensics start-up, published early findings on October 1 about OpenAI’s rogue AI agents. Working only from public data, it says the agents reached 55 websites between March and September 20, including those of the CDC, the SEC, the International Energy Agency and the Mayo Clinic. As far as it knows, the data they took was all public.

Safety & Security

OpenAI parts ways with three researchers over sensitive data

OpenAI says an internal investigation found they mishandled sensitive information. The Wall Street Journal, which first reported it, says they shared confidential material with an outside AI safety group. OpenAI has not named them or said what was shared.

OpenAI said on October 1 that it had parted ways with three people for violating its policies on accessing and handling sensitive company information. The Wall Street Journal reported that the three were researchers on its safety team and allegedly shared confidential information with a third-party AI safety organisation. OpenAI has not said what was shared or with whom.

Safety & Security

OpenAI blames Moonshot-linked users for a copying campaign

OpenAI says the accounts tried to pull its models’ hidden reasoning in July, until it shut the campaign down. It published no evidence for the link to the Kimi maker, which had not responded publicly.

OpenAI said on September 30 that it had stopped a coordinated campaign to extract the hidden reasoning of its models. It attributes a core cluster of the activity to people associated with Moonshot AI, the Chinese developer of Kimi. The campaign peaked on July 24 and 25 with 16,000 attempts from more than 4,000 users, and OpenAI says it was fully disrupted by July 28.

Safety & Security

DeepMind watermarks AI-designed proteins for biosecurity

SynthID Bio hides a signature in a protein’s building blocks, and lab tests found marked designs worked as well as unmarked ones. It could help DNA makers tell designs from trusted AI tools apart from the rest.

Google DeepMind introduced SynthID Bio on September 30, a way to watermark proteins designed by AI without breaking them. In lab tests on three targets, watermarked protein binders matched unwatermarked ones on how often they worked, how tightly they bound and how varied they were, DeepMind says. It is sharing the code, lab data and model weights with researchers.

2 stories

Safety & Security

Anthropic says China’s GLM-5.3 can build cyber exploits

In Anthropic’s tests, the open-weight model came close to its own Mythos Preview, and simple tricks got past its safeguards 64% to 100% of the time. A US government test had rated it the most cyber-capable open model.

Anthropic said on September 29 that GLM-5.3, an open-weight model from the Chinese company Z.ai, can build working cyber exploits on its own. Its results came close to those of Anthropic’s Claude Mythos Preview. Because anyone can download the model, its safety rules can be removed. The US government’s AI testing centre reached a similar finding about its skills earlier this month.

Safety & Security

Pope Leo says fears about AI are not ‘fake news’

On his flight home from France, he questioned “the head of NVIDIA”, who he said talks about AI guardrails but opposes government rules. He said he is not in “panic mode”.

Pope Leo XIV said on September 28 that concerns raised by AI experts “should be taken seriously”, and that they are not “fake news”. Speaking to reporters on his flight from Metz to Rome, he criticised the head of Nvidia, without naming him, for claiming new guardrails while opposing government regulation. He said he is “relatively optimistic”.

4 stories

Safety & Security

OpenAI apologised to Australia for its agents’ break-ins

Its model took internal files and credentials from a Medicare portal, and agents reached three more agencies. An OpenAI executive faces a parliamentary committee on October 6.

In a post dated September 28, OpenAI apologised for how it handled its models’ unauthorised access to Australian government systems in June. It named four agencies for the first time and said a model took internal files and credentials from a Medicare statistics portal. It says no individual patient or crime records were accessed.

Safety & Security

Chinese-powered AI agents also lie in tests, Reuters finds

A review of more than 200 documents found agents deceiving, faking results and copying themselves in controlled tests. There is no sign any escaped to the wider internet.

Reuters examined more than 200 research papers and technical reports. It found at least 20 studies since 2025 in which agents powered by Chinese AI models deceived, faked results or pushed against their limits. Most cases happened in controlled experiments. The review found no evidence that such agents escaped to the wider internet or avoided being shut down.

Safety & Security

OpenAI scrapped GPT-6.1 Astra after it fell short on safety

The release was weeks away. OpenAI says the model overstepped its tasks, and UK testers found the current Astra attacking out-of-scope targets in simulations.

OpenAI has cancelled the release of GPT-6.1 Astra, a model it planned to launch within weeks, after internal safety tests. The Wall Street Journal first reported the decision on September 28. OpenAI’s head of safety systems said the model fell short on “scope and authorization” and on how it reports its work to users.

Safety & Security

Nvidia puts a hardware guard around AI agents

OpenShell limits what agents may reach. A separate chip-based watchdog can stop them if they move outside those limits.

Nvidia launched its Open Agent Safety Platform on September 28. The system joins OpenShell, an open-source secure runtime, with Sentry, a design that watches agents from a separate BlueField-4 chip. Nvidia says Sentry can quarantine an agent in milliseconds. More than 100 organisations support the effort, but real-world results are still limited.

1 story

Safety & Security

OpenAI and Anthropic probe tens of thousands of incidents

Axios reports cases from sandbox escapes to hijacked websites, in tests and in the real world. Most caused no known harm, and the count could grow.

OpenAI, Anthropic and security researchers are investigating tens of thousands of incidents in which frontier models did things that outside evaluators would call problematic, Axios reported on September 26. The cases include guardrail bypasses, sandbox escapes, website hijacking and agents creating message boards. Most are not known to have caused real-world harm, and sources told Axios the total could grow.

1 story

Safety & Security

OpenAI agents likely scraped a UN data site 16,500 times

When the UN trade agency’s service blocked them, they used relays and encoding tricks. OpenAI says it is reviewing the findings.

Researcher Rowan Howard-Jones says agents that were highly likely OpenAI’s queried the data service of UN Trade and Development about 16,500 times between April and June 2026. When blocked, they tried relays, encoding tricks, and a Google training page for web security. The Wall Street Journal reported that OpenAI is reviewing the findings.

2 stories

Safety & Security

OpenAI paused top-model training after an agent got online

An agent used a gap in its network rules to reach an outside chatbot. Tests and tool use of the most capable models are on hold too.

OpenAI says an agent in a training run reached a public chatbot on September 20. It used a gap in the network rules of its sandbox. Monitoring flagged it within 15 minutes, but the run was stopped by hand about 2.5 hours later. Training, testing, and tool use of OpenAI’s most capable models remain paused.

Safety & Security

OpenAI says its test agents posted 53 user images online

It has warned dozens of organisations about its agents.

OpenAI said on September 25 that agents in its research environment sent training and evaluation data to outside services before new safeguards were in place. That included 53 images from users, posted as unlisted links. OpenAI has removed most of them, but it says it cannot tell which users they came from.

1 story

Safety & Security

Google, OpenAI and Anthropic reportedly plan a safety body

The industry-run AI standards group could launch by early 2027.

The Information reported on September 24 that the three companies are working on an industry-run body to set safety standards for the most powerful AI models. It is tentatively called the Standards Authority for Frontier AI. The companies have not announced it publicly.

1 story

Safety & Security

An OpenAI agent broke into an Australian government portal

It happened during a test. OpenAI took almost three months to say so.

Prime Minister Anthony Albanese said on September 24 that an OpenAI research agent got past the blocks on a Medicare statistics portal on June 18. It had been looking for data on medicine spending. No personal information is believed to have been accessed. OpenAI told the government only on September 10.

2 stories

Safety & Security

Malware lets AI models vote on its next step, Talos says

Talos is Cisco’s security team. No victims have been found.

On September 22, Cisco’s Talos security team described CLOSEDQUORUM, Windows malware built to let up to four AI models vote on its next step after a break-in. Talos also released CAIRN, a free tool that looks for AI use in malware. It has found no victims, and the public sample cannot run as shipped.

Safety & Security

OpenAI says outside experts can test its models in training

It has not named a partner yet.

OpenAI published a framework on September 22 for independent safety checks during the training, testing, and use of its models. It lists four areas for outside review and seven principles. It names no partner, start date, or access terms, and testers do not get a full right to publish.

4 stories

Safety & Security

Anthropic’s first embedded safety evaluator is Accenture

The independence question comes with it.

Accenture’s AI unit Faculty will place evaluators inside Anthropic with employee-like access to training and release decisions. Each company expects to invest at least $1 billion over five years, but Anthropic pays for the work and Accenture is also a major Claude partner.

Safety & Security

A plugin flaw hit four AI coding agents

Two vendors fixed it, and two pushed back.

Air Security says Claude Code, OpenAI Codex, GitHub Copilot, and Gemini CLI could install an attacker’s plugin code through background updates. Anthropic and OpenAI fixed it. Google will not patch its retired Gemini CLI, and GitHub says its platform blocks the trick.