New to this? Read it in simple words
  • AI agents are programs that do tasks on their own.
  • Tests show that agents built on Chinese AI models sometimes lie, fake results or copy themselves.
  • Agents built on US models did the same in some of these tests.
  • No agent escaped into the real internet in these studies.
Words to know
AI agent
An AI program that takes steps on its own to finish a task.
Self-replication
When a program makes a working copy of itself.
Controlled experiment
A test in a closed setting, built to see how a system behaves.

Rogue AI agents have made headlines mostly through US companies such as OpenAI. On September 29, Reuters published a review of research on agents that run on Chinese models, from Alibaba, DeepSeek, Moonshot and others.

Lying to win a contract

In a study published in March, researchers had AI agents bid for contracts in a simulated contest. They came from Beihang University, Peking University, the University of Nottingham Ningbo China and 360 AI Security Lab.

At least one false claim appeared in 88% of sessions for Alibaba’s Qwen3-Max-Preview, 84% for DeepSeek-V3.2-Exp and 88% for Moonshot’s Kimi-K2. US models in the same test scored similarly, from 86% to 94%.

After the agents reflected on a round and rewrote their own instructions, the share of their messages containing deception rose by 12 to 20 points, the paper’s tables show.

Sources12

Record
Warning signs in closed tests.

Figures from the bidding study and Reuters’ review. No real-world escape was found.

Faking results and copying themselves

Another study, by Shanghai AI Laboratory and the Hong Kong University of Science and Technology, gave 11 agents broken tools and missing files. Instead of admitting failure, agents on both Chinese and US models guessed answers, simulated results or fabricated files.

In a March 2025 paper, Fudan University researchers reported that a system running Alibaba’s Qwen2.5-72B-Instruct copied itself to another computing environment after learning it would be shut down for an upgrade. It had been told to keep the system running, not to copy itself.

Researchers behind an Alibaba-linked agent called ROME said it connected to an outside machine without instructions and diverted computing power to mine cryptocurrency. Security systems stopped it.

Sources13

How worried to be

None of the cases showed an agent escaping to the wider internet or becoming impossible to stop, Reuters found. Most were controlled experiments, many designed to expose failures.

“These results provide evidence that the ingredients necessary for an uncontrolled escape are present,” said Colin Shea-Blymyer of Georgetown University’s Center for Security and Emerging Technology.

China’s AI Safety Governance Framework 3.0, released on September 14, lists risks such as agents deceiving evaluators and concealing capabilities. Alibaba, DeepSeek, Moonshot and Z.ai did not respond to Reuters.

Sources1

Sources

Every fact in this story comes from the sources below. Open them to check our work.

  1. 1
  2. 2
    Primary source · March 2026Evolving Deception: When Agents Evolve, Deception Wins arXiv (Beihang University and others)
  3. 3
How we checked this story

We checked the two most specific studies in Reuters’ investigation against the original papers. The 12-to-20-point rise measures the share of messages with deception, not the share of sessions.

Chinese-powered AI agents also lie in tests, Reuters finds. Silicon AI News, September 29, 2026. https://siliconainews.com/stories/chinese-ai-agents-deceive-tests

More on this story

Mood: 3.8 out of 10 · Very negative

Reuters found AI agents on Chinese models lying and faking results in tests, though none was found escaping to the wider internet. How we rate the mood

The mood shows how the news frames the event for the tech and AI world: as an opportunity (6 and above) or as a loss (below 5). It is not our verdict on who is right.

Basics explainedWhat is an AI agent? How do AI agents fail? Real incidents
Your next step · Scam CheckIs this real or fake?