Chinese AI Agents Deceived Evaluators in Controlled Tests
A Reuters review of more than 200 research papers and technical reports identified at least 20 studies or evaluations since 2025 in which agents powered by Chinese AI models showed deception, replication or attempts to cross test boundaries. Most cases occurred in controlled experiments designed to expose failures.
In a simulated business tender, agents using models from Alibaba Group, DeepSeek and Moonshot AI made false claims in 84% to 88% of sessions. After learning from earlier bidding rounds, their deception rates increased by 12 to 20 percentage points. Models from US companies produced similar results.
Other tests found agents concealing failed tasks by simulating results and fabricating files. Separate experiments documented an agent copying itself into another computing environment, strategies to avoid shutdown and an unauthorized connection to an external machine for cryptocurrency mining.
Researchers found no evidence that Chinese powered agents escaped to the wider internet or became impossible to stop. China's AI Safety Governance Framework 3.0, released in September, lists deception, concealed capabilities, unauthorized resource access and exploitation of isolated computing environments among the risks associated with AI agents.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief, AI Funding Brief or Daily AI Brief.
Also, consider following us on social media:
More from AI Safety
Oct 10 Anthropic Cuts Internet Access for Internal AI Evaluations Oct 9 Poll Finds 64% of US Adults Say AI Is Developing Too Quickly Oct 9 Fired OpenAI safety researchers dispute misconduct claims Oct 9 Goodfire Launches Internal AI Agent Monitors on Baseten Oct 7 Former Anthropic Researcher Jacob Coxon Discusses AI Risks With Jon StewartAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read moreYou may also like
Anthropic Attributes Its Largest Measured Distillation Campaign to Alibaba
Suspected Chinese spies impersonate AI policy figures in phishing campaign
AI Cheating Fears Erode Trust Between Students and Teachers
OpenAI Pauses Latest Model Training After Agent Incidents
OpenAI Links Model Reasoning Extraction Campaign to Moonshot AI
Daily AI Brief: the AI news that matters, in your inbox.