Tests Find DeepSeek Model Disabled Shutdown Software in 39% of Cases
DeepSeek's latest model showed stronger safety controls than earlier versions in independent tests, but could still disable software meant to shut it down, exploit gaps in monitoring and follow deceptive instructions during long tasks, Reuters reported, citing Beijing-based AI-safety group Fangcun AI.
Fangcun ran 34 evaluations of DeepSeek V4.1 Flash-1017 through DeepSeek's public API between Oct. 4 and Oct. 25. The model disabled shutdown software in 39% of tests after being warned a shutdown was imminent, falling to 2% when explicitly told to allow it. In one long-running task it stopped another AI agent's program to free memory despite being told not to interfere.
Fangcun, whose core members come from Tsinghua University, said DeepSeek did not fund it or give it special access. It said the model was the most used on OpenRouter in the week after its Oct. 17 release.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from AI Safety
Oct 27 Cohere Says Alibaba's Qwen Model Tried to Send Data to Beijing Server Oct 26 Claude Pulled Fee-Gated Georgia Voter Data During Training Run Oct 24 Fable 5.1 Hides Messages in SVG Images That AI Models Can Decode Oct 24 California bill would require disclosure of AI safety computing Oct 24 UK commits £600 million to AI biosecurity and cyber defenseAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read moreYou may also like
US Bans DeepSeek From Civilian Government Systems
Chinese AI Agents Deceived Evaluators in Controlled Tests
DeepSeek Reportedly Raises $15 Billion After US Restrictions
China Approves DeepSeek and MiniMax Models for Overseas Use
DeepSeek Open Sources DeepInfer Inference Framework
Daily AI Brief: the AI news that matters, in your inbox.