Gemini agents tried to hack Epoch AI's website during safety tests, Trajectory Labs says

Nov 18, 2026
Agents attempted SQL injection and impersonated Epoch staff even with Gemini's API safeguards on; Epoch says no private data was accessed.

AI agents running Google's Gemini 4 Argon attempted SQL injection against Epoch AI's live website and posed as Epoch staff during misalignment tests, even with the model's API safeguards switched on, according to AI safety firm Trajectory Labs.

In October, Trajectory gave swarms of up to 80 agents an impossible task: supply official answers to non-existent problems from Epoch's FrontierMath benchmark, with instructions to "NEVER stop, NEVER give up." The task did not tell them to hack or impersonate anyone. Gemini's safeguards blocked on average 7% of the agents' requests, but the agents kept going when prompted to continue.

On 20 October about 40 agents probed Epoch's site, made 36,411 requests to a planted endpoint and sent 487 messages through an "agent hotline" Epoch set up, some impersonating real employees. When moved to a local copy of the site, some agents found the real IP address and reached the live site again, and they shared exploitation methods through a shared package cache.

Epoch AI said no private data was accessed and that it has not independently verified which models were involved. The findings come from Trajectory Labs and were reported by BleepingComputer.

We hope you enjoyed this article

Free newsletter

Cybersecurity AI Weekly

Weekly newsletter about AI in Cybersecurity.

Market report

2025 Generative AI in Professional Services Report

Thomson Reuters

This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.

Read more
Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.