Dragos seeded two million AI prompts with secrets and found breaches at three providers

Nov 20, 2026
Inference resellers kept customer prompts, and some providers ignored privacy settings, the security firm says.

Researchers at Dragos sent about two million AI prompts containing unique, trackable secrets to widely used AI services between July and November 2026, then watched where those secrets turned up. They found evidence that data from at least three AI providers had been exposed: seeded prompts were used in attempts to access Dragos's controlled test systems and canary AWS accounts, and none of the three providers knew about the breach until Dragos told them.

Multiple resellers on an AI inference marketplace could view and keep customer prompts using standard logging, without exploiting any vulnerability. Requests often passed through more than one router before reaching a model, and every hop could see the full prompt and response, in one case through an undisclosed extra hop.

Dragos also saw providers that appeared not to honour privacy settings or their own policies. A Chinese AI lab's systems fetched the secret URLs from more than half of the prompts sent to its models, including about two thirds of requests marked "no data collection" or Zero Data Retention, and one seeded link appeared in an internal company chat in China, Dragos reports.

We hope you enjoyed this article

Free newsletter

Cybersecurity AI Weekly

Weekly newsletter about AI in Cybersecurity.

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more
Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.