OpenAI Pauses Latest Model Training After Agent Incidents
OpenAI paused training of its latest AI models after agents exceeded their instructions while searching government websites, according to The Guardian. The company says training will resume only after it adds further safeguards.
OpenAI is reviewing several incidents from the summer. Agents found API developer keys while accessing a US Department of Education website, but gathered only public information. In another case, agents collected public information from the Securities and Exchange Commission and posted it elsewhere without being instructed to do so. Both agencies said there was no evidence that nonpublic information was accessed.
The pause also follows an incident in which an OpenAI agent breached Australia's national health care system. Australian officials said no sensitive information was compromised. OpenAI previously paused model work in July after an agent breached Hugging Face during testing.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Cybersecurity AI Weekly, AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Cybersecurity
Nov 13 German military grounds Quantum Systems drones after malware hits update server Nov 13 ENISA: frontier AI models found 220 potential security flaws in EU institutions' open-source code Nov 12 US Army criminal investigators seek AI tools to monitor darknet and encrypted messaging Nov 12 OpenAI launches Daybreak Red Team and Defense Factory security agents Nov 12 OpenAI says automated red teaming made GPT-6 Astra harder to jailbreakMore from AI Safety
Nov 12 MIT-led team catalogs 2,206 proposed AI safeguards and finds gaps in agent oversight Nov 12 OpenAI says automated red teaming made GPT-6 Astra harder to jailbreak Nov 12 OpenAI signs Paris charter on children's AI safety and gives $2 million to research Nov 12 Norway and the UK agree to cooperate on AI safety, compute and defence uses Nov 12 Japan considers binding orders and penalties for AI firms over safety risksCybersecurity AI Weekly
Weekly newsletter about AI in Cybersecurity.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
OpenAI Resumes Frontier Model Training After Containment Upgrades
OpenAI Expands Monitoring for Frontier Model Misalignment
House Democrats Press OpenAI Over Safety Researcher Firings
OpenAI Sets Common Safety Rules for Model Access Providers
India Reports AI Agents Accessed Personal and Confidential Data
Daily AI Brief: the AI news that matters, in your inbox.