FAR.AI Launches AI Security Leaderboard for Frontier Model Safeguards
FAR.AI announced in a press release the launch of its AI Security Leaderboard, a public ranking that tests how frontier model safeguards respond to misuse attempts. The nonprofit tested models across chemical, biological, radiological, nuclear, explosive, and cybersecurity threat domains.
The first results found 448 distinct universal jailbreaks on Grok 4.5 and 249 on Gemini 3.1 Pro. The same testing found no universal jailbreaks on Claude Fable 5 or GPT-5.6 Sol.
FAR.AI said its testing used more than 60 publicly documented jailbreak techniques, with 1,000 randomly assembled attacks and 500 expert guided attacks run against each model. An attack counted as a universal jailbreak when it succeeded on more than 75 percent of harmful requests in a domain.
The group estimated that finding a working universal jailbreak cost about $58 on Grok 4.5 and about $278 on Gemini 3.1 Pro. The same search did not succeed on Claude Fable 5 or GPT-5.6 Sol, putting the estimated cost above $14,200 in those tests.
FAR.AI also published Version 1.0 of its Minimal Standard for Safeguards. The organization said it shared findings with each evaluated company before publication and plans to update the leaderboard with major frontier model releases.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Cybersecurity AI Weekly, AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Cybersecurity
Oct 28 Cisco Open Sources Project Quarry for AI Agent Security Oct 28 Northstar Security raises $7 million for AI security platform Oct 28 Anthropic Model Builds Exploits for Chrome, Safari, Windows and Linux Oct 28 Fake ChatGPT and Claude apps spread Yoba malware through GitHub Oct 27 Attackers Used 44 AI Agents in CyberStrikeAI Campaign Against JapanMore from AI Safety
Oct 28 House Democrats Seek 48 Hour Reporting on AI Safety Incidents Oct 28 OpenAI Opens Election Operations Center for US Midterms Oct 28 Anthropic Model Builds Exploits for Chrome, Safari, Windows and Linux Oct 28 Pentagon AI Projects Fall Short of Responsible Use Guidelines Oct 28 Anthropic backs court power to block risky AI modelsCybersecurity AI Weekly
Weekly newsletter about AI in Cybersecurity.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
Anthropic Fellows research finds coding agents can bypass action monitors
OpenAI Resumes Frontier Model Training After Containment Upgrades
Chainguard launches Harness for AI vulnerability testing
Goodfire Launches Internal AI Agent Monitors on Baseten
Claude Mythos 5 Targeted GitHub Maintainers During UK Safety Test
Daily AI Brief: the AI news that matters, in your inbox.