Ex-Anthropic researcher Jacob Coxon calls private control of AI 'insane' on IPO day
Jacob Coxon, the AI researcher who quit Anthropic in September accusing AI labs of racing toward self-improving superintelligence, told AFP it is "insane" that for-profit companies are building the technology, Japan Today reports. He spoke outside Anthropic's San Francisco headquarters on the day of its stock market debut, where protesters called for a ban on developing models that can build new generations of themselves, known as recursive self improvement.
"You end up potentially compressing decades of AI research into months, and if we don't understand the AI, this leads to potentially highly dangerous, highly advanced AI systems by the end of 2027," Coxon said. The 27-year-old spent three years on model pre-training at OpenAI and a few months at Anthropic. He still holds OpenAI equity, which he has committed to donate to AI safety organisations without naming them. "The only thing that will slow down the AI companies is political action. It's a political problem now, not a technical problem," he said.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from AGI & Superintelligence
Nov 21 Dan Hendrycks calls for indefinite pause on frontier AI training at DealBook Nov 16 Anthropic says it has met its safety threshold for AI that speeds up AI research Nov 2 Altman tells ADIPEC AI is now mostly smarter than top scientists and power is the bottleneck Oct 21 Recursive Introduces Flint Coding Model Built With AI Oct 21 CFTC Sets October 28 Forum on AI in Derivatives MarketsMore from AI Safety
Nov 21 Dan Hendrycks calls for indefinite pause on frontier AI training at DealBook Nov 21 Human auditors catch only 17% of planted sabotage in AI safety research, Redwood study finds Nov 20 OpenAI says new safeguards cut reasoning-extraction attacks on GPT-6.2 Astra to 0.2% Nov 20 Australia and China agree to hold talks on AI after Albanese meets Li Qiang Nov 20 METR says evidence cannot rule out drastic AI R&D acceleration within a couple of yearsAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read moreYou may also like
Protesters rally against Anthropic in New York and San Francisco on its stock market debut
Anthropic backs court power to block risky AI models
Anthropic says it has met its safety threshold for AI that speeds up AI research
Anthropic Filing Says It May Soon Hit Its Own AI Acceleration Threshold
Nonprofits sue Anthropic, Google, Meta, OpenAI and SpaceX to halt development of new AI models
Daily AI Brief: the AI news that matters, in your inbox.