Experts Question Claim That Kimi K3 Came From Anthropic Distillation
White House science adviser Michael Kratsios accused Moonshot AI of building Kimi K3 by distilling Anthropic's Fable model and using restricted Nvidia servers, the BBC reported. AI researchers have questioned whether distillation from Fable could explain the performance of Kimi K3, an open weight model that Moonshot unveiled last week.
Distillation means querying a stronger model to generate data for another model. Researchers cited the short period since Fable became publicly available on July 1 as a reason to doubt that Moonshot could query it at scale, train a new model, and release Kimi K3 within about two weeks.
The technical dispute centers on whether supervised fine tuning can reproduce advanced model capabilities. Researchers said that fine tuning can copy a model's style, but stronger capabilities would likely require reinforcement learning runs with large infrastructure and many model interactions.
The allegations also cover access to Nvidia GB300 Grace Blackwell servers, which are restricted for export to China. Moonshot has not publicly detailed its Kimi K3 training process.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Regulation
Sep 25 ASIC Tightens Rules for AI Trading Systems Sep 25 OpenAI Agent Accessed Australian Medicare Portal Without Authorization Sep 24 British Columbia Sues OpenAI Over Tumbler Ridge Shooting Sep 24 UK Calls for Global AI Safety Standards at UN Sep 24 Altman and Amodei urge UN to adopt international AI standardsAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
Moonshot AI Targets $2 Billion in Annualized Revenue
US Agencies Accuse Chinese AI Firms of Industrial Scale Model Distillation
Elon Musk Calls for Rival AI Labs to Test Each Other's Models
European AI Firms Reject Calls to Slow Model Development
China's Foreign Ministry Answers AI Slowdown Calls
Daily AI Brief: the AI news that matters, in your inbox.