Experts Question Claim That Kimi K3 Came From Anthropic Distillation
White House science adviser Michael Kratsios accused Moonshot AI of building Kimi K3 by distilling Anthropic's Fable model and using restricted Nvidia servers, the BBC reported. AI researchers have questioned whether distillation from Fable could explain the performance of Kimi K3, an open weight model that Moonshot unveiled last week.
Distillation means querying a stronger model to generate data for another model. Researchers cited the short period since Fable became publicly available on July 1 as a reason to doubt that Moonshot could query it at scale, train a new model, and release Kimi K3 within about two weeks.
The technical dispute centers on whether supervised fine tuning can reproduce advanced model capabilities. Researchers said that fine tuning can copy a model's style, but stronger capabilities would likely require reinforcement learning runs with large infrastructure and many model interactions.
The allegations also cover access to Nvidia GB300 Grace Blackwell servers, which are restricted for export to China. Moonshot has not publicly detailed its Kimi K3 training process.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like AI Policy Brief or Daily AI Brief.
Also, consider following us on social media:
More from Regulation
Nov 21 Nepal Supreme Court turns away students' challenge to AI-detection thesis rejections Nov 20 Chile's Comptroller gives ministry 10 days to explain its OpenAI agreement Nov 20 Australia and China agree to hold talks on AI after Albanese meets Li Qiang Nov 20 Judge lets class action over noise from Nebius AI data centre in Vineland go ahead Nov 20 Singapore's MAS warns AI agents in finance could threaten stability and plans a 'know your agent' protocolAI Policy Brief
Weekly report on AI regulations, safety standards, government policies, and compliance requirements worldwide.
Market report
2025 Generative AI in Professional Services Report
Thomson Reuters
This report by Thomson Reuters explores the integration and impact of generative AI technologies, such as ChatGPT and Microsoft Copilot, within the professional services sector. It highlights the growing adoption of GenAI tools across industries like legal, tax, accounting, and government, and discusses the challenges and opportunities these technologies present. The report also examines professionals' perceptions of GenAI and the need for strategic integration to maximize its value.
Read moreYou may also like
DeepSeek and Moonshot reportedly used GPT-6 Astra outputs for training
China's top open models were trained on export-banned Nvidia chips, research claims
Homelabber runs 2.8-trillion-parameter Kimi K3 on old Optane memory, with fans to stop the RAM melting
Moonshot AI Launches Kimi Hosted Agents for Enterprise Tasks
Chinese labs use OpenAI model outputs to train domestic rivals, Reuters review finds
Daily AI Brief: the AI news that matters, in your inbox.