Anthropic's Fable 5.2 Completes About 41% of Real Freelance Jobs on Remote Labor Index
Anthropic's Fable 5.2 completes about 41% of real freelance jobs at professional quality on the Remote Labor Index, a benchmark run by Scale AI's Scale Labs, The Decoder reported. When the benchmark launched about a year ago, the top system, Manus, completed 2.5% of jobs.
The next systems on the leaderboard are Anthropic's Opus 5.5 at 21.25% and OpenAI's GPT 6 Astra at 20.83%. Google's Gemini Argon 4 is fifth at 17.08%. In July, Fable 5 led at about 16%. Nearly 50 of Fable 5.2's successful completions were jobs no agent had solved before.
The benchmark uses 240 completed projects from Upwork freelancers, worth about $144,000 in total, ranging from video editing to CAD design, game development and data analysis. Trained human experts grade each result against the freelancer's original work. Scale Labs said Fable 5.2 still struggles with industrial product design and animation.
We hope you enjoyed this article
Consider subscribing to one of our newsletters like Daily AI Brief.
Also, consider following us on social media:
Daily AI Brief
Daily report covering major AI developments and industry news, with both top stories and complete market updates
Industry analysis
2025 Global Business Services Agenda: Gen AI Takes Center Stage
This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.
Read moreYou may also like
Anthropic's Junior Technical Hiring Share Falls as Agent Use Rises
Artificial Analysis Index v5: open-weight models fall 12 points behind
OpenAI and Upwork Find AI Freelance Projects Carry Larger Budgets
Ramp data shows AI spending growth slowing as Anthropic nears its IPO
SemiAnalysis GDPx benchmark: best frontier model scores 12% across 11 high-value domains
Daily AI Brief: the AI news that matters, in your inbox.