CoreWeave Sets New AI Benchmark with NVIDIA GB200 Superchips

Apr 2, 2025
CoreWeave has achieved a new AI inferencing benchmark using NVIDIA GB200 Grace Blackwell Superchips, delivering 800 tokens per second on the Llama 3.1 model, as announced in a press release.
CoreWeave Sets New AI Benchmark with NVIDIA GB200 Superchips

CoreWeave has achieved a new record in AI inferencing benchmarks using NVIDIA GB200 Grace Blackwell Superchips, announced in a press release. The company reported delivering 800 tokens per second (TPS) on the Llama 3.1 405B model, one of the largest open-source models, using a CoreWeave instance equipped with two NVIDIA Grace CPUs and four NVIDIA Blackwell GPUs.

Additionally, CoreWeave submitted results for NVIDIA H200 GPU instances, achieving 33,000 TPS on the Llama 2 70B model, marking a 40% improvement over previous NVIDIA H100 instances. These achievements underscore CoreWeave's position as a leading provider of cloud infrastructure services optimized for AI applications.

We hope you enjoyed this article

Consider subscribing to one of our newsletters like Silicon Brief or Daily AI Brief.

Also, consider following us on social media:

AI Chips & Datacenters AI Brief AI Brief (X)
Free newsletter

Silicon Brief

Weekly coverage of AI hardware developments including chips, GPUs, cloud platforms, and data center technology.

Guide
AI interconnect and networking startups

AI interconnect and networking startups

29 private startups developing the chips, optical switches and memory fabrics that move data through AI infrastructure.

Industry analysis

2025 Global Business Services Agenda: Gen AI Takes Center Stage

The Hackett Group

This industry analysis by The Hackett Group explores the transformative impact of generative artificial intelligence (Gen AI) on global business services (GBS) in 2025. The study highlights the shift from exploration to acceleration of Gen AI initiatives, with 89% of executives advancing these projects to improve customer satisfaction, innovate products, and reduce costs. The report also discusses the challenges and strategies for successful Gen AI adoption, emphasizing the need for a technology-enabled operating model and the importance of reskilling the workforce.

Read more

You may also like

Free, six days a week

Daily AI Brief: the AI news that matters, in your inbox.