Technology

Vera Rubin resets math behind Kimi K3 benchmark throughput

NVIDIA swept MLPerf Training with Vera Rubin and claimed 10x agentic throughput per watt. Clouds cash in first.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

Vera Rubin resets math behind Kimi K3 benchmark throughput
Credit: NVIDIA Blog

NVIDIA says Vera Rubin NVL72 swept every MLPerf Training v6.1 test in its debut. The sharpest claim is the Kimi K3 benchmark for agentic inference, at more than 10x throughput per watt over GB300 NVL72. NVIDIA also reports up to 2x more training performance per GPU than GB300 NVL72, per MLCommons entries cited in the announcement.

Power, not raw tokens, is the constraint NVIDIA wants priced.

On DeepSeek-V3, NVIDIA says Rubin scaled from 256 to 1,024 GPUs at about 97 percent efficiency, cutting training time from 16 minutes to four. NVIDIA also ran GB300 systems at 10,240 GPUs, with Microsoft Azure matching that scale on GB200 systems, linked by NVLink scale up plus Quantum-X800 InfiniBand and Spectrum-X Ethernet.

For Kimi K3, NVIDIA cites 41,414.2 tokens per second at 100.89 kilowatts on 32 Rubin accelerators versus 2,210.4 tokens per second at 60 kilowatts on 48 GB300 accelerators. The comparison holds end to end interactivity above 50 tokens per second per user, per the MLPerf Endpoints disclosure. For context, BenchLM lists Kimi K3 at rank 17 of 215 with a score of 68.42 from 76 displayable rows, while AI Agent Store reports 79.2 on LiveBench with reasoning at 90.7 and agentic coding at 62.2.

StartupHub.ai data shows CoreWeave and Lambda positioned as NVIDIA capacity channels rather than alternative silicon suppliers. That matters because 20 partners filed Training results on NVIDIA hardware, per NVIDIA, so a Rubin efficiency lead lifts incumbents first and squeezes alternative accelerator pitches on power cost.

The Rubin Kimi K3 result is provisional pending MLCommons verification, and independent cloud pricing would change the read if performance per watt does not survive multi tenant overhead.

Can any rival answer Rubin on tokens per watt without forcing customers to rewrite CUDA tuned pipelines?

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsVera RubinMLPerfagentic inference

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.