AI Research

Crusoe ties Nvidia at 72 GPUs on cloud

Crusoe matched NVIDIA's 72-GPU FLUX.1 time on virtualized cloud instances, plus a 128-GPU GPT-OSS run.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

2 min read

GPU rack for AI training benchmark
Credit: Crusoe Blog

Crusoe trained FLUX.1 in 23.63 minutes on 72 Blackwell Ultra GPUs, just under NVIDIA's own 72-GPU time of 23.68 minutes, Crusoe said.

Virtualization did not cost speed.

All 10 results ran on virtualized Crusoe Cloud instances that customers rent today, Crusoe said, using KVM with 1:1 GPU passthrough. The full GB300 NVL72 rack ties 18 nodes of four GPUs into one NVLink domain, Crusoe said, so gradients stay off the network fabric. The comparison pool is large. MLCommons lists 24 submitters in Training v6.1, including CoreWeave, Lambda and Nebius, per MLCommons, which makes parity with the reference system the number to watch.

Crusoe put GPT-OSS 20B at 22.94 minutes on 64 B300 GPUs and 15.41 minutes on 128 GPUs, Crusoe said. Crusoe described the 128-GPU run as the largest HGX B300 configuration submitted for that benchmark in the round. The 64-GPU time matched bare metal on premises systems at the same scale, Crusoe said.

Llama 2 70B LoRA moved from 6.82 minutes on 8 B300 GPUs to 3.93 minutes on 16 GPUs and 2.55 minutes on 32 GPUs, Crusoe said. That is 2.7 times faster on four times the GPUs over Quantum-X800 InfiniBand, Crusoe said.

What the times do not show is cost, power or variance across repeats. Published pricing or energy per run would change the read for buyers who rent by the hour.

Can a customer reproduce NVIDIA reference speed on a rented rack without benchmark tuning?

Mentioned in this story

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsCrusoeNVIDIAGB300 NVL72B300MLCommonsFLUX.1GPT-OSS 20BLlama 2 70B

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.