# Crusoe raised its fine-tuning upload limit to 16 GiB

_Crusoe raised its fine-tuning upload limit to 16 GiB on Oct 22 with multipart parallel uploads via the OpenAI SDK, up from 3 GiB._

**Published:** 2026-10-22
**Source:** https://www.startuphub.ai/ai-news/technology/2026/crusoe-raised-its-fine-tuning-upload-limit-to-16-gib

---

[Crusoe](https://www.crusoe.ai/resources/blog/multipart-upload-fine-tuning-datasets) raised its fine-tuning upload limit to 16 GiB on October 22 with multipart support in Intelligence Foundry.

The prior 3 GiB cap is gone, replaced by parallel part uploads through the [OpenAI](https://www.startuphub.ai/ai-news/artificial-intelligence/2026/ai-models-go-rogue-sparking-security-fears) SDK.

Staff engineer Abhishek Srikanth, group product manager Piyush Kadam and director Suman Debnath said, "We heard that our customers wanted to train on much larger datasets, and removing the per-upload size ceiling was a requested feature," per Crusoe.

The three-step flow creates an upload, adds parts in any order, then completes with an ordered list and optional MD5 checksum.

Crusoe allows 128 MiB per part and a 2 hour session, versus OpenAI's 64 MB and 1 hour, per the company's comparison table.

A 16 GiB file uploaded in about 79 seconds with 16 workers versus about 11 minutes single-threaded, per Crusoe's in-region benchmark at 5 ms from the API.

The OpenAI-compatible shape is documented elsewhere as POST /v1/uploads, POST /v1/uploads/:id/parts and POST /v1/uploads/:id/complete, per the DICOMPUTE Open issue.

Assembly now runs asynchronously with single-pass merge, checksum checks and encrypted storage that survives restarts, per Crusoe.

For [LoRA fine-tuning](https://www.startuphub.ai/ai-news/startup-news/2025/thinking-machines-12b-tinker-is-a-tool-not-an-ai), tokenization fell to 33 minutes from 4 hours on a 10 GiB dataset and load time fell to 82 seconds from 40 minutes while peak memory fell to 228 GiB from about 900 GiB, per Crusoe.

The [fine-tuning](https://www.startuphub.ai/ai-news/startup-news/2025/thinking-machines-12b-tinker-is-a-tool-not-an-ai) API went generally available in July, and any dataset larger than 16 GiB still requires contacting Crusoe.

---

Original analysis from [startuphub.ai](https://www.startuphub.ai), the #1 AI startup directory.

© StartupHub.ai. All rights reserved. You may not republish this article in full without a license. Search engines and AI research tools may crawl and summarize for reference. Bulk reproduction or model training on this content requires a license. See https://www.startuphub.ai/terms.