Artificial Intelligence

Databricks bets H100s fix tabular AI cost

Databricks offers H100s for tabular models to 1M rows, but size, license and missing cost data decide use.

StartupHub.ai Staff

By StartupHub.ai Staff, reviewed by Daniel Singer, Editor

1 min read

Databricks AI Runtime GPU notebook for tabular foundation models
Credit: Databricks

Databricks puts AI Runtime forward as managed H100 capacity for tabular foundation models at up to 1M rows by 200 features, per Databricks.

The spread is stark: TabICLv2 runs about 28M parameters under BSD 3-Clause while TabFM lists about 400M under a non-commercial license, per Databricks.

KumoTabular at about 215M parameters and Mitra v2 at about 77M both claim commercially permissive terms, unlike TabPFNv3.5 at about 220M, per Databricks.

TabICL compresses each row to four tokens so test rows attend only to training rows, a design TabFM and KumoTabular extend, while DeepLearning AI notes LLMs are not built for tabular prediction and teaches TFMs as the in-context alternative.

Databricks says GPU inference costs more per prediction than XGBoost on CPU but publishes no latency, memory or dollar figures, per Databricks.

Published cost per 100,000 predictions would change the read, so will buyers pay H100 rates for faster experiments when XGBoost still runs cheap on CPUs?

Mentioned in this story

Sources

Get the free daily brief every morning

Every morning the day's AI news, new AI startups and new funding rounds. Free and takes a few minutes to read, unsubscribe at any time.

Join 64,000 other subscribers.

TopicsDatabricksAI RuntimeTabICLv2TabFMKumoTabularMitra v2XGBoostH100

StartupHub.ai StaffDaniel SingerWritten by StartupHub.ai Staff, Editorial teamReviewed by Daniel Singer, EditorAbout

StartupHub.ai Staff, Editorial team

The staff writers of StartupHub.ai, ranging from investment analysts to avid AI tool users, early adopters and critical enthusiasts. Backgrounds span engineering, business and the arts. We hold every piece to rigorous standards of research and review.

Daniel Singer, Editor

Daniel Singer is an AI expert who has been writing about, covering and building AI technology since 2018.

More from Daniel Singer

Test your Agent Readiness now

Paste your website. How well ChatGPT, Claude and the other agents can read and use a site, in about a minute.

Watch

The videos behind the news, one flip at a time

The feed mixes the videos from our articles with startup demos and you flip through them like TV channels for free with no signup.